Multi-Process Parallelization with ProcessPoolExecutor - #276

Open

BuffMcBigHuge wants to merge 55 commits into

livepeer:mainfrom

BuffMcBigHuge:marco/multiprocess-clean

Commits on Mar 18, 2025

Preliminary work for ComfyUI native API integration.
BuffMcBigHuge
committed
dcbdcfe

Commits on Mar 25, 2025

Cleanup of pre/post processing of frames.
BuffMcBigHuge
committed
b3a95ad
Added built-in nodes for base64 string and websocket image send, reduced uncessary base64 input frame operations, prep for multi-instance, cleanup.
BuffMcBigHuge
committed
50ca4a1
Preliminary work on multi-Comfy server inference.
BuffMcBigHuge
committed
d66dac4
Work on frame timing and management, added max_frame_wait argument, added config for server management.
BuffMcBigHuge
committed
d3b0b3c
Cleaned up prompt manipulation with custom nodes.
BuffMcBigHuge
committed
63014e3
Added frame tracking, add frame timing stability, added mismatched frame size handling, commented out some logging.
BuffMcBigHuge
committed
15b51a8

Commits on Apr 1, 2025

Commits on Apr 8, 2025

Commits on Apr 16, 2025

Commits on Apr 22, 2025

Commits on Apr 23, 2025

Better error handling for Comfy instances via spawn, reorganization of app, pipeline and config files.
BuffMcBigHuge
committed
6c07c65

Commits on Apr 24, 2025

Fix to linux subprocess command.
BuffMcBigHuge
committed
93308b6

Commits on Apr 25, 2025

Added spawned comfy specific logging, modified client logging, modifications to spawning instances, better handling of misconfigured workspace.
BuffMcBigHuge
committed
98b78e8

Commits on Apr 29, 2025

Modification to logging handler for subprocesses.
BuffMcBigHuge
committed
5b3ac66
Merge branch 'main' into comfy-native-local
BuffMcBigHuge
committed
766277b

Commits on May 2, 2025

Added optional ROOT_DIR environment variable to help with build_trt script.
BuffMcBigHuge
committed
07a9c51

Commits on May 6, 2025

Code cleanup, modification to frame timing mechanism, added frame logging utility.
BuffMcBigHuge
committed
fb44f6d

Commits on May 7, 2025

Commits on May 8, 2025

Commits on May 14, 2025

Merge branch 'main' into marco/logging-updates
BuffMcBigHuge
committed
db2e191

Commits on May 20, 2025

Merge branch 'main' into marco/logging-updates
BuffMcBigHuge
committed
8aadc8d
First version of multi working.
BuffMcBigHuge
committed
2539741
Merge branch 'main' into marco/multiprocess
BuffMcBigHuge
committed
7ec44b3

Commits on May 21, 2025

Simplify video input, small fix.
BuffMcBigHuge
committed
ad44766

Commits on May 26, 2025

Restructure of distribution logic, added pipeline/tensor_cache logging, attempt to fix tensor_rt directory retrieval in comfyui.
BuffMcBigHuge
committed
cbeb89e

Commits on May 27, 2025

Commits on May 28, 2025

Commits on May 29, 2025

Commits on Jun 5, 2025

Commits on Jun 24, 2025

Merge branch 'main' into marco/multiprocess-clean
BuffMcBigHuge
committed
3847c07

Commits on Jun 25, 2025