ComfyUI Extension: ComfyUI_NetDist

ComfyUI_NetDist Introduction

ComfyUI_NetDist is an extension designed to enhance the capabilities of ComfyUI by allowing you to run workflows on multiple local GPUs or networked machines. This extension is particularly useful for AI artists who need to leverage the power of multiple GPUs to speed up their image generation processes or distribute the workload across different machines. By using ComfyUI_NetDist, you can achieve faster rendering times and more efficient use of your hardware resources.

How ComfyUI_NetDist Works

At its core, ComfyUI_NetDist works by distributing the image generation tasks across multiple GPUs or machines. Think of it as a team of artists working together on a large mural. Instead of one artist doing all the work, each artist (or GPU) is assigned a portion of the mural. This collaborative effort results in a faster and more efficient completion of the artwork.

Here's a simplified breakdown of how it works:

1. Setup Multiple Instances: You start by setting up multiple instances of ComfyUI, each running on a different GPU or machine.
2. Define Workflows: You define the workflows that need to be executed. These workflows are like the blueprints for your artwork.
3. Distribute Tasks: The tasks are then distributed to the different instances based on the available resources.
4. Fetch Results: Once the tasks are completed, the results are fetched back and combined to form the final image.

ComfyUI_NetDist Features

Local Remote Control

This feature allows you to control multiple GPUs on a single machine or across different machines. You can set different ports and CUDA devices to manage the GPUs effectively.

Simple Dual-GPU Setup

Ideal for users with two GPUs or two separate PCs. This setup requires minimal configuration and allows you to set local/remote batch sizes and trigger nodes based on specific conditions.

Simple Multi-Machine Setup

This setup scales the dual-GPU example by connecting more nodes together. It helps in distributing the workload across multiple machines, although it may require some adjustments to avoid duplicate images.

Advanced Setup

For more complex setups involving more than two GPUs, this feature allows for easier per-batch overrides and setting default batch sizes. It also supports using workflow JSONs as inputs, making it highly customizable.

Remote Images

The LoadImageUrl and SaveImageUrl nodes allow you to load and save images via URLs. This is useful for integrating with web services or remote storage solutions.

Remote Latents

This feature enables the seamless passing of latent data between nodes. You can save latents as .npy files and load them from other instances, facilitating complex workflows that require intermediate data sharing.

ComfyUI_NetDist Models

Currently, ComfyUI_NetDist does not include different models. It focuses on distributing tasks across multiple GPUs or machines to optimize performance and efficiency.

What's New with ComfyUI_NetDist

Latest Updates

• Improved Workflow Editing: Enhanced capabilities for editing static workflows, making it easier to manage and customize your tasks.
• Multiple Image Output Handling: Better handling of workflows with multiple separate image output nodes.
• Cross-Platform Compatibility: Fixes for edge cases, such as Linux controlling Windows machines, ensuring smoother operation across different operating systems.

Troubleshooting ComfyUI_NetDist

Common Issues and Solutions

1. Issue: Nodes Not Executing

• Solution: Ensure that the node is set to 'always' trigger if it isn't getting executed. This can happen if you change a sampler setting but not the seed.

2. Issue: Duplicate Images

• Solution: Set the seed to randomized on both instances to avoid generating duplicate images.

3. Issue: Remote Instance Not Connecting

• Solution: Add --listen to your launch arguments and set the correct remote IP. Check your IP using ipconfig on Windows or ip a on Linux.

Frequently Asked Questions

• Q: Can I use ComfyUI_NetDist with different types of GPUs?
• A: Yes, you can use it with different types of GPUs as long as they are supported by ComfyUI.
• Q: How do I check the progress of remote tasks?
• A: Currently, there is no preview/progress bar for remote tasks. You will need to wait for the final image to be generated.

Learn More about ComfyUI_NetDist

For additional resources, tutorials, and community support, you can visit the following links:

• ComfyUI_NetDist GitHub Repository
• NetDistSimple Workflow JSON
• NetDistAdvancedV2 Workflow JSON These resources will help you get started and make the most out of ComfyUI_NetDist. Happy creating!