ComfyUI Extension: ComfyUI-UltraEdit-ZHO

ComfyUI-UltraEdit-ZHO Introduction

ComfyUI-UltraEdit-ZHO is an unofficial implementation of the UltraEdit model for ComfyUI. UltraEdit is a powerful image editing model based on Stable Diffusion 3 (SD3) that allows you to edit images using simple text prompts. This extension makes it easy for AI artists to perform both global and region-specific edits while maintaining stylistic consistency. Whether you are working on local projects or using cloud services, ComfyUI-UltraEdit-ZHO provides a seamless experience by supporting both local model loading and automatic model downloading.

How ComfyUI-UltraEdit-ZHO Works

ComfyUI-UltraEdit-ZHO leverages the capabilities of the UltraEdit model to enable text-based image editing. The model uses a combination of image and text guidance to modify images according to the provided prompts. Here’s a simplified breakdown of how it works:

1. Model Loading: The extension can load the UltraEdit model either from local files or by automatically downloading it from the internet.
2. Image Input: You provide an image that you want to edit.
3. Mask Input (Optional): You can also provide a mask to specify the region of the image you want to edit.
4. Text Prompts: You give positive prompts (what you want to add or change) and negative prompts (what you want to avoid).
5. Processing: The model processes the image based on the prompts and generates the edited image. This process allows for intuitive and flexible image editing, making it accessible even for those without a deep technical background.

ComfyUI-UltraEdit-ZHO Features

UltraEdit Model Loading

• Local Model Loading: You can manually download the necessary models and files from BleachNick/SD3_UltraEdit_w_mask and place them in the /ComfyUI/models/ultraedit directory.
• Automatic Model Downloading: The extension can automatically download the required models, ensuring you always have the latest version without manual intervention.

UltraEdit Generation

• Pipe: Connects the model for processing.
• Image: The image you want to edit.
• Mask (Optional): A mask to specify the region of the image to edit. If not provided, the entire image is edited.
• Positive Prompts: Text prompts describing what you want to add or change in the image.
• Negative Prompts: Text prompts describing what you want to avoid in the image.
• Steps: The number of steps for the editing process, with a default of 50 steps.
• Image Guidance Scale: Controls the influence of the image on the editing process, default is 1.5.
• Text Guidance Scale: Controls the influence of the text prompts on the editing process, default is 7.5. - Seed: A seed value for reproducibility of the results.

ComfyUI-UltraEdit-ZHO Models

The extension uses the UltraEdit model, which is based on Stable Diffusion 3 (SD3). This model supports both global and region-specific edits, making it versatile for various image editing tasks. The model can be loaded either locally or automatically, providing flexibility depending on your setup.

Troubleshooting ComfyUI-UltraEdit-ZHO

Common Issues and Solutions

• Output is 512 Small Images Instead of One: If you encounter this issue, you need to manually edit the UltraEdit.py file. Remove the line output_t = output_t.squeeze(0) at the end of the file.
• Image Size Requirements: Ensure that the input image dimensions are multiples of 4 to avoid processing errors.

Frequently Asked Questions

• Why is my model not loading?
• Ensure you have placed the model files in the correct directory if using local loading.
• Check your internet connection if using automatic downloading.
• How do I use a mask for region-specific editing?
• Provide a mask image in the mask input. You can convert a mask to an image format using the "convert mask to image" node if needed.

Learn More about ComfyUI-UltraEdit-ZHO

For additional resources, tutorials, and community support, you can explore the following links:

• UltraEdit GitHub Repository
• UltraEdit Demo on Hugging Face
• UltraEdit Dataset on Hugging Face
• UltraEdit Model on Hugging Face These resources provide comprehensive information and examples to help you get the most out of ComfyUI-UltraEdit-ZHO.