ComfyUI Extension: ComfyUI Sequential Image Loader

ComfyUI Sequential Image Loader Introduction

ComfyUI-SeqImageLoader is an extension for ComfyUI that allows you to load and process frames from a video in bulk. This extension is particularly useful for AI artists who want to perform masking and sketching on each frame of a video through an intuitive graphical user interface (GUI). By using this extension, you can streamline the process of editing video frames, making it easier to apply consistent changes across multiple frames.

How ComfyUI Sequential Image Loader Works

The extension works by extracting frames from a video file and loading them into ComfyUI. You can then use the built-in tools to mask and sketch on each frame. Think of it as a way to break down a video into individual images, edit those images, and then potentially reassemble them into a video. This can be particularly useful for creating animations or applying consistent edits across a sequence of frames.

ComfyUI Sequential Image Loader Features

SequentialImageLoader Node

Input

• sequence_id: This is used for internal processing and can be ignored.
• Upload Button: Allows you to specify the directory containing the video frames. You can use tools like ffmpeg to extract frames from a video.
• start_index: Specifies the starting frame number. Set to 0 to disable.
• end_index: Specifies the ending frame number. Set to 0 to disable.

Output

• images: The loaded frame data. Any sketching applied will be reflected in this output.
• mask_images: Masks for each frame are output as images. You may need to convert them to mask data using a Mask To Image node.
• image_count: The number of processed frames.

VideoFrameExtractor Node

This node allows you to specify a video file (currently only mp4 format is supported) instead of a directory containing frames. It functions similarly to the SequentialImageLoader Node but uses a video file as the source.

Mask Editor

1. Open Mask Editor: After loading the frames, right-click the node and select "Open In MaskEditor".
2. Masking and Sketching: In the editor, you can perform masking and sketching as needed. The editor is based on the standard Mask Editor.

Editor Features

image

1. Switch between automatic masking (magic wand) and manual masking.
2. Switch between masking and sketching.
3. Canvas: Right-click to mask, left-click to unmask.
4. Change the frame being edited.
5. Clear the mask on the current frame.
6. Paste the mask from the previous frame to the current frame.
7. Change the thickness of the masking tool.
8. Undo/Redo operations (Shortcut keys: alt+Z/shift+alt+Z).
9. Save or cancel the results.

ComfyUI Sequential Image Loader Models

Currently, the extension does not include different models. It focuses on loading and editing video frames.

What's New with ComfyUI Sequential Image Loader

Updates and Changes

• Initial Release: The first version of ComfyUI-SeqImageLoader includes the SequentialImageLoader and VideoFrameExtractor nodes, along with a comprehensive Mask Editor.

Troubleshooting ComfyUI Sequential Image Loader

Common Issues and Solutions

1. Frames Not Loading: Ensure that the directory path is correct and that the frames are in a supported format.
2. Masking Tool Not Working: Make sure you are in the correct mode (masking or sketching) and that you are using the right mouse button for the desired action.
3. Video File Not Supported: Currently, only mp4 files are supported. Convert your video to mp4 format if necessary.

Frequently Asked Questions

• How do I extract frames from a video? You can use tools like ffmpeg to extract frames from a video. For example:

ffmpeg -i input.mp4 -vf "fps=1" frame_%04d.png

• Can I use this extension for real-time video editing? No, this extension is designed for frame-by-frame editing and is not suitable for real-time video editing.

Learn More about ComfyUI Sequential Image Loader

Additional Resources

• ComfyUI Documentation: Official documentation for ComfyUI.
• ffmpeg Documentation: Learn how to use ffmpeg for video processing.
• Community Forums: Join the community to ask questions and share your experiences. By using ComfyUI-SeqImageLoader, you can efficiently edit video frames, making it easier to create animations or apply consistent changes across multiple frames. Whether you're an AI artist or a video editor, this extension provides the tools you need to enhance your workflow.