ComfyUI Node: Load Video (Upload) 🎥🅥🅗🅢

Load Video (Upload) 🎥🅥🅗🅢:

The VHS_LoadVideo node is designed to facilitate the loading of video files into your AI art projects. This node allows you to upload video files directly, making it easy to incorporate video content into your creative workflows. By leveraging this node, you can extract frames, audio, and metadata from video files, enabling a seamless integration of video elements into your projects. The primary goal of this node is to simplify the process of working with video files, providing a user-friendly interface for uploading and processing videos without requiring extensive technical knowledge.

Load Video (Upload) 🎥🅥🅗🅢 Input Parameters:

video

This parameter specifies the path to the video file you wish to upload. It is essential for locating and loading the video content into the node. Ensure that the file path is correct and accessible. There are no specific minimum or maximum values, but the path must point to a valid video file.

force_rate

This parameter allows you to set a specific frame rate for the video. If you want to override the original frame rate of the video, you can specify the desired frame rate here. The default value is the original frame rate of the video. Adjusting this parameter can impact the smoothness and speed of the video playback.

force_size

This parameter lets you enforce a specific resolution for the video frames. You can choose from predefined options or set custom dimensions using the custom_width and custom_height parameters. The default value is "Disabled," which retains the original resolution of the video. Changing this parameter can affect the quality and size of the video frames.

custom_width

This parameter allows you to specify a custom width for the video frames if force_size is enabled. It is used in conjunction with custom_height to define the exact dimensions of the video frames. The default value is the original width of the video. Adjusting this parameter can help fit the video frames to specific requirements.

custom_height

This parameter allows you to specify a custom height for the video frames if force_size is enabled. It is used in conjunction with custom_width to define the exact dimensions of the video frames. The default value is the original height of the video. Adjusting this parameter can help fit the video frames to specific requirements.

frame_load_cap

This parameter sets a limit on the number of frames to load from the video. It helps manage memory usage and processing time by restricting the number of frames processed. The default value is unlimited, meaning all frames will be loaded. Setting a lower value can improve performance but may result in incomplete video content.

skip_first_frames

This parameter allows you to skip a specified number of initial frames in the video. It is useful for ignoring unwanted content at the beginning of the video. The default value is 0, meaning no frames are skipped. Adjusting this parameter can help focus on the relevant part of the video.

select_every_nth

This parameter enables you to select every nth frame from the video, effectively downsampling the frame rate. It helps reduce the number of frames processed, which can save memory and processing time. The default value is 1, meaning every frame is selected. Increasing this value can result in a choppier video but can be useful for specific effects or performance optimization.

meta_batch

This optional parameter allows you to specify a meta batch configuration for processing the video frames in batches. It helps manage memory usage and processing efficiency. The default value is None, meaning no meta batching is applied. Using this parameter can optimize the node's performance for large video files.

unique_id

This optional parameter allows you to assign a unique identifier to the video processing task. It helps track and manage multiple video processing tasks. The default value is None, meaning no unique identifier is assigned. Using this parameter can help organize and differentiate between various video processing tasks.

memory_limit_mb

This optional parameter sets a memory limit for the video processing task, specified in megabytes. It helps prevent excessive memory usage and potential crashes. The default value is None, meaning no memory limit is enforced. Setting a memory limit can help manage system resources and ensure stable performance.

vae

This optional parameter allows you to specify a Variational Autoencoder (VAE) for encoding the video frames. It helps compress and encode the video frames into latent representations. The default value is None, meaning no VAE encoding is applied. Using this parameter can help reduce the size of the video frames and enable advanced processing techniques.

Load Video (Upload) 🎥🅥🅗🅢 Output Parameters:

IMAGE

This output parameter provides the loaded video frames as images. Each frame is converted to an image format suitable for further processing and manipulation within your AI art projects. The images are in RGB format and can be used for various creative purposes.

frame_count

This output parameter indicates the total number of frames loaded from the video. It provides a count of the frames available for processing and helps track the extent of the video content.

audio

This output parameter provides the audio extracted from the video. The audio is available as a separate stream and can be used for synchronization, analysis, or creative manipulation alongside the video frames.

video_info

This output parameter provides metadata about the loaded video, including information such as frame rate, frame count, duration, width, and height. It helps understand the properties of the video and can be used for further processing and analysis.

LATENT

This output parameter provides the latent representations of the video frames if a VAE is used. The latent representations are compressed versions of the video frames and can be used for advanced processing techniques, such as generative modeling or feature extraction.

Load Video (Upload) 🎥🅥🅗🅢 Usage Tips:

• Ensure the video file path is correct and accessible to avoid loading errors.
• Use the force_rate parameter to adjust the frame rate for specific effects or synchronization needs.
• Enable force_size and set custom_width and custom_height to fit the video frames to your desired resolution.
• Use frame_load_cap to limit the number of frames loaded, which can help manage memory usage and processing time.
• Skip unwanted initial frames using the skip_first_frames parameter to focus on the relevant part of the video.
• Downsample the frame rate using select_every_nth to reduce the number of frames processed and save resources.

Load Video (Upload) 🎥🅥🅗🅢 Common Errors and Solutions:

Invalid video file: <video>

• Explanation: The specified video file path is incorrect or the file does not exist.
• Solution: Verify the file path and ensure the video file is accessible.

Memory limit hit after loading <n> frames. Stopping execution.

• Explanation: The memory limit set by memory_limit_mb has been exceeded during video processing.
• Solution: Increase the memory limit or reduce the number of frames loaded by adjusting frame_load_cap or select_every_nth.

No frames generated

• Explanation: No frames were successfully loaded from the video, possibly due to an incorrect file path or unsupported video format.
• Solution: Check the video file path and ensure the video format is supported. Adjust input parameters if necessary.