The ComfyUI Prompt-Relay is an innovative tool designed to streamline the process of generating video prompts by intelligently distributing latent frames across different segments. It eliminates the need for manual frame counting, allowing users to focus on crafting detailed narratives for their videos.
- Supports two distinct syntax styles for prompt creation: inline and block formatting.
- Features a
global_promptfield to maintain consistent details throughout the video, enhancing storytelling coherence. - Offers a
normalize_by_tokensoption that adjusts segment weights based on the number of tokens, ensuring more complex segments receive appropriate emphasis.
Context
The ComfyUI Prompt-Relay serves as an extension within the ComfyUI ecosystem, specifically aimed at enhancing video prompt generation. Its primary function is to automatically allocate latent frames to various segments of a video based on user-defined prompts, simplifying the creative process for users.
Key Features & Benefits
This tool introduces a dual syntax approach for prompt creation, allowing users to choose between inline or block styles, catering to different preferences in prompt structuring. The global_prompt feature enables consistent thematic elements to be carried throughout the video, ensuring that critical details remain intact. Furthermore, the normalize_by_tokens toggle enhances the distribution of frames by considering the complexity of each segment, ultimately leading to a more balanced representation of the narrative.
Advanced Functionalities
The tool offers advanced capabilities such as the ability to use the word2number Python package for flexible numerical representation in headers, which can be beneficial for users who prefer writing numbers in word form. Additionally, it provides a structured approach for integrating outputs from Video Language Models (VLM) or Large Language Models (LLM), ensuring that the prompts are formatted correctly for optimal processing.
Practical Benefits
By automating the allocation of latent frames and providing a clear framework for prompt creation, the ComfyUI Prompt-Relay significantly improves workflow efficiency within ComfyUI. Users gain greater control over the narrative pacing and visual storytelling, which enhances the overall quality of video outputs.
Credits/Acknowledgments
The original project can be found at the provided link, and contributions to this tool are acknowledged from the community and developers involved in its creation. The repository is open-source, allowing for further enhancements and adaptations by users.
