Yuan-ManX/ComfyUI-Tools-Roadmap

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, Animation, Video, Audio, 3D Model, and more!🔥

44

92 commits

updated Sep 21, 2024

See the code

README

ComfyUI Tools Roadmap 🎮

ComfyUI

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, 3D Model, Animation, Video, Avatar, Audio, Music and more!🔥

Table of Contents

Project List

ComfyUI

ComfyUIDescriptionSourcePaper
ComflowyspaceComflowyspace is an open-source AI image and video generation tool committed to providing a better, interactive experience than the standard SDWebUI and ComfyUI.Comflowyspace
ComfyUIThe most powerful and modular stable diffusion GUI and backend.ComfyUI
ComfyUI BrowserAn image/video/workflow browser and manager for ComfyUI.ComfyUI Browser
Comfy.ICUComfyICU - Run ComfyUI workflows in the Cloud.Comfy.ICU
ComfyUI-Custom-ScriptsEnhancements & experiments for ComfyUI, mostly focusing on UI features.ComfyUI-Custom-Scripts
ComfyUI ManagerComfyUI-Manager is an extension designed to enhance the usability of ComfyUI.ComfyUI Manager
ComfyUI_TensorRTThis node enables the best performance on NVIDIA RTX™ Graphics Cards (GPUs) for Stable Diffusion by leveraging NVIDIA TensorRT.ComfyUI_TensorRT

^ Back to Contents ^

Image

ComfyUIDescriptionSourcePaper
ComfyUI-AnyTextAnyText: Multilingual Visual Text Generation And Editing.AnyTextarXiv
ComfyUI-AuraSRAuraSR: GAN-based Super-Resolution for real-world.AnyText
ComfyUI_CatVTONCatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models.CatVTONarXiv
comfyui_controlnet_auxComfyUI's ControlNet Auxiliary Preprocessors.
ComfyUI_ExtraModelsSupport for miscellaneous image models. Currently supports: DiT, PixArt, T5 and a few custom VAEs.Hunyuan-DiTarXiv
ComfyUI-Flowty-LDSRThis is a custom node that lets you take advantage of Latent Diffusion Super Resolution (LDSR) models inside ComfyUI.
ComfyUI-IC-LightComfyUI native implementation of IC-Light.IC-Light
ComfyUI-InstanceDiffusionInstance-level Control for Image Generation.InstanceDiffusionarXiv
ComfyUI InstantIDZero-shot Identity-Preserving Generation in Seconds.InstantIDarXiv
ComfyUI-IMAGDressingIMAGDressing👔: Interactive Modular Apparel Generation for Virtual Dressing.IMAGDressingarXiv
ComfyUI IPAdapter plusThe IPAdapter are very powerful models for image-to-image conditioning.IP-AdapterarXiv
ComfyUI-KolorsKolors: Effective Training of Diffusion Model for Photorealistic Text-to-Image Synthesis.Kolors
ComfyUI-layerdiffuseTransparent Image Layer Diffusion using Latent Transparency.LayerDiffuse
ComfyUI_MagicClothingMagic Clothing: Controllable Garment-Driven Image Synthesis.Magic ClothingarXiv
ComfyUI-MarigoldMarigold depth estimation in ComfyUI.MarigoldarXiv
ComfyUI-MimicBrushZero-shot Image Editing with Reference Imitation.MimicBrusharXiv
ComfyUI_omostOmost is a project to convert LLM's coding capability to image generation (or more accurately, image composing) capability.Omost
ComfyUI OOTDiffusionOutfitting Fusion based Latent Diffusion for Controllable Virtual Try-on.OOTDiffusionarXiv
ComfyUI PhotoMaker PlusCustomizing Realistic Human Photos via Stacked ID Embedding.PhotoMakerarXiv
comfyui-reactor-nodeFast and Simple Face Swap Extension Node for ComfyUI.
ComfyUI Segment AnythingBased on GroundingDino and SAM, use semantic strings to segment any element in an image.Segment Anything Model (SAM)arXiv
ComfyUI-Segment-Anything-2SAM 2: Segment Anything in Images and Videos.Segment Anything Model 2 (SAM 2)arXiv
ComfyUI StableZero123A Single Image to Consistent Multi-view Diffusion Base Model.Zero123++arXiv
ComfyUI_UltimateSDUpscaleComfyUI nodes for the Ultimate Stable Diffusion Upscale script by Coyote-A.Ultimate SD Upscale
DiffMorpher-ComfyUIDiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphing.DiffMorpherarXiv
PuLID ComfyUIPure and Lightning ID Customization via Contrastive Alignment.PuLIDarXiv

^ Back to Contents ^

Mesh

ComfyUIDescriptionSourcePaper
ComfyUI InstantMeshEfficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models.InstantMesharXiv

^ Back to Contents ^

Texture

ComfyUIDescriptionSourcePaper
Comfy TexturesUnreal Engine ⚔️ ComfyUI - Automatic texturing using generative diffusion models.

^ Back to Contents ^

3D Model

ComfyUIDescriptionSourcePaper
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!CharacterGenarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!CRMarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!Era3DarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!InstantMesharXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!Stable Fast 3DarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!Unique3DarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!Zero123++arXiv
ComfyUI-Flowty-TripoSRTripoSR custom node for comfyui.TripoSRarXiv
ComfyUI-TripoThis extension integrates Tripo into ComfyUI, allowing users to generate 3D models from text prompts or images directly within the ComfyUI interface.TripoSRarXiv

^ Back to Contents ^

Animation

ComfyUIDescriptionSourcePaper
ComfyUI-ADMotionDirectorComfyUI nodes for training AnimateDiff motion loras.AnimateDiff MotionDirector
ComfyUI-AnimateAnyone-EvolvedAnimate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation.Animate AnyonearXiv
ComfyUI-AnimateDiff-EvolvedAnimate Your Personalized Text-to-Image Diffusion Models without Specific Tuning.AnimateDiffarXiv
ComfyUI-AnimateDiff-EvolvedAnimateDiff-Lightning is a lightning-fast text-to-video generation model.AnimateDiff-LightningarXiv
Comfyui-AnimateLCMAccelerating the Animation of Personalized Diffusion Models and Adapters with Decoupled Consistency Learning.AnimateLCMarXiv
ComfyUI-DynamiCrafterAnimating Open-domain Images with Video Diffusion Priors.DynamiCrafterarXiv
ComfyUI-MagicAnimateEasily use Magic Animate within ComfyUI!
ComfyUI-ToonCrafterGenerative Cartoon Interpolation.ToonCrafter

^ Back to Contents ^

Video

ComfyUIDescriptionSourcePaper
ComfyUI-DiffSynth-StudioDiffutoon: High-Resolution Editable Toon Shading via Diffusion Models.DiffutoonarXiv
ComfyUI-MagicAnimateMagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model.MagicAnimatearXiv
ComfyUI-MimicMotionMimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance.MimicMotionarXiv
ComfyUI-DragNUWADragNUWA enables users to manipulate backgrounds or objects within images directly, and the model seamlessly translates these actions into camera movements or object motions, generating the corresponding video.DragNUWA
ComfyUI-SVDExperimental use of stable-video-diffusion in ComfyUI.
ComfyUI-VideoHelperSuiteNodes related to video workflows.

^ Back to Contents ^

Avatar

ComfyUIDescriptionSourcePaper
avatar-graph-comfyuiA custom nodes module for creating real-time interactive avatars powered by blender bpy mesh api + Avatech Shape Flow runtime.
ComfyUI-AniPortraitAudio-Driven Synthesis of Photorealistic Portrait Animations.AniPortraitarXiv
ComfyUI_EchoMimicEchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning.EchoMimicarXiv
ComfyUI-HalloHallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation.HalloarXiv
ComfyUI-IP_LAPThe comfyui custom node of IP_LAP to make audio driven videos!IP_LAParXiv
ComfyUI-LivePortraitKJLivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control!LivePortraitarXiv
Comfyui-MusePoseMusePose: a Pose-Driven Image-to-Video Framework for Virtual Human Generation.MusePose
ComfyUI-MuseTalkReal-Time High Quality Lip Synchorization with Latent Space Inpainting!MuseTalk
ComfyUI-MuseVInfinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising!MuseV
ComfyUI-V-ExpressConditional Dropout for Progressive Training of Portrait Video Generation.V-ExpressarXiv
ComfyUI_wav2lipA custom node for ComfyUI that allows you to perform lip-syncing on videos using the Wav2Lip model. It takes an input video and an audio file and generates a lip-synced output video.Wav2LiparXiv

^ Back to Contents ^

Audio

ComfyUIDescriptionSourcePaper
ComfyUI-AudioSchedulerAudioScheduler project contains a collection of audio processing nodes.
ComfyUI-ChatTTSChatTTS is a generative speech model for daily dialogue.ChatTTS
ComfyUI-GPT_SoVITSA Powerful Few-shot Voice Conversion and Text-to-Speech WebUI.GPT-SoVITS
ComfyUI_ParlerTTSParler-TTS is a lightweight text-to-speech (TTS) model that can generate high-quality, natural sounding speech in the style of a given speaker (gender, pitch, speaking style, etc).Parler-TTS
ComfyUI-StableAudioSamplerThe New Stable Diffusion Audio Sampler 1.0 In a ComfyUI Node. Make some beats!
ComfyUI-UVR5The comfyui custom node for UVR5 to separate vocals and background music.UVR5
ComfyUI-XTTSa custom comfyui node for coqui-ai/TTS's xtts module! support 17 languages voice cloning and tts.XTTS

^ Back to Contents ^

Music

ComfyUIDescriptionSourcePaper
ComfyUI-SunoAIComfyUI Node wrapper of SunoAI API.

^ Back to Contents ^

ComfyUI Workflow

ComfyUIDescriptionSourcePaper

^ Back to Contents ^

ai
comfyui
comfyui-nodes
comfyui-workflow
stable-diffusion

Contributors

Yuan-ManX

92 commits

Yuan-ManX/ComfyUI-Tools-Roadmap

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, Animation, Video, Audio, 3D Model, and more!🔥

44

92 commits

updated Sep 21, 2024

See the code

README

ComfyUI Tools Roadmap 🎮

ComfyUI

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, 3D Model, Animation, Video, Avatar, Audio, Music and more!🔥

Table of Contents

Project List

ComfyUI

ComfyUIDescriptionSourcePaper
ComflowyspaceComflowyspace is an open-source AI image and video generation tool committed to providing a better, interactive experience than the standard SDWebUI and ComfyUI.Comflowyspace
ComfyUIThe most powerful and modular stable diffusion GUI and backend.ComfyUI
ComfyUI BrowserAn image/video/workflow browser and manager for ComfyUI.ComfyUI Browser
Comfy.ICUComfyICU - Run ComfyUI workflows in the Cloud.Comfy.ICU
ComfyUI-Custom-ScriptsEnhancements & experiments for ComfyUI, mostly focusing on UI features.ComfyUI-Custom-Scripts
ComfyUI ManagerComfyUI-Manager is an extension designed to enhance the usability of ComfyUI.ComfyUI Manager
ComfyUI_TensorRTThis node enables the best performance on NVIDIA RTX™ Graphics Cards (GPUs) for Stable Diffusion by leveraging NVIDIA TensorRT.ComfyUI_TensorRT

^ Back to Contents ^

Image

ComfyUIDescriptionSourcePaper
ComfyUI-AnyTextAnyText: Multilingual Visual Text Generation And Editing.AnyTextarXiv
ComfyUI-AuraSRAuraSR: GAN-based Super-Resolution for real-world.AnyText
ComfyUI_CatVTONCatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models.CatVTONarXiv
comfyui_controlnet_auxComfyUI's ControlNet Auxiliary Preprocessors.
ComfyUI_ExtraModelsSupport for miscellaneous image models. Currently supports: DiT, PixArt, T5 and a few custom VAEs.Hunyuan-DiTarXiv
ComfyUI-Flowty-LDSRThis is a custom node that lets you take advantage of Latent Diffusion Super Resolution (LDSR) models inside ComfyUI.
ComfyUI-IC-LightComfyUI native implementation of IC-Light.IC-Light
ComfyUI-InstanceDiffusionInstance-level Control for Image Generation.InstanceDiffusionarXiv
ComfyUI InstantIDZero-shot Identity-Preserving Generation in Seconds.InstantIDarXiv
ComfyUI-IMAGDressingIMAGDressing👔: Interactive Modular Apparel Generation for Virtual Dressing.IMAGDressingarXiv
ComfyUI IPAdapter plusThe IPAdapter are very powerful models for image-to-image conditioning.IP-AdapterarXiv
ComfyUI-KolorsKolors: Effective Training of Diffusion Model for Photorealistic Text-to-Image Synthesis.Kolors
ComfyUI-layerdiffuseTransparent Image Layer Diffusion using Latent Transparency.LayerDiffuse
ComfyUI_MagicClothingMagic Clothing: Controllable Garment-Driven Image Synthesis.Magic ClothingarXiv
ComfyUI-MarigoldMarigold depth estimation in ComfyUI.MarigoldarXiv
ComfyUI-MimicBrushZero-shot Image Editing with Reference Imitation.MimicBrusharXiv
ComfyUI_omostOmost is a project to convert LLM's coding capability to image generation (or more accurately, image composing) capability.Omost
ComfyUI OOTDiffusionOutfitting Fusion based Latent Diffusion for Controllable Virtual Try-on.OOTDiffusionarXiv
ComfyUI PhotoMaker PlusCustomizing Realistic Human Photos via Stacked ID Embedding.PhotoMakerarXiv
comfyui-reactor-nodeFast and Simple Face Swap Extension Node for ComfyUI.
ComfyUI Segment AnythingBased on GroundingDino and SAM, use semantic strings to segment any element in an image.Segment Anything Model (SAM)arXiv
ComfyUI-Segment-Anything-2SAM 2: Segment Anything in Images and Videos.Segment Anything Model 2 (SAM 2)arXiv
ComfyUI StableZero123A Single Image to Consistent Multi-view Diffusion Base Model.Zero123++arXiv
ComfyUI_UltimateSDUpscaleComfyUI nodes for the Ultimate Stable Diffusion Upscale script by Coyote-A.Ultimate SD Upscale
DiffMorpher-ComfyUIDiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphing.DiffMorpherarXiv
PuLID ComfyUIPure and Lightning ID Customization via Contrastive Alignment.PuLIDarXiv

^ Back to Contents ^

Mesh

ComfyUIDescriptionSourcePaper
ComfyUI InstantMeshEfficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models.InstantMesharXiv

^ Back to Contents ^

Texture

ComfyUIDescriptionSourcePaper
Comfy TexturesUnreal Engine ⚔️ ComfyUI - Automatic texturing using generative diffusion models.

^ Back to Contents ^

3D Model

ComfyUIDescriptionSourcePaper
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!CharacterGenarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!CRMarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!Era3DarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!InstantMesharXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!Stable Fast 3DarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!Unique3DarXiv
ComfyUI-3D-PackMake 3D assets generation in ComfyUI good and convenient as it generates image/video!Zero123++arXiv
ComfyUI-Flowty-TripoSRTripoSR custom node for comfyui.TripoSRarXiv
ComfyUI-TripoThis extension integrates Tripo into ComfyUI, allowing users to generate 3D models from text prompts or images directly within the ComfyUI interface.TripoSRarXiv

^ Back to Contents ^

Animation

ComfyUIDescriptionSourcePaper
ComfyUI-ADMotionDirectorComfyUI nodes for training AnimateDiff motion loras.AnimateDiff MotionDirector
ComfyUI-AnimateAnyone-EvolvedAnimate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation.Animate AnyonearXiv
ComfyUI-AnimateDiff-EvolvedAnimate Your Personalized Text-to-Image Diffusion Models without Specific Tuning.AnimateDiffarXiv
ComfyUI-AnimateDiff-EvolvedAnimateDiff-Lightning is a lightning-fast text-to-video generation model.AnimateDiff-LightningarXiv
Comfyui-AnimateLCMAccelerating the Animation of Personalized Diffusion Models and Adapters with Decoupled Consistency Learning.AnimateLCMarXiv
ComfyUI-DynamiCrafterAnimating Open-domain Images with Video Diffusion Priors.DynamiCrafterarXiv
ComfyUI-MagicAnimateEasily use Magic Animate within ComfyUI!
ComfyUI-ToonCrafterGenerative Cartoon Interpolation.ToonCrafter

^ Back to Contents ^

Video

ComfyUIDescriptionSourcePaper
ComfyUI-DiffSynth-StudioDiffutoon: High-Resolution Editable Toon Shading via Diffusion Models.DiffutoonarXiv
ComfyUI-MagicAnimateMagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model.MagicAnimatearXiv
ComfyUI-MimicMotionMimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance.MimicMotionarXiv
ComfyUI-DragNUWADragNUWA enables users to manipulate backgrounds or objects within images directly, and the model seamlessly translates these actions into camera movements or object motions, generating the corresponding video.DragNUWA
ComfyUI-SVDExperimental use of stable-video-diffusion in ComfyUI.
ComfyUI-VideoHelperSuiteNodes related to video workflows.

^ Back to Contents ^

Avatar

ComfyUIDescriptionSourcePaper
avatar-graph-comfyuiA custom nodes module for creating real-time interactive avatars powered by blender bpy mesh api + Avatech Shape Flow runtime.
ComfyUI-AniPortraitAudio-Driven Synthesis of Photorealistic Portrait Animations.AniPortraitarXiv
ComfyUI_EchoMimicEchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning.EchoMimicarXiv
ComfyUI-HalloHallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation.HalloarXiv
ComfyUI-IP_LAPThe comfyui custom node of IP_LAP to make audio driven videos!IP_LAParXiv
ComfyUI-LivePortraitKJLivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control!LivePortraitarXiv
Comfyui-MusePoseMusePose: a Pose-Driven Image-to-Video Framework for Virtual Human Generation.MusePose
ComfyUI-MuseTalkReal-Time High Quality Lip Synchorization with Latent Space Inpainting!MuseTalk
ComfyUI-MuseVInfinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising!MuseV
ComfyUI-V-ExpressConditional Dropout for Progressive Training of Portrait Video Generation.V-ExpressarXiv
ComfyUI_wav2lipA custom node for ComfyUI that allows you to perform lip-syncing on videos using the Wav2Lip model. It takes an input video and an audio file and generates a lip-synced output video.Wav2LiparXiv

^ Back to Contents ^

Audio

ComfyUIDescriptionSourcePaper
ComfyUI-AudioSchedulerAudioScheduler project contains a collection of audio processing nodes.
ComfyUI-ChatTTSChatTTS is a generative speech model for daily dialogue.ChatTTS
ComfyUI-GPT_SoVITSA Powerful Few-shot Voice Conversion and Text-to-Speech WebUI.GPT-SoVITS
ComfyUI_ParlerTTSParler-TTS is a lightweight text-to-speech (TTS) model that can generate high-quality, natural sounding speech in the style of a given speaker (gender, pitch, speaking style, etc).Parler-TTS
ComfyUI-StableAudioSamplerThe New Stable Diffusion Audio Sampler 1.0 In a ComfyUI Node. Make some beats!
ComfyUI-UVR5The comfyui custom node for UVR5 to separate vocals and background music.UVR5
ComfyUI-XTTSa custom comfyui node for coqui-ai/TTS's xtts module! support 17 languages voice cloning and tts.XTTS

^ Back to Contents ^

Music

ComfyUIDescriptionSourcePaper
ComfyUI-SunoAIComfyUI Node wrapper of SunoAI API.

^ Back to Contents ^

ComfyUI Workflow

ComfyUIDescriptionSourcePaper

^ Back to Contents ^

ai
comfyui
comfyui-nodes
comfyui-workflow
stable-diffusion

Contributors

Yuan-ManX

92 commits