ComfyUI Txt2Video
Added 2023-11-25 12:40:03 +0000 UTCFrom the Img2Video of Stable Video Diffusion, with this ComfyUI Workflow you can create an image with the prompt, negative prompt and checkpoint(and vae) that you want and then a video will be created automatically with that image.
Required:
1- on Windows: 8+ GB VRAM NVIDIA gpu only
on Linux: 8+ GB VRAM NVIDIA gpu and AMD gpu
2- ComfyUI: https://github.com/comfyanonymous/ComfyUI
3- this worfklow: https://civitai.com/models/211703
4- in ComfyUI\models\checkpoints:
https://huggingface.co/stabilityai/stable-video-diffusion-img2vid/blob/main/svd.safetensors <- for 14 fps video
or
https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt/blob/main/svd_xt.safetensors <- for 25 fps video
5- a checkpoint in ComfyUI\models\checkpoints
6- a vae in ComfyUI\models\vae (optional)
7- ComfyUI Manager for the Missing Nodes: https://github.com/ltdrdata/ComfyUI-Manager
P.S.: The recommended resolution for SVD is 576x1024, but in the workflow I set a default value of 512x768 (with 40 steps, 20 steps is good enough). It's up to you to choose the resolution and steps that you want... but 512x768 with 40 steps is a good starting point for your attempts.
