The coolest Vid2Vid with RAVE and AnimateDiff version 3. New technique for AI videos with ComfyUI

Описание

RUN IT FOR FREE IN OPENART.AI:
http://tinyurl.com/42xctcdu

Total transformation of your videos with the new RAVE method combined with AnimateDiff. In this video, we explore the endless possibilities of RAVE (Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models). We combine it with AnimateDiff to edit and convert any video into an incredible animation.

Please, support this channel with a ko-fi!
https://ko-fi.com/koalanation

Tracklist:
00:00 Intro
00:16 RAVE and tutorial approach
01:04 Part 1 - Base workflow and installation of Custom Nodes
01:56 Part 1 - Models used in the workflow
03:02 Part 2 - RAVE workflow development and testing
05:14 Part 2 - Extending the workflow with AnimateDiff and ControlGIF
09:08 EXTRA - Second example: convert a car into a warship with LooseControl
11:06 Outro

Final workflow (in OpenArt): http://tinyurl.com/46w4achr
Base workflow (Github): http://tinyurl.com/hkfme93v

RAVE paper: https://rave-video.github.io/

Custom Nodes:
Can all be installed with ComfyUI Manager (http://tinyurl.com/ms3jkk4m)
ComfyUI-Rave
ComfyUI Noise
ComfyUI's ControlNet Auxiliary Preprocessors
ComfyUI-VideoHelper-Suite
Was Node Suite
ComfyUI-Advanced-ControlNet
AnimateDiff Evolved
rgthree's comfyUI nodes
ComfyUI Essentials
KJNodes for ComfyUI

Checkpoints (copy in models/checkpoints):
Can be downloaded from Civit.ai
Realistic Vision (can be downloaded from Civit.ai)
Juggernaut (can be downloaded from Civit.ai)

ControlNet (copy in models/controlnet folder)
Depth: can be downloaded from ComfyUI manager
ControlGIF (hugginface): http://tinyurl.com/28y9jkkr
LooseControl (civit.ai): http://tinyurl.com/2dpdnxce

AnimateDiff version 3 (http://tinyurl.com/y52cx825)
Adapter: http://tinyurl.com/3ctk78xa (copy in models/checkpoint)
Motion module: http://tinyurl.com/bdfdj8xv (copy in custom-nodes/ComfyUI-AnimateDiff-Evolved/models)


Videos
Pexels: http://tinyurl.com/46m8zxpk
Pixabay: http://tinyurl.com/yc46w8fh

Music
Song: It's Our Time
Music by: CreatorMix.com

Edited with Canva, and ClipChamp. I record the stuff in powerpoint.

© 2024 Koala Nation
#comfyui #animatediff #stablediffusion