Stable Diffusion Deforum + Hybrid_video + instruct_pix2pix

Описание

Having fun with #deforum #stablediffusion and Hybrid Video by @reallybigname with intruct_pix2pix model.

Video source : https://www.youtube.com/watch?v=pYGm2yM1jKI

2d settings
strenght schedule : 0:((-0.33 * cos((115 / 240 * 3.141 * (t + 0) / 15))**10 + 0.33))
noise_schedule : 0:((0.06 * cos((115 / 480 * 3.141 * (t + 0) / 15))**30 + 0.01))
seed : iter
Hybrid_composite : On
Optical Flow : On
DIS Medium : On
comp_alpha_schedule : 0.5

Prompt:
{
"0": " what it would look like if everything looked like a 80's zoo footage movie by national board of canada film",
"63":" make it look like a simpson movie ",
"126":" what it would look like if everything looked like a Jurassic Park ",
"189": "make it look like an Alien movie by ridley scott",
"252": " what it would look like if everything looked like a western movie",
"315": "make it look like a steam punk movie like arcane",
"378":" what it would look like if everything looked like a cyberpunk movie",
"441":" what it would look like if everything looked like a second world war movie",
"504":" what it would look like if everything looked like a Martin Scorcese movie with robert de niro",
"567":"make it look like a old school Bollywood movie "
}

Hybrid Video Settings
"hybrid_generate_inputframes": false,
"hybrid_generate_human_masks": "None",
"hybrid_use_first_frame_as_init_image": false,
"hybrid_motion": "Optical Flow",
"hybrid_motion_use_prev_img": false,
"hybrid_flow_method": "DIS Medium",
"hybrid_composite": true,
"hybrid_comp_mask_type": "None",
"hybrid_comp_mask_inverse": false,
"hybrid_comp_mask_equalize": "None",
"hybrid_comp_mask_auto_contrast": false,
"hybrid_comp_save_extra_frames": false,
"hybrid_comp_alpha_schedule": "0:(0.5)",
"hybrid_comp_mask_blend_alpha_schedule": "0:(0.5)",
"hybrid_comp_mask_contrast_schedule": "0:(1)",
"hybrid_comp_mask_auto_contrast_cutoff_high_schedule": "0:(100)",
"hybrid_comp_mask_auto_contrast_cutoff_low_schedule": "0:(0)",