camenduru/text-to-video-synthesis-colab

Text To Video Synthesis Colab

1,513

stars

173

commits

Jupyter Notebook

primary language

Mar 28, 2024

updated

colab
colab-notebook
colaboratory
t2v
text-to-video

README

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

ColabType
Open In Colablongscope_text_to_video_colab polyware-ai/longscope
(Thanks to @polyware_ai ❤ for the model)
Open In Colabzeroscope_v2_xl_text_to_video_colab cerspense/zeroscope_v2_XL
(Thanks to @cerspense ❤ for the model)
Open In Colabzeroscope_v2_576w_text_to_video_colab cerspense/zeroscope_v2_576w
(Thanks to @cerspense ❤ for the model)
Open In Colabpotat1_exp1_text_to_video_colab (Thanks to lambda labs ❤ for the gpu)
Open In Colabzeroscope_v2_dark_text_to_video_colab cerspense/zeroscope_v2_dark_30x448x256
(Thanks to @cerspense ❤ for the model)
Open In Colabzeroscope_v2_30x448x256_text_to_video_colab cerspense/zeroscope_v2_30x448x256
(Thanks to @cerspense ❤ for the model)
Open In Colabzeroscope_v1_1_320s_text_to_video_colab cerspense/zeroscope_v1-1_320s
(Thanks to @cerspense ❤ for the model)
Open In Colabpotat1_text_to_video_colab camenduru/potat1 (Thanks to lambda labs ❤ for the gpu)
Open In Colabzeroscope_v1_320s_text_to_video_colab cerspense/zeroscope_v1_320s
(Thanks to @cerspense ❤ for the model)
Open In Colabms_1_7b_text_to_video_colab damo-vilab/text-to-video-ms-1.7b
(Thanks to damodamo-vilab ❤ for the model)
Open In Colabanimov_512x_text_to_video_colab strangeman3107/animov-512x
(Thanks to @bRuefiRe ❤ for the model)
Open In Colabanimov_0_1_1_text_to_video_colab strangeman3107/animov-0.1.1
(Thanks to @bRuefiRe ❤ for the model)
Open In Colabanimov_0_1_text_to_video_colab strangeman3107/animov-0.1.1
(Thanks to @bRuefiRe ❤ for the model)
Open In ColabWatermark Remover
Open In Colabtext_to_video_synthesis
(Thanks to damodamo-vilab ❤ for the model)
Open In Colabtext_to_video_synthesis_diffusers
(Thanks to damodamo-vilab ❤ for the model)

🦒 Community Colab

ColabFunctionAuthorReadme
Open In Colabpotat1_text_to_video_colab_ALM (Thanks to snydjos ❤)snydjos AILostMediaReadme

Tutorials

https://www.youtube.com/watch?v=WHcjD-uraUs (for zeroscope_video_webui_colab and zeroscope_upscale_video_webui_colab)
https://www.youtube.com/watch?v=E45AO1w9gRU (for Potat 1️⃣ and Zeroscope)
https://www.youtube.com/watch?v=b8D4am73e6I

Main Repo

https://www.modelscope.cn/models/damo/text-to-video-synthesis/summary
https://github.com/modelscope/modelscope
https://github.com/huggingface/diffusers

Paper

https://arxiv.org/abs/2308.06571

Models License

Apache License 2.0

Examples

Potat 1️⃣

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/604a8817-5ad3-421a-9240-e5d3b195074d

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/842da028-df43-4dba-bb14-a41d66edeb4e

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/c5201c8a-2815-4533-9474-1e312c564f4e

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/281d1a9e-b930-4e8a-9554-5203e15b4425

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/0bb74810-13bf-4e20-950f-b569a60ea5c8

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/1025f302-9fa1-4bd3-8996-1da94697151e

Base Model

A giraffe underneath a microwave.
A giraffe underneath a microwave.
A goldendoodle playing in a park by a lake.
A goldendoodle playing in a park by a lake.
A panda bear driving a car.
A panda bear driving a car.
A teddy bear running in New York City.
A teddy bear running in New York City.
Drone flythrough of a fast food restaurant
on a dystopian alien planet.
Drone flythrough of a fast food restaurant on a dystopian alien planet.
A dog wearing a Superhero outfit with red cape
flying through the sky.
A dog wearing a Superhero outfit with red cape flying through the sky.
Monkey learning to play the piano.
Monkey learning to play the piano.
A litter of puppies running through the yard.
A litter of puppies running through the yard.
Robot dancing in times square.
Robot dancing in times square.

https://github.com/camenduru/text2video-zero-colab

Contributors

camenduru

173 commits

camenduru/text-to-video-synthesis-colab

Text To Video Synthesis Colab

1,513

stars

173

commits

Jupyter Notebook

primary language

Mar 28, 2024

updated

colab
colab-notebook
colaboratory
t2v
text-to-video

README

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

ColabType
Open In Colablongscope_text_to_video_colab polyware-ai/longscope
(Thanks to @polyware_ai ❤ for the model)
Open In Colabzeroscope_v2_xl_text_to_video_colab cerspense/zeroscope_v2_XL
(Thanks to @cerspense ❤ for the model)
Open In Colabzeroscope_v2_576w_text_to_video_colab cerspense/zeroscope_v2_576w
(Thanks to @cerspense ❤ for the model)
Open In Colabpotat1_exp1_text_to_video_colab (Thanks to lambda labs ❤ for the gpu)
Open In Colabzeroscope_v2_dark_text_to_video_colab cerspense/zeroscope_v2_dark_30x448x256
(Thanks to @cerspense ❤ for the model)
Open In Colabzeroscope_v2_30x448x256_text_to_video_colab cerspense/zeroscope_v2_30x448x256
(Thanks to @cerspense ❤ for the model)
Open In Colabzeroscope_v1_1_320s_text_to_video_colab cerspense/zeroscope_v1-1_320s
(Thanks to @cerspense ❤ for the model)
Open In Colabpotat1_text_to_video_colab camenduru/potat1 (Thanks to lambda labs ❤ for the gpu)
Open In Colabzeroscope_v1_320s_text_to_video_colab cerspense/zeroscope_v1_320s
(Thanks to @cerspense ❤ for the model)
Open In Colabms_1_7b_text_to_video_colab damo-vilab/text-to-video-ms-1.7b
(Thanks to damodamo-vilab ❤ for the model)
Open In Colabanimov_512x_text_to_video_colab strangeman3107/animov-512x
(Thanks to @bRuefiRe ❤ for the model)
Open In Colabanimov_0_1_1_text_to_video_colab strangeman3107/animov-0.1.1
(Thanks to @bRuefiRe ❤ for the model)
Open In Colabanimov_0_1_text_to_video_colab strangeman3107/animov-0.1.1
(Thanks to @bRuefiRe ❤ for the model)
Open In ColabWatermark Remover
Open In Colabtext_to_video_synthesis
(Thanks to damodamo-vilab ❤ for the model)
Open In Colabtext_to_video_synthesis_diffusers
(Thanks to damodamo-vilab ❤ for the model)

🦒 Community Colab

ColabFunctionAuthorReadme
Open In Colabpotat1_text_to_video_colab_ALM (Thanks to snydjos ❤)snydjos AILostMediaReadme

Tutorials

https://www.youtube.com/watch?v=WHcjD-uraUs (for zeroscope_video_webui_colab and zeroscope_upscale_video_webui_colab)
https://www.youtube.com/watch?v=E45AO1w9gRU (for Potat 1️⃣ and Zeroscope)
https://www.youtube.com/watch?v=b8D4am73e6I

Main Repo

https://www.modelscope.cn/models/damo/text-to-video-synthesis/summary
https://github.com/modelscope/modelscope
https://github.com/huggingface/diffusers

Paper

https://arxiv.org/abs/2308.06571

Models License

Apache License 2.0

Examples

Potat 1️⃣

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/604a8817-5ad3-421a-9240-e5d3b195074d

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/842da028-df43-4dba-bb14-a41d66edeb4e

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/c5201c8a-2815-4533-9474-1e312c564f4e

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/281d1a9e-b930-4e8a-9554-5203e15b4425

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/0bb74810-13bf-4e20-950f-b569a60ea5c8

https://github.com/camenduru/text-to-video-synthesis-colab/assets/54370274/1025f302-9fa1-4bd3-8996-1da94697151e

Base Model

A giraffe underneath a microwave.
A giraffe underneath a microwave.
A goldendoodle playing in a park by a lake.
A goldendoodle playing in a park by a lake.
A panda bear driving a car.
A panda bear driving a car.
A teddy bear running in New York City.
A teddy bear running in New York City.
Drone flythrough of a fast food restaurant
on a dystopian alien planet.
Drone flythrough of a fast food restaurant on a dystopian alien planet.
A dog wearing a Superhero outfit with red cape
flying through the sky.
A dog wearing a Superhero outfit with red cape flying through the sky.
Monkey learning to play the piano.
Monkey learning to play the piano.
A litter of puppies running through the yard.
A litter of puppies running through the yard.
Robot dancing in times square.
Robot dancing in times square.

https://github.com/camenduru/text2video-zero-colab

Contributors

camenduru

173 commits

Languages

Jupyter Notebook

100.0%