🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

Data

https://github.com/microsoft/XPretrain/tree/main/hd-vila-100m (HD-VILA-100M Dataset)
http://toflow.csail.mit.edu/ (Vimeo-90k Dataset)
https://github.com/m-bain/webvid
Movie Trailers

Tag

https://github.com/Breakthrough/PySceneDetect
https://github.com/ExponentialML/Video-BLIP2-Preprocessor

Main Repo

https://github.com/ExponentialML/Text-To-Video-Finetuning

🚦 Prototype 🚦

Potat 1️⃣

Model: https://huggingface.co/camenduru/potat1
Dataset: https://huggingface.co/camenduru/potat1_dataset/tree/main

Potat 1️⃣ Output

https://github.com/camenduru/Text-To-Video-Finetuning-colab/assets/54370274/97282de4-e1df-49a0-851e-cb8b4b040441

Please try it 🐣

https://github.com/camenduru/text-to-video-synthesis-colab