🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

Colab	Info
	dataset
	train
	train single video
	inference

Data

https://github.com/microsoft/XPretrain/tree/main/hd-vila-100m (HD-VILA-100M Dataset)
http://toflow.csail.mit.edu/ (Vimeo-90k Dataset)
https://github.com/m-bain/webvid
Movie Trailers

Tag

https://github.com/Breakthrough/PySceneDetect
https://github.com/ExponentialML/Video-BLIP2-Preprocessor

Main Repo

https://github.com/ExponentialML/Text-To-Video-Finetuning

🚦 Prototype 🚦

Potat 1️⃣

Model: https://huggingface.co/camenduru/potat1
Dataset: https://huggingface.co/camenduru/potat1_dataset/tree/main

Potat 1️⃣ Output

Fruits.Strawberries.Flying.Falling.In.Air.Tabletop.Shot.High.Speed.Slow.Motion.5cf78a08.mp4

Please try it 🐣

https://github.com/camenduru/text-to-video-synthesis-colab