Text to video vs image to video: which should you use?

Both modes end with a video. The difference is who decides what it looks like: with text, the model does, and with an image, you do.

Side by side

When to use text

Use it when you do not yet know what you want. It is the cheapest way to try out ideas, and each run may surprise you.

When to use an image

Use it when appearance matters. Your real product, a specific character or a composition you have already approved should all start from a picture.

Use them together

1. Explore with text at low resolution.
2. When you like a result, save a good frame.
3. Use that frame as your starting image, and refine the action.
4. For several scenes with the same subject, use reference images.

Read more on text to video and image to video.