korrents

korrents · piece

Diffusion Models for Video Generation

Lilian Weng · 12 Apr 2024

Read the piece on lilianweng.github.io ↗

2 korrents from this piece ↓

Lilian Weng did not write this page.

Every claim below was made in this piece, quoted word for word and numbered in the order the piece makes them, so you can read it there rather than take our word for it. The sentence above each quote is our reading of the claim, not their wording. Each quote was checked against a stored copy of the page at build time; where the two differ, the quote is the fact.

  1. Our reading

    Video generation requires more world knowledge than image generation because of the need for temporal consistency across frames.

    Their wordsIt has extra requirements on temporal consistency across frames in time, which naturally demands more world knowledge to be encoded into the model.

  2. Our reading

    High-quality video data, especially paired with text, is harder to collect at scale than image or text data.

    Their wordsIn comparison to text or images, it is more difficult to collect large amounts of high-quality, high-dimensional video data, let along text-video pairs.

Keep reading

The other pieces are the ones whose claims are worded most like this one's. That measures language, not agreement: they may argue the opposite.