H 309 / 3212020s

Generative Image-to-Video

Generative image-to-video. Public product launch from 2023. Examples from 2024/2025 will follow.

Typeface · Audiowide

Stable Video Diffusion, 2023: official collage of images for the model announcement.
Temporal effect: still image or image sequence.
Stable Video Diffusion, 2023: official collage of images for the model announcement. Temporal effect: still image or image sequence.Stability AI. © Stability AI; public model announcementView source ↗

Prompt

Apply a Generative Image-to-Video look as a single cinematic frame suggesting emerging movement. Add slight directional blur to loose fabric, hair, foliage, or other movable details, with subtle depth separation and coherent lighting; avoid duplicated anatomy or invented camera angles. Keep the original subject and composition.

Identify

A still image begins to come to life spatially. The camera and figures move. Additional perspectives emerge.

Principle

A video model1 synthesizes a sequence of images from a source image2 and, if applicable, text instructions. Movement arises from learned relationships.

Example

Stable Video Diffusion: 2023. Runway Gen-3: 2024. Gen-4: 2025.

Try it out

Test a starting image with three motion commands. Check camera movement, object movement, and level of detail throughout the entire sequence.

Background

Major public product wave 2023–2025; ongoing development until 2026.

A trained video model generates a temporal image sequence from a starting image and, if necessary, text instructions. Movement, additional views, changes in lighting, and new details are estimated and synthesized by the model.

Image: Official demo/announcement image. The model completes temporal image sequences from a single input. The image shows several original demo motifs, not frames from a single sequence; a motion example can be found on the linked project page.

Distinction

Ken Burns pan or 2.5D parallax move existing image planes. Generative image-to-video can synthesize new views and image content. This is a family of techniques, not a single filter. Historical examples are presented without referring to them as the latest models available today.

Aftermath

A still image could become the starting scene of a fictional photograph. The creative brief increasingly shifted towards references, movement guidelines, and selection.

Further examples · 7 images

Interpolación Generativa Acotada
02 Interpolación Generativa AcotadaThis diagram illustrates the process of generative interpolation between a cross and a circle over one second. It demonstrates the fundamental concept of synthesizing intermediate frames to create fluid motion from static endpoints.Olivia Wall · CC BY-SA 4.0 · Wikimedia Commons
AI-generated video of a domestic dragon
03 AI-generated video of a domestic dragonThe animation shows a woman interacting with a dragon. It demonstrates the model's ability to maintain subject consistency while generating complex organic movement and camera panning from a high-detail initial frame.prompted by Lumi's AI Dreams · Public domain · Wikimedia Commons
AI scare ad Fidesz war
04 AI scare ad Fidesz warA low-resolution video still shows a girl looking out a window. It demonstrates the characteristic texture and slight spatial warping of early generative AI video models used in 2024 political advertising.Fidesz Budapest · Public domain · Wikimedia Commons
Coca-Cola AI ad - truck with misspelled logo
05 Coca-Cola AI ad - truck with misspelled logoThe image shows a truck with a garbled brand logo and flickering lights. This displays the common text-synthesis errors and temporal inconsistencies found in generative video outputs from late 2024.Silverside AI for The Coca-Cola Company AI technologies used in the ad campaign include: Leonardo, Luma, Runway, Kling, · Public domain · Wikimedia Commons
AI illustration: A split frame compares a static oil painting to a modernized, fluid versi
06 AI illustration: A split frame compares a static oil painting to a modernized, fluid versiA split frame compares a static oil painting to a modernized, fluid version of the same scene. This highlights the synthesis of new, dynamic pixels from a fixed source image.Illustration generated for the Atlas (AI)
AI illustration: A side-by-side comparison shows a static city scene gaining motion blur a
07 AI illustration: A side-by-side comparison shows a static city scene gaining motion blur aA side-by-side comparison shows a static city scene gaining motion blur and dynamic lighting. This illustrates how generative models synthesize movement and temporal changes from a single base frame.Illustration generated for the Atlas (AI)

Sources