WAM-like training, VLA-like inference. DreamFree uses a video model’s predictive features to predict actions without generating future videos.
A 14B video backbone running at 11 Hz.
DreamFree achieves 11 Hz on a single H200 and a 17.8× inference speedup over DreamZero, while improving real-world success.
Lower memory use at inference.
Without future-video generation or classifier-free guidance (CFG) at inference, DreamFree can fit on a single A6000 with 48 GB of memory.
Improves with larger backbones and video-only data.
Scaling the video backbone from 5B to 14B improves RoboCasa success from 58.5% to 71.7%. Extra videos raise it to 74.4% without additional action labels.
Figure 1 · Real-world DROID evaluation on H200 GPUs. Latency is measured per action chunk.
DROID (Franka Panda)
01
Precise object manipulation.
Stand a bottle upright, pour into a pan, pick up bolts, and place a ring around a pole.
Generate future videos to guide actions. Iterative denoising is slow, and video prediction errors can affect actions.
Fast-WAM
Trains video denoising and action prediction together, but skips video generation at inference. Denoising alone does not ensure the shared features capture future information.
DreamFree
Distills a frozen video diffusion model’s predictive knowledge into a visual encoder. Predicts actions from the current observation without generating future videos.
DreamFree adds future representation distillation to video generative training, making the video model’s predictive knowledge available in the features used for action prediction. This helps translate larger video backbones into better control; generative training alone shows little benefit from scaling.
Make video priors useful without imagining videos.
An explicit alignment loss makes current-frame features predictive of the future.
At training
Figure 2 · Future frames supervise predictive representation learning during training. At deployment, the encoder needs only the current observation and instruction.
STAGE 1
Distill predictive representations
A frozen video diffusion teacher observes current and future frames. An alignment loss trains the current-frame features to predict the teacher’s future-aware representations, alongside the original video generative objective. This directly supervises the features used for control and needs no action labels.
STAGE 2
Learn to read out actions
Using action-labeled robot demonstrations, a readout module extracts action-relevant features from the visual encoder. An action decoder maps these features to executable action chunks.
At inferenceFigure 3 · The Visual Encoder processes the current frame f0 and instruction ℓ in one forward pass. Readout extracts action-relevant features, and the 1B Action DiT denoises the action chunk a1, …, ah. No future-video generation is needed.
Evaluation results
RoboCasa-Kitchen simulation
Across 24 kitchen tasks, DreamFree reaches 71.7% success, rising to 74.4% with extra video data. Scaling the backbone from 5B to 14B adds 13.2 percentage points, compared with 0.3 for Fast-WAM.
Comparison with VLA and WAM baselines
Method
Family
Success (%)
π₀
VLA
62.5
GR00T-N1.5
VLA
64.1
FLARE
VLA
66.4
Cosmos Policy
WAM
67.1
DreamFree (14B)
WAM
71.7
+ extra video
WAM
74.4
The base model uses 50 demonstrations per task, as in Cosmos Policy. “+ extra video” adds videos without extra action labels.
Scaling imagination-free WAMs · Success (%)
Method
5B
14B
Gain
Fast-WAM
44.4
44.7
+0.3 pp
DreamFree
58.5
71.7
+13.2 pp
+ extra video
68.8
74.4
+5.6 pp
Gain: 5B → 14B within each row.
DreamFree effectively leverages video priors without imagination and benefits from additional video-only data.
DROID real-world evaluation
We evaluate 10 tasks × 5 trials per policy, using new objects or scene arrangements within familiar task types. All policies run out of the box, without task-specific fine-tuning.
Success measures completed tasks. Task progress gives partial credit using each task’s scoring rubric.
50 real-world trials per policy
Method
Success (%)
Progress (%)
Latency (ms/chunk)
π₀.₅
16.0
33.5
81
DreamZero
56.0
71.8
1,632
DreamFree
64.0
83.0
91
Average time to predict an action chunk on H200 GPUs, using each policy’s own settings.
Figure 4 · Per-task results include deformable objects, object rearrangement, and sequential manipulation.
Real-time control at 11 Hz
With its 14B video backbone, DreamFree averages 91 ms per action chunk on a single H200. Inference is 17.8× faster than DreamZero, without video step distillation or asynchronous execution.
Figure 5 · Inference latency on NVIDIA H200 GPUs and task completion time.
REAL-WORLD GALLERY
DROID and YAM rollouts
Full DROID evaluations and a small-data pilot on YAM.
DreamFree learns from video-only demonstrations through its predictive encoder.
Atomic tasks use one skill; composite tasks combine several skills in sequence.
Composite videos in pre-training video-only fine-tuning
We add composite-task demonstrations to visual encoder pre-training, alongside atomic-task videos. Both models use the same atomic-task action labels to train the action module; no composite-task action labels are used.
2× playback
Open the microwave → put food inside → close the door → turn it on.
01 · Added data
Composite-task videos
For encoder pre-training
No action labels
Composite-task demonstration video
02 · Before
Trained on atomic data
Atomic videos + action labels only
Success: 0%Progress: 8.8%
Selected failure example
Inference instructionPick the cheese from the counter and place it in the microwave. Then turn on the microwave.
03 · After
With composite videos
Added during pre-training
Success: 5%Progress: 26.3%
Selected success example
Inference instructionPick the cheese from the counter and place it in the microwave. Then turn on the microwave.
Note: The atomic training data typically includes the individual skills used in composite tasks, e.g., “Open the microwave” and “Close the door.”
Our results suggest that these demonstrations help it combine familiar skills into new task sequences, without additional action labels.
Failure Cases
DROID (Franka Panda)
“put the orange block in the bowl”
The robot picks the red block instead of the requested orange one. Similar colors can still be confused.
The policy completes some tasks with limited training data, but folding clothes and erasing the whiteboard are still unreliable. The t-shirt folding failure may reflect difficulty understanding the cloth’s state.
We have not yet investigated whether longer training would resolve these limitations.
Citation
@misc{jo2026dreamfree,
title = {Future Representation Distillation for Imagination-free World Action Models},
author = {Jaehyeong Jo and Sangwon Jang and Sihyun Yu and
Seonghyeon Ye and Yekyung Nah and Hojung Jung and
Kimin Lee and Sung Ju Hwang},
year = {2026},
note = {Manuscript}
}