DreamFree: Future Representation Distillation
for Imagination-free World Action Models

Imagination-free WAMs, scaled to 14B and DROID-scale data.

* Equal contribution · † Equal advising

WAM-like training, VLA-like inference.
DreamFree uses a video model’s predictive features to predict actions without generating future videos.

A 14B video backbone running at 11 Hz.

DreamFree achieves 11 Hz on a single H200 and a 17.8× inference speedup over DreamZero, while improving real-world success.

Lower memory use at inference.

Without future-video generation or classifier-free guidance (CFG) at inference, DreamFree can fit on a single A6000 with 48 GB of memory.

Improves with larger backbones and video-only data.

Scaling the video backbone from 5B to 14B improves RoboCasa success from 58.5% to 71.7%. Extra videos raise it to 74.4% without additional action labels.

Figure 1 · Real-world DROID evaluation on H200 GPUs. Latency is measured per action chunk.

DROID (Franka Panda)

Precise object
manipulation.

Stand a bottle upright, pour into a pan, pick up bolts, and place a ring around a pole.

Explore the DROID evaluation
1×
Stand the bottle upright
1×
Pour the contents of the cup into the pan.

Trained on DROID only · No task-specific adaptation.

ABC-130k (YAM)

Trained on a filtered 100-hour subset of ABC-130k (≈1/35 of its total duration)

1.5×
Load plates into tabletop dish rack
1×
Put the plastic bottles in the bin
1×
Open the pen cap
1×
Put the screwdriver in the bin
1×
Fold and stack the t-shirtsPartially completed

Trained on ABC-130k only · No task-specific adaptation.

Explore the YAM rollouts

What makes imagination-free WAMs scale?

Joint WAMs (e.g., DreamZero)

Generate future videos to guide actions. Iterative denoising is slow, and video prediction errors can affect actions.

Fast-WAM

Trains video denoising and action prediction together, but skips video generation at inference. Denoising alone does not ensure the shared features capture future information.

DreamFree

Distills a frozen video diffusion model’s predictive knowledge into a visual encoder. Predicts actions from the current observation without generating future videos.

DreamFree adds future representation distillation to video generative training, making the video model’s predictive knowledge available in the features used for action prediction. This helps translate larger video backbones into better control; generative training alone shows little benefit from scaling.

Make video priors useful without imagining videos.

An explicit alignment loss makes current-frame features predictive of the future.

At training

Figure 2 · Future frames supervise predictive representation learning during training. At deployment, the encoder needs only the current observation and instruction.
STAGE 1

Distill predictive representations

A frozen video diffusion teacher observes current and future frames. An alignment loss trains the current-frame features to predict the teacher’s future-aware representations, alongside the original video generative objective. This directly supervises the features used for control and needs no action labels.

STAGE 2

Learn to read out actions

Using action-labeled robot demonstrations, a readout module extracts action-relevant features from the visual encoder. An action decoder maps these features to executable action chunks.

At inference
Figure 3 · The Visual Encoder processes the current frame f0 and instruction ℓ in one forward pass. Readout extracts action-relevant features, and the 1B Action DiT denoises the action chunk a1, …, ah. No future-video generation is needed.

Evaluation results

RoboCasa-Kitchen simulation

Across 24 kitchen tasks, DreamFree reaches 71.7% success, rising to 74.4% with extra video data. Scaling the backbone from 5B to 14B adds 13.2 percentage points, compared with 0.3 for Fast-WAM.

Comparison with VLA and WAM baselines
MethodFamilySuccess (%)
π₀VLA62.5
GR00T-N1.5VLA64.1
FLAREVLA66.4
Cosmos PolicyWAM67.1
DreamFree (14B)WAM71.7
+ extra videoWAM74.4

The base model uses 50 demonstrations per task, as in Cosmos Policy. “+ extra video” adds videos without extra action labels.

Scaling imagination-free WAMs · Success (%)
Method5B14BGain
Fast-WAM44.444.7+0.3 pp
DreamFree58.571.7+13.2 pp
+ extra video68.874.4+5.6 pp

Gain: 5B → 14B within each row.

DreamFree effectively leverages video priors without imagination and benefits from additional video-only data.

DROID real-world evaluation

We evaluate 10 tasks × 5 trials per policy, using new objects or scene arrangements within familiar task types. All policies run out of the box, without task-specific fine-tuning.

Success measures completed tasks. Task progress gives partial credit using each task’s scoring rubric.

50 real-world trials per policy
MethodSuccess (%)Progress (%)Latency
(ms/chunk)
π₀.₅16.033.581
DreamZero56.071.81,632
DreamFree64.083.091

Average time to predict an action chunk on H200 GPUs, using each policy’s own settings.

Figure 4 · Per-task results include deformable objects, object rearrangement, and sequential manipulation.

Real-time control at 11 Hz

With its 14B video backbone, DreamFree averages 91 ms per action chunk on a single H200. Inference is 17.8× faster than DreamZero, without video step distillation or asynchronous execution.

Figure 5 · Inference latency on NVIDIA H200 GPUs and task completion time.
REAL-WORLD GALLERY

DROID and YAM rollouts

Full DROID evaluations and a small-data pilot on YAM.

Open Gallery

Task transfer from video demonstrations

DreamFree learns from video-only demonstrations through its predictive encoder.

Atomic tasks use one skill; composite tasks combine several skills in sequence.

Composite videos in pre-training

We add composite-task demonstrations to visual encoder pre-training, alongside atomic-task videos. Both models use the same atomic-task action labels to train the action module; no composite-task action labels are used.

Open the microwave → put food inside → close the door → turn it on.

01 · Added data

Composite-task videos

For encoder pre-training

No action labels

Composite-task demonstration video

02 · Before

Trained on atomic data

Atomic videos + action labels only

Success: 0%Progress: 8.8%

Selected failure example

Inference instructionPick the cheese from the counter and place it in the microwave. Then turn on the microwave.

03 · After

With composite videos

Added during pre-training

Success: 5%Progress: 26.3%

Selected success example

Inference instructionPick the cheese from the counter and place it in the microwave. Then turn on the microwave.

Note: The atomic training data typically includes the individual skills used in composite tasks, e.g., “Open the microwave” and “Close the door.”

Our results suggest that these demonstrations help it combine familiar skills into new task sequences, without additional action labels.


Failure Cases

DROID (Franka Panda)

“put the orange block in the bowl”

The robot picks the red block instead of the requested orange one. Similar colors can still be confused.

ABC-130k (YAM)

Fold and stack the t-shirts

Rollout 11

Erase the whiteboard

Rollout 01

The policy completes some tasks with limited training data, but folding clothes and erasing the whiteboard are still unreliable. The t-shirt folding failure may reflect difficulty understanding the cloth’s state.

We have not yet investigated whether longer training would resolve these limitations.

Citation

@misc{jo2026dreamfree,
  title  = {Future Representation Distillation for Imagination-free World Action Models},
  author = {Jaehyeong Jo and Sangwon Jang and Sihyun Yu and
            Seonghyeon Ye and Yekyung Nah and Hojung Jung and
            Kimin Lee and Sung Ju Hwang},
  year   = {2026},
  note   = {Manuscript}
}

Press Esc or click outside the figure to close.