git404hub

what is dream.exe fr?

showlab/dream.exe — explained in plain English

Analysis updated 2026-05-18

21Audience · researcherComplexity · 4/5Setup · hard

tl;dr

A research benchmark that tests whether AI-generated robot videos depict physically valid actions by converting them into robot movement plans and running them in a physics simulator.

vibe map

mindmap
  root((dream.exe))
    What it does
      Converts video to robot plan
      Runs plan in simulator
      Checks task completion
    Benchmark
      101 tasks from RoboCasa
      Three difficulty levels
      Eight models tested
    Findings
      Visual quality is poor predictor
      General video models show physics understanding
    Status
      Code coming soon
      Research paper available

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Evaluate whether a video generation model produces physically plausible robot motions for a given manipulation task.

VIBE 2

Benchmark multiple video generation models on a standardized set of 101 robot tasks across three difficulty levels.

how it stacks up fr

showlab/dream.exe0whitedev/detranspiler0xluk3/zk-resources
Stars212121
LanguagePython
Setup difficultyhardhardeasy
Complexity4/54/51/5
Audienceresearcherdeveloperresearcher

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1day+

Repository is currently a placeholder, code, benchmark data, and evaluation tools are listed as coming soon.

in plain english

This is a research project from the Show Lab at the National University of Singapore, in collaboration with Oxford and Tencent. The central question it investigates is whether AI models that generate videos can produce videos of robots doing tasks that would actually work if a real robot tried to follow them. The typical way to judge a video generation model is by asking whether the video looks realistic. Dream.exe takes a different approach: it converts the motion shown in a generated video into an actual robot movement plan, runs that plan in a physics simulator, and checks whether the task gets completed. A video can look convincing but still fail this test if the robot movement it depicts is physically impossible or poorly timed. The project includes a benchmark of 101 tasks drawn from a robotics dataset called RoboCasa. The tasks are organized into three difficulty levels: simple single-object manipulation (pick something up, put it down), multi-object interactions where the robot needs to reason about how objects relate to each other, and multi-stage tasks that require the robot to complete several steps in the right order. Eight different video generation models were tested under this benchmark, including both open-source and closed-source systems. The findings from the paper suggest that AI models trained on general internet video already carry some understanding of physical cause and effect, since several models achieved measurable success at completing tasks despite no robot-specific training. The research also found that how visually polished a video looks is a poor indicator of whether the robot actions it depicts would actually work. At the time of this writing, the repository is a placeholder. The code, benchmark data, and evaluation tools are listed as coming soon. Only the research overview and citation information are currently present.

prompts (copy fr)

prompt 1
Once dream.exe code is released, how would I run one of the 101 RoboCasa tasks to check whether a generated video leads to task success in the physics simulator?
prompt 2
The dream.exe paper found that visual quality is a poor predictor of robot task success. What metrics does it use instead to evaluate whether a generated video is physically valid?
prompt 3
I want to cite the dream.exe research in my robotics paper. What is the correct citation based on the repository information?

Frequently asked questions

what is dream.exe fr?

A research benchmark that tests whether AI-generated robot videos depict physically valid actions by converting them into robot movement plans and running them in a physics simulator.

How hard is dream.exe to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is dream.exe for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.