
WorldOracle launches real-execution benchmark for action-driven world models
WorldOracle, which its developers describe as the first benchmark for action-driven world models that uses real-world execution as the yardstick, launched on Oct. 16 and opened evaluation submissions to developers. The project was jointly completed by researchers from AGIBOT, NVIDIA, Princeton University, the University of Texas at Austin and the University of Toronto, combining world-model developers with benchmark researchers. The platform addresses a question the industry has lacked a benchmark to answer directly: given a set of actions, how far is a model’s predicted future from what actually happens? WorldOracle defines this as “Execution Coherence.” The researchers said a reliable world model must withstand three stress tests: causal obedience, meaning it must follow the given action sequence, including wrong or...
AGIBOT
Figure AI
UBTECH