How Many Exposures Does a World Model Need? Learning Unseen Game Mechanics at Test Time
Abstract
World models enable agents to plan and learn from imagined experience, but in an unfamiliar environment they must learn its mechanics from limited interaction. A mechanic is a rule for how an action or an interaction changes part of the environment. Each occurrence of a mechanic that the model observes is one exposure. We ask how many exposures a world model needs to predict the effects of a new environment's mechanics. We address this question on ARC-AGI-3, a benchmark of interactive games defined by their programs. We introduce MechEval, which labels 69 recurring mechanics across 20 games from these programs. It scores each prediction on the cells the mechanic changes at each exposure. As a test bed, we build WARC (World model for ARC-AGI-3), a 35M-parameter vision transformer that is pretrained on other games and updates all of its parameters after each transition. On held-out games, WARC learns to predict four in five mechanics with at least 80% accuracy on the cells they change and keeps that accuracy to the end of the recordings. Half of them reach that accuracy within about 80 exposures, in a single play of the game, and without updates only one in seven does at all. In closed-loop play on the public games, WARC-Agent, which pairs WARC with a fixed graph explorer, triples the explorer's official efficiency score from 0.15 to 0.46, mostly through test-time training. On the hidden games of the Kaggle leaderboard, our entry scores 0.20.
Community
MechEval measures how fast a world model learns the mechanics of an unseen game, and WARC is a world model that learns them at test time.
Measuring how fast a world model learns an unseen game, not just how well, is a fresh way to look at it. Learning mechanics at test time sounds close to how people pick up a new game. What was the hardest kind of mechanic for WARC to pick up?
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- When Generative Models Act as Simulators (2026)
- Witness: Discovery, Deciphering, and Epiphany in Interactive Puzzle Environments (2026)
- Keeping JEPA World Models Plannable When Little of the Frame Moves (2026)
- The Planning Limits of Latent World Models (2026)
- Relational Learning as World Modeling (2026)
- Knowledge transfer between simple discrete worlds (2026)
- Memento 3: Model-Based Recursive Self-Improvement through Reflective Rulebooks (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2611.12324 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper