Layer 03 · World Model & Cognition
The Robot Builds Internal Reality — And Understanding.
This is where raw perception becomes understanding. The robot builds an internal model of the world, reasons about it, and decides what matters.
Cognition takes structured perception and converts it into a belief about the world, predictions about how it will evolve, and a plan for what to do next.
Key idea
A world model is the robot's internal reality. Cognition is the ability to reason, plan, and understand within it.
The Cognition Workflow.
Perception in → context out
Perception
Build World Model
Store in Memory
Understand
Plan
Ground
Output Context
Inputs · Capabilities · Outputs.
The cognitive architectureInputs From Perception
Core Capabilities
Outputs To Action & Control
What This Layer Enables.
Downstream consequences— Capabilities Unlocked When Cognition Works
- Generalization to new environments
- Robustness to noise and occlusion
- Zero-shot and few-shot task transfer
- Better safety and interpretability
- Continuous improvement via learning
- Compositional skill composition
Key Trends.
Where cognition is movingNeural world models trained end-to-end with action heads.
3D foundation models replacing 2D-only backbones.
VLA models scaling to internet+robotic pretraining.
LLM reasoners with grounded verification loops.
Graph & symbolic AI hybridized with neural components.
Lifelong memory becoming an architectural primitive.
Embodied semantics fused into multimodal backbones.
Takeaway
World Model & Cognition turns perception into understanding.
Better understanding → better planning → better actions → better outcomes.