Skip to yearly menu bar Skip to main content


Poster

Do LLMs Build World Representations? Probing Through the Lens of State Abstraction

Zichao Li · Yanshuai Cao · Jackie CK Cheung

East Exhibit Hall A-C #3307
[ ]
Fri 13 Dec 11 a.m. PST — 2 p.m. PST

Abstract:

How do large language models (LLMs) encode the state of the world, including the status of entities and their relations, as described by a text? While existing work directly probes for a complete state of the world, our research explores whether and how LLMs abstract this world state in their internal representations. We propose a new framework for probing for world representations through the lens of state abstraction theory from reinforcement learning, which emphasizes different levels of abstraction, distinguishing between general abstractions that facilitate predicting future states and goal-oriented abstractions that guide the subsequent actions to accomplish tasks. To instantiate this framework, we design a text-based planning task, where an LLM acts as an agent in an environment and interacts with objects in containers to achieve a specified goal state. Our experiments reveal that fine-tuning as well as advanced pre-training strengthens LLM-built representations' tendency of maintaining goal-oriented abstractions during decoding, prioritizing task completion over recovery of the world's state and dynamics.

Live content is unavailable. Log in and register to view live content