Interactive Locality: A Framework for Measuring Information Flow in Hierarchical Recursive Reasoning

This paper proposes the task geometry-aware interactive locality framework, which aims to quantify local-global information flow in hierarchical recursive models (e.g., HRM, TRM). Using sparse autoencoders and activation patching techniques, this framework not only reveals the information organization patterns of explicit recursive reasoning models but also compares their structural differences with embodied 3D models (e.g., MTU3D), providing a new perspective for the interpretability research of spatial reasoning models.

Spatial reasoning is the cornerstone of human intelligence, requiring a balance between position-bound computation (focusing on specific local information) and position-invariant structure (grasping global constraints). Existing hierarchical recursive models claim to achieve local-to-global reasoning, but lack quantitative verification, making it difficult to clarify the specific patterns of information flow.

The interactive locality framework transforms the intuition of "local execution, global planning" into a measurable method, with core concerns: Does the model's information flow remain confined to adjacent regions/semantic segments, or does it propagate across long distances? Its unique task geometry-aware characteristic defines "adjacency" based on task types (e.g., path adjacency in mazes, row-column-box in Sudoku, object neighborhoods in ARC), adapting to the structural characteristics of different tasks.

The framework uses the following techniques: 1. Sparse autoencoder feature ablation: Decompose model activations into sparse features and track information flow through ablation; 2. Limited-noise activation patching: Replace activations in a certain layer of the model (input A → input B) and observe the impact on subsequent computations; 3. The appendix supplements structural Jacobian matrix and attention pattern analysis to provide complementary verification.

Experiments on three benchmarks (Maze-Hard, Sudoku Extreme, ARC-AGI) show: 1. In maze navigation, high-level recurrent states tend to write information in adjacent grids/path segments, and recursive updates accumulate into a global solution; 2. In Sudoku, constraint information mainly propagates within relevant rows, columns, and boxes, which aligns with the task's constraint geometry; 3. In ARC visual reasoning, information flow is concentrated in object neighborhoods, with the TRM model having the strongest locality.

Comparisons with MTU3D (an embodied 3D scene understanding model) reveal: The local-global transition of explicit recursive models (HRM, TRM) is dynamically bound to recursive reasoning; while the causal spatial locality of MTU3D is concentrated at the transition point where visual features are passed to the grounding module, not inside the encoder. This indicates that the two adopt different information organization strategies: recursive models build global structures through iteration, while modular models transfer information through interfaces.

Contributions: 1. Convert vague local-global concepts into quantitative indicators; 2. Task geometry awareness adapts to different task structures; 3. Cross-architecture applicability (recursive/embodied models). Limitations: Limited benchmark scope, no coverage of large-scale Transformers, causal strength needs verification. Future Directions: Extend to language models, active intervention experiments, link theory to computational complexity trade-offs.