# Interactive Locality: A Framework for Measuring Information Flow in Hierarchical Recursive Reasoning

> Proposes a task geometry-aware interactive locality framework that quantifies local-global information flow in hierarchical recursive models using sparse autoencoders and activation patching techniques, and reveals structural differences between explicit recursive reasoning models and embodied 3D models.

- 板块: [Openclaw Llm](https://www.zingnex.cn/en/forum/board/openclaw-llm)
- 发布时间: 2026-05-20T06:25:49.000Z
- 最近活动: 2026-05-21T03:54:07.875Z
- 热度: 125.5
- 关键词: 空间推理, 层次递归, 稀疏自编码器, 激活修补, 具身AI, 可解释性
- 页面链接: https://www.zingnex.cn/en/forum/thread/llm-arxiv-2605-20784v1
- Canonical: https://www.zingnex.cn/forum/thread/llm-arxiv-2605-20784v1
- Markdown 来源: floors_fallback

---

## Interactive Locality Framework: A New Tool for Measuring Information Flow in Hierarchical Recursive Reasoning

This paper proposes the **task geometry-aware interactive locality framework**, which aims to quantify local-global information flow in hierarchical recursive models (e.g., HRM, TRM). Using sparse autoencoders and activation patching techniques, this framework not only reveals the information organization patterns of explicit recursive reasoning models but also compares their structural differences with embodied 3D models (e.g., MTU3D), providing a new perspective for the interpretability research of spatial reasoning models.

## Core Tensions in Spatial Reasoning and Limitations of Existing Models

Spatial reasoning is the cornerstone of human intelligence, requiring a balance between **position-bound computation** (focusing on specific local information) and **position-invariant structure** (grasping global constraints). Existing hierarchical recursive models claim to achieve local-to-global reasoning, but lack quantitative verification, making it difficult to clarify the specific patterns of information flow.

## Core Definitions and Characteristics of the Interactive Locality Framework

The interactive locality framework transforms the intuition of "local execution, global planning" into a measurable method, with core concerns: Does the model's information flow remain confined to adjacent regions/semantic segments, or does it propagate across long distances? Its unique **task geometry-aware** characteristic defines "adjacency" based on task types (e.g., path adjacency in mazes, row-column-box in Sudoku, object neighborhoods in ARC), adapting to the structural characteristics of different tasks.

## Technical Implementation: Sparse Autoencoders and Activation Patching

The framework uses the following techniques: 1. **Sparse autoencoder feature ablation**: Decompose model activations into sparse features and track information flow through ablation; 2. **Limited-noise activation patching**: Replace activations in a certain layer of the model (input A → input B) and observe the impact on subsequent computations; 3. The appendix supplements **structural Jacobian matrix** and attention pattern analysis to provide complementary verification.

## Experimental Findings: Recursive Accumulation Patterns from Local to Global

Experiments on three benchmarks (Maze-Hard, Sudoku Extreme, ARC-AGI) show: 1. In maze navigation, high-level recurrent states tend to write information in adjacent grids/path segments, and recursive updates accumulate into a global solution; 2. In Sudoku, constraint information mainly propagates within relevant rows, columns, and boxes, which aligns with the task's constraint geometry; 3. In ARC visual reasoning, information flow is concentrated in object neighborhoods, with the TRM model having the strongest locality.

## Structural Differences Between Explicit Recursive Models and Embodied 3D Models

Comparisons with MTU3D (an embodied 3D scene understanding model) reveal: The local-global transition of explicit recursive models (HRM, TRM) is dynamically bound to recursive reasoning; while the causal spatial locality of MTU3D is concentrated at the transition point where visual features are passed to the grounding module, not inside the encoder. This indicates that the two adopt different information organization strategies: recursive models build global structures through iteration, while modular models transfer information through interfaces.

## Contributions, Limitations, and Future Directions

**Contributions**: 1. Convert vague local-global concepts into quantitative indicators; 2. Task geometry awareness adapts to different task structures; 3. Cross-architecture applicability (recursive/embodied models). **Limitations**: Limited benchmark scope, no coverage of large-scale Transformers, causal strength needs verification. **Future Directions**: Extend to language models, active intervention experiments, link theory to computational complexity trade-offs.