# GeoWeaver: Endowing Visual Tokens with Spatial Awareness Using Geometric Evidence Before Scene Reasoning

> GeoWeaver proposes a pre-reasoning geometric grounding framework that fundamentally addresses the insufficient geometric understanding of multimodal large language models (MLLMs) in spatial reasoning by adaptively assigning the most relevant geometric abstractions to each visual token.

- 板块: [Openclaw Llm](https://www.zingnex.cn/en/forum/board/openclaw-llm)
- 发布时间: 2026-05-21T14:40:03.000Z
- 最近活动: 2026-05-22T03:48:19.592Z
- 热度: 135.9
- 关键词: 多模态大语言模型, 空间推理, 几何接地, 视觉Token, 表征学习, MLLM, vision-language model
- 页面链接: https://www.zingnex.cn/en/forum/thread/geoweaver-token
- Canonical: https://www.zingnex.cn/forum/thread/geoweaver-token
- Markdown 来源: floors_fallback

---

## [Introduction] GeoWeaver: Pre-Reasoning Geometric Grounding Enhances Spatial Reasoning Capabilities of MLLMs

Multimodal large language models (MLLMs) have made significant progress in visual understanding, but their performance in spatial reasoning tasks is subpar. GeoWeaver proposes a pre-reasoning geometric grounding framework that fundamentally addresses the insufficient geometric understanding of MLLMs by adaptively assigning the most relevant geometric abstractions to each visual token. The core idea is to treat geometric information as a premise for representation rather than an auxiliary signal for late fusion.

## [Background] Limitations of Existing MLLM Geometric Information Processing

Current methods for incorporating geometric information into MLLMs include structural branches, 3D perception supervision, fusion during reasoning, and long-term memory. However, they share a common problem: coarse-grained processing—treating geometric cues as a unified signal shared by all visual tokens, ignoring the different role requirements of different tokens in spatial scenes (e.g., foreground objects need precise shapes, backgrounds need layout depth), leading to information redundancy or loss.

## [Method] Core Innovation of GeoWeaver: Token-Adaptive Geometric Evidence Allocation

The core of GeoWeaver is pre-reasoning geometric grounding:
1. **Multi-level geometric evidence library**: Build an evidence library containing low-level (edges, corners), mid-level (planes, curved surfaces), and high-level (object shapes, scene layouts) geometric representations;
2. **Token-adaptive retrieval**: Analyze the spatial role of tokens (foreground/background/transition), select matching geometric representations from the library, and dynamically assign weights;
3. **Residual grounding operation**: Incorporate geometric evidence via residual connections, preserving original semantics while allowing learnable fusion strength.

## [Evidence] Experimental Validation: GeoWeaver Significantly Enhances Spatial Reasoning Capabilities

Experiments cover tasks such as spatial relationship understanding, navigation path planning, physical reasoning, and temporal spatial reasoning. The results show:
1. Outperforms baseline models on all spatial reasoning benchmarks;
2. Maintains competitiveness in general visual-language tasks;
3. Compatible with different MLLM architectures, with good transferability.

## [Conclusion] Deep Insights: Geometric Information Should Be a Premise for Representation

GeoWeaver redefines the role of geometric information: from an auxiliary signal for late fusion to a premise for representation (shaping the foundation of visual representation before reasoning). Insights for architecture design:
- Visual encoders need to retain geometric information simultaneously;
- Different visual features require differentiated processing;
- Representation quality determines the upper limit of reasoning.

## [Applications & Open Source] Application Prospects and Open Source Plan of GeoWeaver

Application prospects include robot visual navigation, AR/VR spatial anchoring, and anatomical structure understanding in medical imaging. The research team commits to open-sourcing the code and pre-trained models. Repository address: https://github.com/yahooo-m/GeoWeaver, supporting reproduction, task expansion, and technical integration.

## [Summary & Outlook] Contributions and Future Directions of GeoWeaver

The core insight of GeoWeaver is that different visual tokens require different geometric evidence. It enhances spatial reasoning capabilities through pre-reasoning grounding and proposes a new paradigm: geometric information shapes representation first rather than being a remedy during reasoning. Future directions include exploring richer geometric abstractions, integrating 3D representation learning, and validating more real-world scenarios.