Zing Forum

Reading

Graph of Trace: Visualizing the Thought Process of Scientific AI Agents

The Graph of Trace framework organizes the execution traces of AI agents into directed graphs, enabling real-time monitoring and visualization of complex scientific research workflows, significantly enhancing the efficiency and interpretability of human-AI collaboration.

Graph of Trace执行轨迹可视化科学AI智能体可解释性人机协作工作流监控有向图科研自动化
Published 2026-06-13 13:09Recent activity 2026-06-16 12:55Estimated read 5 min
Graph of Trace: Visualizing the Thought Process of Scientific AI Agents
1

Section 01

Introduction: Overview of the Graph of Trace Framework

The Graph of Trace framework organizes the execution traces of scientific AI agents into directed graphs, enabling real-time monitoring and visualization of complex scientific research workflows. It addresses the 'black box' problem of AI agents, significantly enhances the efficiency and interpretability of human-AI collaboration, and provides key support for research automation.

2

Section 02

Problem Background: Challenges in Agent Workflow Tracking

The increasing capabilities of scientific AI agents have led to more complex workflows (multi-step reasoning, tool invocation, cross-modal data processing), making it difficult for humans to understand their execution processes. Traditional text logs cannot answer questions like 'why' and 'how to improve', so a visualization solution that intuitively displays structure and highlights decision points is needed.

3

Section 03

Core Design: Directed Graph Representation of Execution Traces

The core innovation is organizing execution traces into directed graphs: nodes represent execution events (tool invocation, code execution, reasoning steps), and edges represent dependencies and data flows. Advantages include: explicit structure (showing topological structure and bottlenecks), fine-grained recording (details like tool parameters/return values), and real-time updates (dynamic progress monitoring).

4

Section 04

Visualization Features: Multi-level Information Presentation

Four views are provided: Overview View (overall structure and key paths), Detailed View (parameters/reasoning basis of specific steps), Timeline View (temporal dependencies and parallelism), and Difference View (comparing differences between different execution traces).

5

Section 05

User Research: Positive Feedback from Interdisciplinary Experts

Experts from AI, neuroscience, and biology were invited to evaluate. Results show: improved interpretability (clear view of reasoning processes), increased efficiency in fault localization (quickly identifying problem areas), and enhanced interactive experience (supporting pausing/modifying execution plans).

6

Section 06

Application Scenarios: Wide Applicability Across Multiple Domains

Research domain: Understanding how agents analyze data/generate hypotheses; Industrial domain: Monitoring automated workflows and auditing decisions; Education domain: Serving as a teaching tool to help understand algorithm principles.

7

Section 07

Key Technical Implementation Points

Key technologies include: Event capture (implanting hooks in the agent framework), graph construction algorithm (directed graph from linear event flow), performance optimization (incremental rendering/lazy loading), and scalability (flexible plugin mechanism supporting multiple data sources).

8

Section 08

Future Outlook: From Visualization to Intervenability

Future directions: Supporting real-time intervention (modifying agent behavior), predictive visualization (previewing workflows), optimization suggestions based on historical traces, and becoming a key infrastructure for transparent and controllable AI systems.