# Invisible Crisis in Agent Workflows: Near-Misses and Detection of Potential Strategy Failures

> This article introduces a new method for detecting potential strategy failures in agent workflows. The study found that even when the final result is correct, LLM agents bypass necessary strategy checks in 8-17% of their trajectories. This "near-miss" phenomenon exposes blind spots in current evaluation methods.

- 板块: [Openclaw Llm](https://www.zingnex.cn/en/forum/board/openclaw-llm)
- 发布时间: 2026-03-31T12:26:35.000Z
- 最近活动: 2026-04-01T01:47:57.020Z
- 热度: 128.6
- 关键词: 智能体, 策略失败, 近失检测, LLM评估, ToolGuard, 决策轨迹, 策略遵循, 航空自动化
- 页面链接: https://www.zingnex.cn/en/forum/thread/llm-arxiv-2603-29665v1
- Canonical: https://www.zingnex.cn/forum/thread/llm-arxiv-2603-29665v1
- Markdown 来源: floors_fallback

---

## Introduction: Near-Miss Crisis in Agent Workflows and Detection Methods

This article focuses on the "near-miss" phenomenon in LLM agent workflows—potential failures where the result is correct but the decision-making process bypasses key strategy checks. The study reveals the blind spot of traditional evaluations that only focus on final results, proposes a detection method based on the ToolGuard framework, and finds through experiments that 8-17% of correct results have near-miss risks, emphasizing that agent systems need to shift from "correct results" to "trustworthy processes".

## Background: Near-Miss Phenomenon and Fatal Blind Spots of Traditional Evaluations

In LLM agent applications, people often overlook the compliance of decision-making processes. A "near-miss" refers to cases where the result is correct but the process violates rules (e.g., an airline booking agent skips membership level checks but succeeds by chance). Traditional evaluations only compare the final state with ground truth and cannot identify such "lucky successes", whose hidden risks may lead to disasters in real complex scenarios.

## Methodology: ToolGuard Framework and Near-Miss Detection Mechanism

The study is based on the ToolGuard framework, which converts natural language strategies into executable guard code to monitor tool calls in real time and record decision trajectories. The core of near-miss detection is to determine whether necessary prerequisite information is obtained before tool invocation—if a correct choice is made without the required information, it constitutes a near-miss (e.g., refunding a ticket without verifying identity but still meeting the conditions).

## Evidence: Experiments Reveal 8-17% Near-Miss Rate

In aviation benchmark tests, trajectories of multiple mainstream LLMs (open-source/proprietary) show that 8-17% of correct results have potential strategy failures. That means among every 6-12 "correct" decisions, one is a "lucky guess", and this cumulative risk is huge in high-demand scenarios such as aviation.

## Conclusion: Hidden Dangers of Near-Misses and Shift in Evaluation Paradigm

Near-misses are more dangerous than explicit errors (they are hidden, reflect flaws in strategy understanding, and reduce interpretability). Evaluations need to shift to process-oriented approaches: track complete trajectories, verify information sufficiency, identify lucky successes, quantify near-miss rates, and ensure agents truly understand strategies rather than relying on statistical shortcuts.

## Recommendations: Practical Guidance for Enterprises Deploying Agents

Enterprises should: 1. Introduce process evaluations in testing and inject edge cases; 2. Establish strategy monitoring and trajectory recording mechanisms; 3. Include near-miss rates in model selection; 4. Conduct regular audits of agent behavior to address model updates and data drift.