Invisible Crisis in Agent Workflows: Near-Misses and Detection of Potential Strategy Failures

This article focuses on the "near-miss" phenomenon in LLM agent workflows—potential failures where the result is correct but the decision-making process bypasses key strategy checks. The study reveals the blind spot of traditional evaluations that only focus on final results, proposes a detection method based on the ToolGuard framework, and finds through experiments that 8-17% of correct results have near-miss risks, emphasizing that agent systems need to shift from "correct results" to "trustworthy processes".

In LLM agent applications, people often overlook the compliance of decision-making processes. A "near-miss" refers to cases where the result is correct but the process violates rules (e.g., an airline booking agent skips membership level checks but succeeds by chance). Traditional evaluations only compare the final state with ground truth and cannot identify such "lucky successes", whose hidden risks may lead to disasters in real complex scenarios.

The study is based on the ToolGuard framework, which converts natural language strategies into executable guard code to monitor tool calls in real time and record decision trajectories. The core of near-miss detection is to determine whether necessary prerequisite information is obtained before tool invocation—if a correct choice is made without the required information, it constitutes a near-miss (e.g., refunding a ticket without verifying identity but still meeting the conditions).

In aviation benchmark tests, trajectories of multiple mainstream LLMs (open-source/proprietary) show that 8-17% of correct results have potential strategy failures. That means among every 6-12 "correct" decisions, one is a "lucky guess", and this cumulative risk is huge in high-demand scenarios such as aviation.

Near-misses are more dangerous than explicit errors (they are hidden, reflect flaws in strategy understanding, and reduce interpretability). Evaluations need to shift to process-oriented approaches: track complete trajectories, verify information sufficiency, identify lucky successes, quantify near-miss rates, and ensure agents truly understand strategies rather than relying on statistical shortcuts.

Enterprises should: 1. Introduce process evaluations in testing and inject edge cases; 2. Establish strategy monitoring and trajectory recording mechanisms; 3. Include near-miss rates in model selection; 4. Conduct regular audits of agent behavior to address model updates and data drift.