Small Language Models Empower Large Model Prompt Disambiguation: A New Low-Cost, High-Efficiency Approach to Inference Optimization

The research team proposes an innovative prompt optimization method that uses small language models (SLMs) to perform semantic disambiguation on ambiguous prompts before inference. This method can improve large model inference performance by 2.5 percentage points at a cost of only $0.02. By moving prompt optimization to the preprocessing stage, it avoids interfering with the internal mechanisms of large models, providing a low-cost and efficient optimization approach for large model applications.

The inference performance of large language models (LLMs) is highly dependent on prompt quality. However, user natural language prompts often contain semantic ambiguities (such as unclear references, ambiguous modification relationships, and vague quantifier scopes), leading the model's inference path to deviate from the user's intent. Previous methods corrected issues during the inference process but did not address the ambiguity problem at its root.

The method consists of three key steps: 1. Semantic risk identification: Analyze ambiguity risk points in the prompt; 2. Multi-perspective consistency check: Examine potential ambiguity points from multiple angles to confirm conflicting interpretations; 3. Conflict resolution and structural reorganization: Resolve semantic conflicts and reorganize the prompt into a logically clear one.

Small language models are chosen for disambiguation for two reasons: First, the complexity of the disambiguation task is lower than that of the core inference task of large models, so small models can handle it. Second, small models have high computational efficiency, with a single processing cost of only $0.02, making them suitable for large-scale deployment.

Experiments show that disambiguated prompts improve inference performance by an average of 2.5 percentage points without modifying large model parameters. Analysis of the attention mechanism reveals that disambiguated prompts make the model's attention more focused on semantically key tokens, explaining the mechanism behind the performance improvement.

Method advantages: Modular design (independent of the inference process, easy to integrate), interpretability (transparent disambiguation process), and universality (applicable to various LLMs). Suitable application scenarios: Customer service dialogues, educational Q&A, legal/medical consulting, and other fields with high accuracy requirements.

Current limitations: Limited ability to handle deep ambiguities that require domain-specific expertise. Future directions: Enhance disambiguation accuracy by combining knowledge graphs; develop adaptive disambiguation strategies; explore joint optimization of disambiguation and inference.

The research shows that improving input quality can effectively enhance large model performance. Using small models for low-cost prompt preprocessing to achieve significant returns with minimal investment provides valuable references for large model engineering practices.