Edit-Level Majority Voting: Addressing Overcorrection in Large Model Grammatical Error Correction

The research team proposes a training-free edit-level majority voting method. By aggregating multiple candidate edit operations generated by a single model, it effectively mitigates the overcorrection problem in large model grammatical error correction. This method performs excellently on 9 grammatical error correction benchmarks covering 7 languages, outperforming greedy decoding and MBR decoding, and provides a practical inference-stage solution for large model GEC tasks.

Dilemma of Overcorrection

Overcorrection refers to the model making unnecessary modifications to originally correct parts (e.g., changing "The quick brown fox jumps..." to "leaps..."), leading to semantic drift, reduced user trust, and increased editing costs.

Limitations of Existing Methods

• Greedy Decoding: Simple and efficient but prone to overcorrection;
• MBR Decoding: Reduces overcorrection but has high computational cost and relies on similarity metrics;
• Training-stage solutions: Require retraining the model, which is costly and has poor transferability.

Core Insight: Consensus at the Edit Level

Inspired by human editing behavior: Real errors are corrected by most people, while correct parts are rarely modified. The voting granularity is refined from sentence level to edit operations (insertion/deletion/replacement).

Method Steps

1. Multiple Candidate Generation: Generate diverse candidates via temperature sampling;
2. Edit Extraction and Alignment: Convert candidates into standardized edit operations based on the minimum edit distance algorithm;
3. Majority Voting Aggregation: Count the frequency of edit operations, retain those supported by the majority, and apply them to generate the final result.

Cross-Language Coverage

Validated on 9 benchmarks covering 7 languages (e.g., English BEA-2019, Czech AKCES-GEC, etc.) to demonstrate generality.

Comparison Baselines

• Outperforms greedy decoding: Average F0.5 score improved significantly;
• Outperforms MBR decoding: Better performance and higher computational efficiency (O(n) vs O(n²)).

Key Findings

• Significantly reduces overcorrection rate;
• Strong prompt stability, insensitive to instruction prompts.

• Zero training cost: No fine-tuning or training required, can be applied to any existing model immediately;
• Plug-and-play: Integrated into existing GEC systems as a post-processing step without modifying the architecture;
• Simple hyperparameters: Candidate count, temperature, and voting threshold are semantically intuitive and easy to tune.

Limitations

• Complex edit alignment: Ambiguity easily arises from complex rewrites;
• Long sentence processing: Long sentences have many edit operations, leading to decreased statistical significance of voting.

Future Directions

• Combine confidence estimation, external knowledge, and iterative correction;
• Extend to other text generation tasks such as text simplification and style transfer.

Edit-level majority voting provides an elegant and practical solution to the overcorrection problem in large model grammatical error correction. Its training-free nature allows for immediate deployment, and it is expected to become a standard component in the practical application of GEC technology, helping to build more reliable and practical error correction systems.