What Makes High-Quality Multilingual Reasoning? An Analysis of Reasoning Trajectories from the Perspective of Measurable Features

Large Reasoning Models (LRMs) exhibit strong reasoning capabilities in English, but there are significant performance gaps in other languages. Current research implicitly assumes that English reasoning patterns are applicable to all languages. However, the latest study, by analyzing measurable reasoning features across 10 languages, finds that reasoning features derived from English show significant differences or even reversals in correlation strength in other languages, challenging the English-centric reward design assumption and providing profound insights for the optimization of multilingual AI.

Currently, most LRMs are trained and optimized on English corpora, and their reasoning capabilities are first validated on English tasks. When extended to other languages, a common assumption is that reasoning is inherently language-agnostic, so English patterns should apply to other languages. Based on this, strategies often replicate English reasoning (e.g., reward models prefer English structures, datasets use English as a template), but ignore the problem that reasoning patterns in different languages may vary due to structural and cultural cognitive differences.

The study defines three categories of measurable reasoning features:

1. Multilingual alignment features: lexical overlap, structural similarity, semantic equivalence;
2. Reasoning step features: step granularity, logical clarity, computational accuracy;
3. Reasoning flow features: information gain, backtracking frequency, conclusion convergence.

Empirical analysis of 4 LRMs' performance across 10 languages:

• English advantages are not universal: Feature correlation strengths vary greatly (e.g., moderately detailed steps are effective in English, while conciseness is more effective in Japanese and Korean);
• Reversal of feature correlation directions: For example, fewer backtracking steps are better in English, but moderate backtracking is optimal in some languages;
• Sparse autoencoders reveal implicit patterns: For instance, conditional branch reasoning is frequent and effective in some languages.

Results of using features as selection strategies during testing:

• Language-customized weights significantly outperform uniform weights;
• Feature combination predictions are more reliable;
• Adaptive strategies perform close to supervised learning, demonstrating the potential for lightweight optimization.

Implications of the study for reward design:

1. Challenge the English-centric assumption: English-preferring reward models may underestimate effective patterns in non-English languages;
2. Language-adaptive rewards: Customize reasoning preferences for each language (different reward models, language-specific weights, etc.);
3. Rethink multilingual benchmarks: Develop native datasets, adopt language-specific evaluation criteria, avoid English as the sole reference.

Limitations: Only focuses on mathematical reasoning, and the coverage of 10 languages is limited. Future directions:

• Cognitive linguistics perspective: Explore the relationship between language structure and reasoning;
• Cross-cultural factors: Distinguish between the impacts of language structure and cultural cognition;
• Adaptive training strategies: Automatically discover language-specific reasoning patterns;
• Multilingual collaborative reasoning: Strategies for cross-language knowledge transfer and sharing.

The study reveals the complexity and specificity of multilingual reasoning, reminding us not to simply apply English patterns. An effective multilingual reasoning system needs to respect the uniqueness of each language and tailor evaluation criteria and optimization goals accordingly. This has broad implications for multilingual AI applications, and understanding and respecting language diversity is increasingly important.