The Credibility Cost of Chain-of-Thought Compression: A Study on the Trade-off Between Efficiency and Safety

This paper is the first systematic study on the impact of chain-of-thought compression on model credibility. It finds that while compression reduces reasoning costs, it impairs safety, hallucination resistance, and multilingual robustness. The study proposes an alignment-aware DPO variant, which achieves a 19.3% chain-of-thought compression rate while significantly reducing credibility loss. This thread will elaborate on the background, problems, methods, solutions, and suggestions in separate floors.

Long Chain-of-Thought (Long-CoT) models improve performance on complex tasks through detailed reasoning, but more tokens lead to higher costs and longer response times. To address this challenge, chain-of-thought compression technologies have emerged, and existing evaluations mainly focus on task accuracy and token savings.

The capabilities of large language models are encoded in the same parameter space; compressing the chain of thought may alter internal representations. Even if accuracy remains unchanged, attributes such as safety and factual correctness may degrade. Relying solely on accuracy evaluation has limitations and may lead to serious consequences in actual deployment.

The study evaluated three credibility dimensions: safety (resistance to harmful requests), hallucination resistance (factual accuracy), and multilingual robustness. Key findings: Compression generally leads to credibility degradation; different methods have distinct degradation characteristics; degradation may exist implicitly (e.g., accurate in math tasks but prone to jailbreaking in sensitive topics). Additionally, a normalized efficiency scoring framework is proposed to quantify the trade-off between efficiency and credibility.

Standard DPO does not consider chain-of-thought length. The new variant optimizes three objectives simultaneously: maintaining accuracy, reducing chain length, and preserving credibility. Experimental results: The chain-of-thought length is reduced by 19.3%, and the degradation in safety, hallucination resistance, and multilingual robustness is significantly less than traditional methods.

1. Rethink evaluation criteria, treating efficiency and credibility as equally important constraints; 2. Conduct comprehensive credibility testing (edge cases, abuse scenarios) before deployment; 3. Developers should transparently report the impact of compression on credibility to help users make decisions.

Limitations: Evaluation dimensions do not cover fairness, etc.; the task scope is limited to reasoning; long-term impacts are not observed. Future directions: Dynamic credibility monitoring systems, adaptive compression (adjusting the degree based on input), and credibility-aware model architecture design.

Key insights: Accuracy is not the only evaluation metric; different compression methods have different impacts on credibility; explicitly considering credibility during alignment can balance efficiency and safety. This study provides a foundation for responsible AI development and emphasizes the importance of credibility in model optimization.