Selective Forgetting in Large Reasoning Models: Precisely Erasing Sensitive Knowledge While Preserving Reasoning Ability

This article proposes a new selective forgetting framework for Large Reasoning Models (LRMs), addressing the limitations of traditional machine forgetting methods on LRMs. It can precisely erase sensitive reasoning content while preserving general reasoning ability, providing a new path for the secure deployment of LRMs.

LLMs' memory of sensitive information poses ethical and legal risks, and traditional machine forgetting techniques are not suitable for LRMs: LRMs generate Chain of Thought (CoT) which easily leaks sensitive knowledge. Existing methods either impair overall reasoning ability or damage general reasoning ability. The core challenge is to precisely remove target knowledge while maintaining the integrity of general reasoning ability.

The core of the framework is to only process CoT segments containing sensitive information: 1. Multi-LLM combined with RAG to analyze CoT and identify sensitive segments; 2. Replace sensitive segments with benign placeholders to preserve logical structure; 3. Feature replacement forgetting loss function to suppress the generation of sensitive content and enhance effective alternatives.

Experiments on synthetic datasets and real medical datasets show: Target sensitive knowledge is effectively removed; General reasoning ability is comparable to that before forgetting; The logical structure of CoT is coherent, proving the framework's effectiveness.

This research is of great significance for AI security and privacy, applicable to sensitive fields such as finance and healthcare; It can remove sensitive knowledge without retraining the model, saving costs and avoiding performance fluctuations; Its interpretability makes it suitable for audit and compliance scenarios.

The framework balances privacy and ability by precisely identifying and replacing sensitive segments. Future directions include expanding to complex reasoning scenarios, optimizing placeholder quality, combining differential privacy, etc. Managing the knowledge boundaries of LRMs remains an important topic in AI research.