Predicting Future Behavior: A New Paradigm for Controlled Generation of Large Reasoning Models

Large reasoning models (such as DeepSeek-R1 and OpenAI o1) possess strong multi-step reasoning capabilities, but they face unpredictability issues that hinder practical deployment. This study proposes training activation probes to predict the future behavior of models and develops the Future Probe Controlled Generation (FPCG) method based on this, enabling effective guidance with almost no reduction in output quality, thus opening up a new direction for research on the controllability of reasoning models.

Control Dilemmas of Reasoning Models

Large reasoning models (LRMs) often exhibit unpredictable behaviors such as path deviation, lengthy reasoning chains, and errors in key steps, posing challenges to practical applications. Engineers need to effectively guide model behavior.

Limitations of Existing Methods

Current test-time guidance methods rely on detection features to identify generated behaviors, but detection features are only good at "retrospection" (identifying what has happened) rather than "prediction" (indicating what will happen), leading to lagging and passive interventions with limited effectiveness.

Probe Training Method

Extract hidden states from the model's intermediate reasoning steps and train lightweight linear probes. The task is to predict the model's final behavior (such as correct/incorrect answers, reasoning strategies, behavior patterns, etc.) based on the current hidden state.

Prediction Performance

Experiments show that the probe's prediction accuracy ranges from 64% to 91%, and it can predict the final behavior with high confidence from intermediate steps. Moreover, the prediction features are "predictive signals", which are different from detection features.

FPCG Working Principle

1. Candidate sampling: Sample multiple candidate sentences at each decoding step;
2. Future prediction: Use probes to predict the future behavior each candidate leads to;
3. Optimal selection: Choose the candidate that leads to the desired behavior;
4. Continue generation: Decode based on the selected candidate.

Key Advantages

• Almost no quality loss: Selection at the text level without changing internal computations;
• Proactive guidance: Pre-select the optimal path instead of post-hoc correction;
• Solve scenarios where traditional activation guidance fails.

Guidance Effect

FPCG successfully guides the model toward desired behaviors, achieving control effects that traditional methods cannot reach.

Output Quality

FPCG causes almost no reduction in output quality during guidance, while traditional activation guidance methods often come with significant quality degradation.

Probe Generalization Ability

The probe generalizes well across different reasoning tasks, with stable prediction accuracy across tasks.

Separation of Detection and Prediction Features

Dimension	Detection Features	Prediction Features
Time Direction	Looking backward	Looking forward
Information Content	"What has happened"	"What will happen"
Intervention Timing	Lagging	Proactive
Application Scenario	Post-hoc analysis	Pre-hoc guidance

AI Safety Implications

• Early warning: Predicting harmful outputs allows early intervention;
• Capability assessment: Probes as a tool for model self-assessment;
• Alignment training: Strengthening prediction features to help cultivate controllable models.

Research Limitations

• Probe training requires behavior-labeled data, which is costly;
• Prediction scope is limited to the near future, with limited long-term planning capabilities;
• Predefined behavior types are needed; new behaviors require additional training;
• Candidate sampling increases computational overhead.

Future Directions

• Efficient probe training methods;
• Extend prediction time range;
• Unsupervised/weakly supervised prediction feature discovery;
• Combine FPCG with other guidance methods.

Industry Application Prospects

Potential applications in scenarios such as educational assistance, code generation, mathematical reasoning, dialogue systems, and creative writing.

Conclusion

This study reveals that the model's hidden states encode future expectations, and "predictive control" is a key technology for AI safety and controllability, opening up a new direction for research on the controllability of reasoning models.