Psychological Concept Neurons: Can We Control the 'Personality' of Large Models?

Key Research Points

This study explores the connection between large language models (LLMs) and the psychological 'Big Five Personality' theory, with core findings as follows:

1. LLMs internally have psychological concept neurons corresponding to the Big Five personality dimensions;
2. Intervening on these neurons can causally change the model's internal representations (success rate for some targeted directions exceeds 80%);
3. However, the transfer of internal representation manipulation to generative behavior has significant limitations (e.g., reduced effect, cross-trait spillover). The study provides key scientific basis for AI interpretability, alignment, and personality engineering.

Big Five Personality Theory Framework

The mainstream 'Big Five Personality' in contemporary personality psychology includes five dimensions:

• Openness: Acceptance of new experiences (imagination, curiosity);
• Conscientiousness: Self-discipline and goal orientation (reliable, organized);
• Extraversion: Tendency to gain energy from external sources (talkative, social);
• Agreeableness: Interpersonal harmony (friendly, cooperative);
• Neuroticism: Emotional stability (anxious, tense).

Issues with AI Personality Mimicry

LLMs can already mimic specific personality traits, but the core questions are: Do models internally encode these psychological concepts? Can their behavior be manipulated through intervention?

Key Technical Paths

1. Detection Technology: Train classifiers at different layers of the model to determine the decodability of personality information;
2. Localize Concept Neurons: Identify neurons that respond selectively to specific personality dimensions (e.g., 'high openness');
3. Intervention Experiments:
   • Activation enhancement: Increase the activation level of target neurons;
   • Activation inhibition: Reduce the activation of target neurons;
   • Targeted manipulation: Precisely control activation patterns to push towards specific personality directions.

Detection Results

• Personality information can be decoded in early layers and persists through deep layers;
• Personality information emerges faster than other semantic information.

Localization Results

• Concept-selective neurons are most dense in the middle layers of the model;
• Neurons for different personality dimensions have limited overlap, and representations are distributed (encoded by multiple neurons together).

Intervention Effects

• Interventions can consistently change detector readings (enhancing openness → shift towards high openness);
• Interventions in middle layers have the most obvious effect, while early/deep layers are weaker;
• Success rate for some concept directions exceeds 80%, confirming causal participation.

Limitations of Behavior Manipulation

1. Reduced Effect: The impact of internal representation manipulation on the distribution of generated labels is much weaker than at the representation level;
2. Concept Dependence: Dimensions like extraversion are more sensitive to interventions, but neuroticism is harder to manipulate;
3. Cross-Trait Spillover: Intervening on a single dimension easily affects other traits (e.g., enhancing openness → affects extraversion);
4. Difficulty in Precise Control: Even when intervening on a large number of neurons, it is difficult to achieve precise regulation of generative behavior.

Key Implications

1. Controllability Boundary: Simple neural manipulation is difficult to 'program' AI personality; the impact is limited and imprecise;
2. Safety Risks: Malicious interventions may induce models to exhibit specific personality traits;
3. Personalized Applications: Understanding the mechanism helps customize customer service/virtual companions, etc., but technical limitations must be faced squarely;
4. Evaluation Challenges: Comprehensive evaluation needs to combine internal representations and actual behavior.

Key Exploration Areas

1. Fine-grained Intervention Technology: Develop methods that can stably manipulate a single trait;
2. Cross-Model Comparison: Verify personality representation patterns of models with different architectures/scales;
3. Dynamic Personality: Study the dynamic changes of personality representations in conversations;
4. Causal Mechanism: Analyze the transformation chain from representation to behavior;
5. Application Verification: Test the practicality of personality regulation technology in real scenarios.