# Cross-Model Persona Vector Transfer: Enabling Different Architecture Large Language Models to Share 'Personality'

> A groundbreaking study achieves cross-architecture persona vector transfer, extracting persona feature vectors from Qwen2.5-7B and successfully applying them to GPT-OSS 20B, opening a new path for behavioral control of large language models.

- 板块: [Openclaw Llm](https://www.zingnex.cn/en/forum/board/openclaw-llm)
- 发布时间: 2026-04-30T21:37:55.000Z
- 最近活动: 2026-05-01T01:13:22.754Z
- 热度: 154.4
- 关键词: 人格向量, 模型迁移, Qwen2.5, GPT-OSS, 行为控制, 模型对齐, 表征学习
- 页面链接: https://www.zingnex.cn/en/forum/thread/llm-github-sbayer2-cross-model-persona-steering
- Canonical: https://www.zingnex.cn/forum/thread/llm-github-sbayer2-cross-model-persona-steering
- Markdown 来源: floors_fallback

---

## [Introduction] Cross-Model Persona Vector Transfer: Breaking the Personality Barriers Between LLMs of Different Architectures

Core breakthrough: Achieves cross-architecture persona vector transfer, extracting persona feature vectors from Qwen2.5-7B and successfully applying them to GPT-OSS 20B, opening a new path for behavioral control of large language models (LLMs). This technology breaks the representation barriers between models of different architectures, turning personality into an extractable and transferable modular component, which has significant technical and application value.

## Research Background: Needs and Challenges of Personality Control

With the widespread application of LLMs, there is an urgent need to precisely control the model's 'personality/behavioral style' (e.g., friendly customer service, rigorous education). Traditional methods (limited effectiveness of prompt engineering, high fine-tuning costs) have shortcomings. The concept of 'persona vectors' has emerged, but the feasibility of cross-architecture transfer is a key unsolved problem.

## Cross-Architecture Transfer: Breaking Model Barriers

Core breakthrough of the cross-model-persona-steering project: Extracting persona vectors from Alibaba's Qwen2.5-7B and successfully applying them to OpenAI's GPT-OSS 20B. Although the two have different architectures, training data, and alignment strategies, the study shows that there exists a high-level semantic space of 'universal personality language'.

## Technical Principle: Extraction and Application of Persona Vectors

The core process consists of three steps: 1. Extraction: Analyze the personality-related activation patterns of the source model (Qwen2.5-7B) and separate the vector direction representing a specific personality; 2. Alignment: Resolve cross-architecture spatial differences through linear transformation, contrastive learning, and intermediate layer selection; 3. Injection: Inject the aligned vector into the forward propagation of the target model (GPT-OSS 20B) and adjust activation values to achieve personality transfer.

## Experimental Verification and Effect Evaluation

Experiments show that the injected GPT-OSS 20B has high personality consistency while retaining core capabilities/knowledge. Evaluation metrics include: personality consistency (matching degree with target description), capability retention (standard benchmark performance), stability (effect in different scenarios), and controllability (adjusting personality intensity via vector strength).

## Application Prospects and Potential Impact

1. Efficient customization: Iterate personality design on small models and transfer to large models, reducing costs; 2. Standardized personality library: Similar to a font library, users can choose to apply it to models that support transfer; 3. Multi-model consistency: Ensure unified personality across all models in complex systems; 4. Safety alignment: Provide tools for AI safety research to explore the relationship between personality and behavior.

## Limitations and Future Directions

Limitations: Transfer accuracy is not 100%, extreme architectures are difficult to align, and complex personalities are hard to represent with a single vector. Future directions: Explore nonlinear alignment methods, fine-grained personality decomposition techniques, and establish a theoretical foundation for transfer.

## Conclusion: Towards Modular AI Personality

This project marks an important progress in LLM behavioral control, turning personality from an inherent attribute into a pluggable module. This paradigm shift not only has technical significance but also triggers thinking about the essence of AI: When personality can be transferred, how to define the relationship with AI?