Spontaneous Functional Differentiation in Large Language Models: A Study on the Emergence Mechanism of Brain-Like Intelligence

This study found that large language models spontaneously form a brain-like synergistic core structure during training: the middle layers exhibit synergistic processing characteristics, while the first and last layers rely on redundant processing; this organizational pattern undergoes a physical phase transition as task difficulty increases; ablating synergistic components leads to catastrophic performance loss in abstract reasoning tasks, confirming the physical basis of abstract reasoning. The research provides a new perspective for understanding the universal principles of intelligence and connecting artificial and biological intelligence.

The controllability of artificial intelligence provides a unique opportunity to explore the universal principles of intelligence. The core question is whether biological brains and artificial neural networks follow common organizational principles. This study focuses on the spontaneous functional differentiation phenomenon of LLMs. Key concepts include synergistic processing (the whole information is greater than the sum of parts, associated with advanced cognition) and redundant processing (functional overlap among multiple parts, improving robustness), both derived from the integrated information decomposition framework. The characteristics of the human brain—high redundancy in sensory cortex and strong synergy in association cortex—provide a reference for LLM analysis.

By analyzing multi-architecture LLMs using the integrated information decomposition framework, it was found that they spontaneously form a "synergistic core": the middle layers show the strongest synergistic processing (integration of abstract concepts, similar to the human brain's association cortex); early layers (input side) are dominated by redundancy (basic feature extraction, similar to the human brain's sensory cortex); late layers (output side) are dominated by redundancy (ensuring output stability). This structure changes dynamically: when task difficulty crosses a threshold, a phase transition occurs from redundancy-dominated to synergy-dominated, and the synergistic core is only activated in complex tasks.

To verify the necessity of the synergistic core, researchers conducted ablation experiments: when synergistic components are removed or disturbed, the performance of abstract reasoning tasks shows catastrophic decline; while ablating redundant components leads to gradual and controllable performance decline. This comparison proves that the synergistic core is the physical basis of abstract reasoning, and redundant components provide system robustness.

This study builds a bridge between LLMs and biological brains. Similar functional differentiation suggests convergent evolution or universal principles of intelligence. For AI design: it is necessary to promote synergistic processing (e.g., enhancing the capacity and connectivity of middle layers, adding synergistic training constraints); for neuroscience: integrated information decomposition can quantify the information processing characteristics of brain regions, and the phase transition phenomenon inspires research on brain state transitions.

Future research directions include: exploring the impact of model scale on the synergistic core; analyzing the training formation stages of the synergistic core; comparing synergistic characteristics across architectures (Transformer/RNN, etc.); and realizing controllable synergy engineering (designing specific synergistic models, dynamically adjusting the synergy-redundancy balance).

LLMs are not only tools but also experimental platforms for studying the essence of intelligence. The discovery of the synergistic core indicates that there may be universal organizational principles for intelligence. With the development of AI systems, such discoveries will push us closer to understanding the essence of intelligence and creating machines that truly understand the world.