The Truth Stays in the Family: Enhancing Contextual Grounding via Inherited Truthful Heads in Model Lineages

Core Insights This study reveals that contextual truthfulness scores in large language model (LLM) lineages have strong heritability, and proposes the TruthProbe soft gating strategy to reduce hallucinations and improve contextual truthfulness by amplifying truthful attention heads within the lineage.

Source Information

• Original Authors: arXiv authors, miso-choi (GitHub: https://github.com/miso-choi/TruthProbe)
• Source Platform: arXiv
• Original Title: The Truth Stays in the Family: Enhancing Contextual Grounding via Inherited Truthful Heads in Model Lineages
• Link: http://arxiv.org/abs/2606.15821v1
• Publication Time: 2026-06-14T13:39:09Z

Model lineages (e.g., series based on LLaMA2, Qwen2.5) consist of downstream variants sharing a base LLM, but the deep behavioral connections between base models and downstream models remain unclear:

• If a base model is prone to hallucinations or unfaithful to context, do downstream models inherit these traits?
• If a base model performs well in a certain aspect, can the advantages be transferred to downstream tasks? Understanding this connection is crucial for model selection, capability prediction, and hallucination mitigation.

The research team quantified contextual truthfulness scores at the attention head level and found:

1. Cross-Lineage Consistency: In lineages such as Vicuna, Qwen2.5, LLaMA2, and Mistral, truthfulness scores are strongly preserved within the lineage (even after instruction tuning or multimodal adaptation).
2. Weight and Behavioral Inheritance: High-truthfulness attention heads maintain similar weight patterns in fine-tuned models and focus on query-related evidence, providing a basis for interpretability.

Design of the TruthProbe Soft Gating Strategy:

• Core Principle: Leverage the heritability of truthfulness to identify and amplify well-performing attention heads within the lineage without retraining the model.
• Implementation Steps:
  1. Head-level truthfulness scoring;
  2. Calculate soft gating weights based on scores (truthful heads receive higher weights);
  3. Dynamically adjust attention distribution during inference;
  4. Preserve the unique functions of non-truthful heads to avoid capability degradation.

Experimental Validation Results:

• Contextual Truthfulness: Significant improvement on the HaluEval hallucination benchmark;
• Multimodal Hallucination Reduction: Excellent performance on POPE (visual-language object presence hallucination) and CHAIR (image description hallucination) benchmarks;
• Cross-Generation Transfer: Truthfulness scores of base LLMs are effectively transferred to fine-tuned LLMs and multimodal descendants.

Technical Insights:

• Model lineages are channels for inheritance of behavioral traits;
• Attention heads exhibit functional specialization (some are responsible for contextual truthfulness);
• Soft intervention (instead of hard removal) can maintain model robustness while improving target metrics;
• Provides a new approach for model interpretability and controllability.

Practical Application Value:

• Model Selection: Need to consider the truthfulness performance of base models (affects downstream lineages);
• Hallucination Mitigation: A lightweight solution to improve the reliability of deployed models without retraining;
• Model Auditing: Fine-grained analysis of attention heads to identify scenarios prone to hallucinations;
• Multimodal Optimization: Improving the truthfulness of base LLMs can simultaneously enhance downstream multimodal models.

Limitations:

• Relies on the genetic traits of model lineages, so its effect is limited for models without clear lineage relationships;
• Evaluation is based on specific benchmarks; needs to be validated in more extensive scenarios;
• Attention head analysis and manipulation incur additional computational overhead.

Future Directions:

• Cross-lineage generalization;
• Dynamic adaptive gating strategy;
• Multidimensional behavioral manipulation (truthfulness, safety, etc.);
• Directly optimize attention head truthfulness during training.

The research team has open-sourced the code (https://github.com/miso-choi/TruthProbe), and the community value includes:

• Reproducibility: Facilitates verification and extension by other researchers;
• Toolization: Developers can integrate it into model optimization workflows;
• Benchmark Establishment: Helps form evaluation standards for attention head manipulation methods.