Research on Sparse Visual Thinking Circuits in Vision-Language Models

This study focuses on the interpretability of Sparse Autoencoders (SAE) in Vision-Language Models (VLM), with the core question of whether SAE features can form modular, composable reasoning units. The research team developed a reproducible causal analysis pipeline, tested it on the Qwen3-VL-8B model, found that the modularity hypothesis often does not hold, and identified the non-modular circuit interference phenomenon, providing a diagnostic framework for VLM control.

Sparse Autoencoders (SAE) have become an important tool for improving the interpretability of multimodal models. However, the hypothesis that SAE features can form modular, composable reasoning units has not been fully verified—yet this hypothesis is the foundation of many intervention-based model control methods.

The research team developed a reproducible causal analysis pipeline with the following steps:

1. Target Layer Identification: Use linear probes to locate task type information in the intermediate decoder layers of Qwen3-VL-8B
2. SAE Training: Train a sparse autoencoder on this layer
3. Feature Selection: Construct task-selective feature sets using explicit rules
4. Intervention Experiments: Perform scaling and ablation operations during inference, while quantifying accuracy and drift magnitude

Through systematic experiments, the study found that the modularity hypothesis often does not hold:

• Intervening on task-selective feature sets can moderately improve reasoning accuracy
• Intervening on the union of two such feature sets reliably triggers output drift (a large number of unexpected changes in prediction results)
• Even under norm-matched perturbation conditions, accuracy decreases This non-modular circuit interference indicates that feature unions amplify activation shifts through shared internal pathways.

The study was conducted on a controlled synthetic benchmark, which includes 7 task types and 3 difficulty levels. Validation methods include:

• Bootstrap subsampling
• Permutation control
• Reproduction across multiple VLM families
• Validation on 5 diverse datasets

This work clarifies the boundaries of SAE feature composability and provides a rigorous diagnostic framework for more reliable vision-language model control.