Research on Sensitive Personal Information Detection in Pre-trained Corpora of Japanese Large Language Models

This study is the first to systematically explore the detection of Special Care Personal Information (SCPI) in pre-trained corpora of Japanese large language models, filling the gap in this field. The research uses large model-assisted annotation to build datasets and train classifiers adapted to Japanese characteristics, providing important technical support for privacy compliance and data security of Japanese large language models. The original paper is from the arXiv platform, published on June 10, 2026, link: http://arxiv.org/abs/2606.12114v1.

Pre-training of large language models requires massive data. If it contains sensitive information, it is prone to privacy leaks and regulatory risks. Research on Japanese sensitive information detection is relatively scarce, and developers lack effective tools. SCPI defined by Japan's Personal Information Protection Act (APPI) includes race, political views, medical records, etc. The consequences of leakage are serious, and compliance needs are urgent, but manual review is unrealistic, so the development of automated tools is imminent.

1. Data Construction: Using large model-assisted annotation, with advantages of high efficiency, consistent annotation, and strong scalability; 2. Model Training: Training machine learning classifiers targeting Japanese characteristics such as grammatical structure, honorific system, and mixed use of characters.

Results: The developed SCPI classifier can effectively identify sensitive content and provide a feasible technical solution. Challenges: 1. The difference between Japanese and English is large, so the effect of direct migration methods is limited; 2. SCPI identification relies on context, and pattern matching is insufficient; 3. The boundary of sensitive information is blurred, requiring fine judgment.

For the Japanese large model ecosystem: reduce privacy risks, meet compliance requirements, and improve data quality; Methodological inspiration: The "large model-assisted annotation + classification" pipeline can provide reference for low-resource languages; Frontier exploration: Promote the expansion of privacy protection technology to multilingual and multicultural scenarios.

Limitations: Limited dataset size, accuracy in complex contexts needs to be improved, and coverage of emerging internet terms is insufficient. Future directions: Expand the dataset, multi-modal expansion, real-time detection system, cross-language migration to other Asian languages.

This study fills the gap in Japanese SCPI detection and provides practical compliance tools. It reveals the necessity of multilingual privacy protection technology, lays the foundation for subsequent work, and provides valuable experience for the global large model community.