IntegrityAI: A Hybrid Intelligent System for AI-Generated Text Detection and Academic Integrity Assessment

IntegrityAI is a hybrid intelligent system integrating Transformer models, stylometric analysis, and LLM scoring. It aims to detect AI-generated text and assess the originality of students' thinking, providing technical solutions for academic integrity in education. This article covers background, architecture, evaluation mechanism, technical implementation, application ethics, and future directions.

The popularity of large language models like ChatGPT and Claude has transformed education. Students can generate content quickly, and traditional plagiarism tools (e.g., Turnitin) fail on AI-generated "original" content. Banning AI tools is unrealistic; we need to distinguish reasonable use from improper reliance and assess work originality and thinking depth.

The system core includes three complementary modules:

1. Transformer Discriminative Model: Based on pre-trained models like RoBERTa/DeBERTa, it learns statistical differences between human and AI texts;
2. Stylometric Analysis: Extracts stylistic features such as vocabulary richness, sentence length variation, and function word patterns;
3. LLM Scoring Module: Uses prompts to guide LLMs to evaluate semantic content like logical coherence, viewpoint originality, and critical thinking.

The system outputs a multi-dimensional evaluation report:

• Originality Score: Assesses content originality and identifies excessive reliance on AI templates;
• Reasoning Depth: Analyzes argument complexity, multi-angle analysis, and evidence support;
• Comprehensive Academic Integrity Index: Probabilistic overall risk assessment (non-binary, context-dependent).

Engineering implementation uses:

• Ensemble Learning: Fuses three modules' outputs to reduce single-model bias;
• Adversarial Robustness: Data augmentation and adversarial training to counter paraphrasing tool attacks;
• Interpretable Output: Provides key evidence (e.g., highlighting suspected AI paragraphs);
• Continuous Learning: Incremental framework to adapt to new AI models.

Educational scenario applications:

• Process Assessment: Combines writing process data to distinguish AI-assisted ideation from direct copying;
• Personalized Feedback: Helps students improve writing;
• Teacher Assistance: Provides decision-making support, with final judgment by teachers. Ethical considerations: Transparency, avoiding group bias, data privacy, and appeal channels.

Limitations: Detection accuracy is not 100%, arms race with AI generation tech, over-reliance may deviate from education essence. Future directions: Update educational concepts (emphasize process evaluation), cultivate responsible AI use awareness, and build academic ecosystem via system, culture, and tech collaboration.