AI-Powered Automatic Scoring System for Handwritten Answer Sheets: Integrated Application of OCR, NLP, and Large Language Models

This project builds a full-stack web application that integrates OCR, NLP, and Large Language Model (LLM) technologies to achieve handwritten answer extraction, semantic correctness evaluation, automatic scoring, and AI feedback. It provides an automated and intelligent solution for the field of educational assessment, addressing issues such as low efficiency and strong subjectivity in traditional manual grading.

Traditional manual grading faces problems like low efficiency, strong subjectivity, and high costs. Especially in large-scale exams and daily homework correction, teachers are burdened heavily and scoring is prone to inconsistency. AI automated assessment is a potential solution, but the main challenges are handwritten content recognition (diverse styles, varying quality) and semantic understanding of subjective questions (beyond keyword matching capabilities).

The system adopts a full-stack architecture: the front-end provides a user-friendly interface for answer sheet upload and result viewing; the back-end handles core tasks such as OCR recognition, semantic analysis, and score calculation. The technology stack includes OCR (handwritten text conversion), NLP (preprocessing and semantic understanding), and LLM (answer evaluation and feedback generation). The multi-layer architecture ensures a complete process from image input to score output.

The OCR module faces challenges such as differences in handwriting styles and illegible writing. It uses deep learning models (CNN, RNN, Transformer) or mature APIs, combined with preprocessing like image enhancement and denoising to improve accuracy. The core innovation in semantic evaluation lies in the application of LLM: it evaluates the similarity between the answer and the standard answer through semantic understanding, identifies synonyms, equivalent expressions, and logical structures, rather than just keyword matching, generating scores closer to human judgment.

The system provides AI-generated personalized feedback, including the strengths of the answer, problems, gaps from the standard answer, and improvement suggestions, following educational psychology principles to ensure constructiveness. Application scenarios include: assisting manual grading in large-scale exams, quickly correcting homework in daily teaching, and handling large numbers of submissions on online education platforms, helping to reduce teachers' burden and enable students to improve their learning in real time.

The system's value lies in bringing automation and intelligence to educational assessment, reducing teachers' burden and providing students with instant feedback. However, there are limitations: OCR accuracy is affected by handwriting quality (e.g., illegible writing, complex formulas); LLM scoring may deviate from human judgment (especially for open-ended questions); attention needs to be paid to model fairness to avoid scoring biases against the language expressions of specific groups.

In the future, the architecture can be simplified by using multimodal LLM to directly process handwritten images; personalized learning feedback can be provided by combining students' historical performance; evaluation dimensions can be expanded to include thinking processes, error patterns, critical thinking, etc., transforming the system from a scoring tool into a comprehensive learning analysis platform.