P.R.I.S.M.: A 'Glass Box' Interpreter for Transparent AI Reasoning Processes

P.R.I.S.M. is an offline-first AI transparency interface designed for high-risk scenarios. As a diagnostic overlay for the Gemma 4 reasoning engine, it addresses the trust crisis of black-box AI through three core functions: visual reasoning chains, real-time fact verification, and uncertainty calibration. It allows users to 'see' the AI's thinking process and is suitable for high-risk fields such as medical triage and legal aid.

When large language models are deployed in high-risk fields like medical triage, legal aid, and financial consulting, opacity brings multiple risks: AI systems output assertive conclusions based on hidden probabilistic reasoning, leading users to overtrust wrong answers; they present hallucinated facts with full confidence, which may cause misdiagnosis or legal misguidance; generated statements lack source traceability, making auditing and verification impossible. In fields where lives and livelihoods are at stake, a confident AI system is not equivalent to a correct one.

1. Latent Reasoning Engine

Intercepts Gemma 4's <|channel>thought text blocks to visualize step-by-step reasoning and discarded hypotheses, including probability-weighted competing hypothesis branches, reasons for discarded paths, and complete logical flow (e.g., in medical scenarios, showing supporting/weakening points for hypotheses like myocardial ischemia or pulmonary embolism).

2. Source Anchoring Visualizer

Verifies each claim via a local RAG vector database: breaks down responses into factual statements → cross-references local storage → color-codes trust signals (🟢Verified / 🟡Inferred / 🔴Unverified).

3. Certainty Slider

Converts token-level logprobs from the Cactus Compute reasoning engine into visual signals (solid opaque text for high confidence, faded blurry text for low confidence), and ensures alignment between confidence and actual correctness via Brier score minimization and ECE calibration.

Technical Architecture

Four-layer design: Frontend (Next.js + Tailwind CSS) with multiplexed stream rendering; Backend (Python streaming server) parses reasoning blocks, tool calls, and logprobs; Reasoning engine (Cactus Compute) runs the Unsloth-fine-tuned Gemma 4 E4B model (ultra-low latency, 128K context, fully offline); Vector storage (local RAG database) for source verification.

Model Fine-Tuning

Uses Gemma 4 E4B (4.5 billion effective parameters), fine-tuned via Unsloth QLoRA (10GB VRAM, 60% memory reduction, 2x training speed), including four LoRA adapters: Calibration Adapter, Medical Triage Adapter, Legal Navigation Adapter, and Reasoning Structuring Adapter.

Medical Triage

Targeted at rural medical workers, community volunteers, and low-literacy patients, supporting image report understanding (uploading lab results/X-rays), voice interaction, transparent diagnostic reasoning, and offline operation.

Legal Aid

Targeted at marginalized communities, migrant workers, domestic violence survivors, etc., with features like privacy-first (local processing), citation support, confidence awareness, and multilingual support (140+ languages).

Deployment

Fully offline edge deployment: MacBook (Apple Silicon, 8GB RAM), Linux workstation (8GB RAM), Raspberry Pi/self-service terminal (E2B quantized version, 4GB RAM), with future mobile support.

Conclusion

P.R.I.S.M. firmly believes that AI transparency is a fundamental right. In high-risk fields, users have the right to know the AI's thinking process, uncertainties, and information sources. This is not only a functional innovation but also the foundation for responsible AI development.