MAGI：可运行在消费级硬件上的开源大语言模型AI系统

MAGI is an open-source AI system inspired by Neon Genesis Evangelion, designed to run on consumer hardware with full-featured AI assistant capabilities. Key features include: customizable core reasoning protocol, modular toolchain (code execution, web browsing, image generation), long-term memory Codex, multi-agent NERV mode, and Telegram remote operation. Project repo: Kenshiro-28/MAGI. It prioritizes localization, privacy, and user customization over cloud-based services.

MAGI's name comes from Neon Genesis Evangelion, aiming to make functional AI assistants accessible on consumer hardware. Unlike cloud-based commercial AI services (e.g., ChatGPT), its core design principles are localization (run on local laptops/desktops), customizability (tailor推理 protocols and behavior), and modularity (extend via plugins). It supports Debian stable natively and other OS via Docker, ensuring cross-platform use without expensive GPU servers or cloud subscriptions, keeping data private locally.

Customizable Core Protocol

MAGI's Core Protocol allows defining structured推理 frameworks (default has 5 stages: Foundational Deconstruction → Hypothesis Generation & Inversion → Multi-Method Derivation & Triangulation → Epistemic Rigor Loop → Metacognitive Consolidation). Users can customize to variants like Chain-of-Thought.

Modular Toolchain

Plugins include:

• Code Runner: Generates/executes Python code in isolated environments (with Ruff check, 30min timeout, 10 rounds of optimization).
• Web Plugin: Real-time internet access for up-to-date info.
• Image Generation: Uses SDXL for visual outputs.

Long-Term Memory (Codex)

Stores cross-session knowledge (code snippets, solutions) in codex.json, using semantic embedding retrieval (not keyword-based).

Running Modes

4 modes: Chat (default), Action (uses mission_data.txt), NERV (multi-agent:1 Captain +3 Soldiers), Autonomous (runs until task completion with prime_directives.txt).

Configuration via config.cfg

Key options:

• TEMPERATURE:0.6 (model creativity)
• CONTEXT_SIZE:65536 tokens
• HEARTBEAT_SECONDS:1800 (30min idle before background thinking)
• Plugins toggle (code runner, Codex, image generation, Telegram, web)

Prime Directives

prime_directives.txt defines system prompts, personality (friendly/professional), rules, and ethics to shape MAGI's behavior.

Heartbeat Mechanism

After idle time, MAGI initiates background thinking to decide task continuation,主动 dialogue, or silence—adding主动性 beyond passive Q&A.

Security

• Code execution: Isolated virtual environments,30min timeout, Ruff static check.
• Note: File system not fully sandboxed—users should run in trusted environments, backup data, and review code.

Application Scenarios

• Personal AI assistant (email, code help, info query).
• Local knowledge base (Codex for team/personal knowledge management).
• Automation (autonomous mode for long-running tasks like research/monitoring).
• Multi-agent experiments (NERV mode).
• Offline use (enterprise intranets without internet access).

Comparison Table

Feature	MAGI	ChatGPT	Ollama + Frontend
Local Run	✅	❌	✅
Code Execution	✅	✅	Need config
Long-Term Memory	✅	❌	Need config
Customizable推理	✅	❌	❌
Multi-agent	✅	❌	❌
Image Generation	✅	✅	Need config
Web Browsing	✅	✅	Need config

Limitations

• Hardware: Requires16GB+ RAM, good CPU/GPU, storage for large models.
• Model Gap: Local open-source models lag behind GPT-4 in complex reasoning/knowledge.
• Configuration Complexity: Needs technical background for setup/tuning.

MAGI is an innovative open-source AI system that brings powerful, customizable AI to consumer hardware. Its strengths lie in开箱即用 full features and deep customizability, ideal for tech users valuing privacy, offline use, or AI behavior control. It contributes to AI democratization—making advanced AI accessible to individual developers/researchers, not just big corporations. For users needing local, privacy-focused AI, MAGI is a promising project to watch.