Mnemos: An AI Second Brain Based on Gemini 3 Multi-Agent Architecture

Mnemos is a desktop AI knowledge management platform. Built on Gemini 3's multimodal capabilities and eight specialized agents, it can automatically convert fragmented information such as screenshots, voice, and text into structured knowledge and actionable tasks, bridging the gap from passive storage to active assistance, and aiming to close the divide between information consumption and meaningful action.

A large amount of fragmented information we capture daily (such as screenshots, papers, recruitment information) is often put aside due to shifting work priorities, scattered across various tools without synergy. The core problem is not a lack of information, but the gap between information consumption and action. Mnemos was born in February 2026 at the Google Gemini Hackathon to address this pain point.

Multi-Agent Architecture: Contains eight Gemini 3-driven agents including perception, classification, orchestration, research, proactive, resource discovery, and email intelligence. Divided into core processing layers and extension layers, they communicate via an event bus and use off-peak calls to avoid API limitations.

Three-Layer Classification Framework: Life domains (12 categories), context types (19 types), and intents (14 action types). Their combination enables precise understanding of information and action triggering (e.g., automatically creating a calendar event from a meeting screenshot).

Frontend: Electron.js (cross-platform desktop support); Backend: Python + FastAPI (API gateway, request routing); AI Capabilities: Vertex AI to access Gemini 3, text-embedding-004 for generating embeddings, Vertex AI Search for semantic retrieval; Storage: GCS (files), Firestore (metadata), Vertex AI Search (indexes); Deployment: GCP Cloud Run containerized stateless services with auto-scaling; Security: Google OAuth authentication, least-privilege IAM roles.

Challenges: Timing and restrained design when transitioning from a reactive to a proactive system; Extracting multiple discrete actions from a single capture; Accuracy of multimodal processing for unstructured screenshots; Balancing low-latency synchronous feedback and deep asynchronous processing.

Learnings: Intelligence must integrate timing, context, and restraint; An excellent AI system should enhance human capabilities without diverting attention.

Mnemos represents a new direction in AI personal knowledge management, shifting from a passive repository to an active assistant. Short-term goals: cross-device synchronization, integration with tools like Slack/Notion, personalized prioritization, native macOS app; Long-term vision: predictive proactive intelligence, team collaboration, enterprise-level security, mobile applications. For developers, its multi-agent design, event-driven architecture, and three-layer classification framework are of reference value.