GlassArc: A Local AI Assistant with Zero API Keys, Integrating LLM and Real-Time Web Search

GlassArc is a single-file, self-contained local AI assistant that can run large language models (LLMs) without API keys. It integrates real-time searches from DuckDuckGo and Google, and supports both terminal and web modes. Its core selling points include privacy protection, zero cost, and low deployment barriers, making it suitable for users concerned about data security, restricted network access, or cost sensitivity. The project is open-source, maintained by Hukam512, and hosted on GitHub.

Amid the trend of AI tools relying on cloud APIs and subscription services, GlassArc provides an alternative for local operation. It integrates LLM and real-time search into a single file, eliminating the need for API keys and lowering deployment barriers. It has practical value for users with privacy concerns, cost control needs, or offline requirements. The core design concepts are single-file deployment, zero API keys, local LLM support, and built-in search.

1. Local AI Conversation: Uses llama-cpp-python to load GGUF models (default Qwen2.5-3B), with an 8192-token context window, and automatically splits and summarizes ultra-long inputs;
2. Real-Time Search: Zero API keys, parallel crawling from DuckDuckGo/Google, with optimization strategies (UA rotation, delay, content extraction, deduplication);
3. Dual-Mode Interaction: Terminal mode (command line) and web mode (Flask framework, stable with no restart issues);
4. Intelligent Model Management: Automatically selects models based on resources (Qwen2.5-3B requires 4GB memory; otherwise, TinyLlama is used).

1. Data Integrity: Calculates CRC32 checksum for generated content;
2. Logging System: glassarc_trace.log records key operations, slow_ops.log records operations exceeding 60 seconds;
3. Prompt Optimization: Qwen series uses ChatML templates to distinguish roles, improving output quality.

Environment Preparation: Install dependencies (llama-cpp-python, requests, beautifulsoup4, trafilatura, fake-useragent, flask); Model Download: Download the Qwen2.5-3B-Instruct-GGUF model via huggingface_hub to the models directory; Startup Methods: Terminal mode (python glassarc_safe.py), web mode (add --web parameter); Common Commands: /web to trigger search, exit to end the session.

Suitable for privacy-sensitive environments (local computing with no data transmitted externally), network-restricted regions (no API regional restrictions), cost-sensitive users (free and open-source), offline/intranet environments (AI conversation available offline), and rapid prototype verification (single-file deployment).

Search relies on web scraping, which may be restricted by anti-crawling measures; Local model performance is affected by hardware, and complex tasks are not as good as cloud-based ones; The web interface uses port 5000 by default; please note port conflicts.

GlassArc returns to the essence of AI tools, lowering the threshold of use and dependency complexity, making it suitable for users with autonomous control needs. The project is open-source under the MIT license, and models follow their original licenses. Thanks to the support of open-source projects like llama.cpp and llama-cpp-python; its single-file architecture and zero-API design reflect in-depth thinking about practicality and user experience.