Ghost Writer: An Open-source Editor Integrating Local Large Language Models into Writing Workflows

Ghost Writer is an open-source, local-first Markdown editor built with Tauri and Rust. It integrates local large language models via Ollama to provide AI-assisted writing features like streaming generation, placeholder workflow, and theme switching. The tool prioritizes privacy (all data stored locally) and a distraction-free environment, making it ideal for creators working on deep-thinking tasks.

Most AI writing tools are either cloud-dependent or bloated. Ghost Writer was designed with the core philosophy of 'focus on writing':

• Local-first: All data stored locally, no privacy leaks or network dependency.
• Distraction-free interface: Minimal visual noise to keep creators focused.
• AI as assistant: Supports rather than replaces creators. It suits long articles, academic papers, novels, etc., requiring deep thinking.

Ghost Writer uses modern tech stack:

• Tauri: Cross-platform desktop framework (Rust) with smaller size and better performance than Electron.
• Ollama Integration: Communicates via HTTP (default http://127.0.0.1:11434), auto-detects local models, auto-starts Ollama if needed, and provides model selector.
• Frontend: Node.js-based, uses Noto fonts, supports light/dark themes, and safe Markdown rendering.

AI-assisted Writing

• Selective insert: Replaces selected text or inserts at cursor.
• Placeholder workflow: Uses {{...}} syntax for AI generation.
• Streaming generation: Real-time output with stop/undo/redo controls.

Markdown Editing

• Real-time preview (Ctrl/Cmd+M), full shortcut support (bold, italic, save, etc.).

File Management

• Save/load .md files, copy content, print/export to PDF.

Interface Customization

• Light/dark theme switch, window pinning, responsive toolbar.

Ghost Writer is ideal for:

• Academic writing: Privacy for sensitive data, AI for polishing or background info.
• Creative writing: Placeholder workflow for scenes/dialogues.
• Technical docs: AI for code explanations or API drafts.
• Privacy-sensitive users: Local models ensure content never leaves the device.

Environment Requirements

Node.js 20.19+/22.12+, npm, Ollama (with at least one model), Rust toolchain.

Quick Start

• Web dev: cd src/ghost-writer-editor && npm ci && npm run dev (visit http://localhost:5174).
• Desktop dev: npm run dev:tauri.
• Build: npm run build:tauri (or platform-specific commands).

Model Config

Pull a model (e.g., ollama pull llama3.1:8b), list models (ollama list), then select in Ghost Writer.

• Automated Release: GitHub Actions trigger builds on v* tags, generating multi-platform packages (Windows .exe, macOS .dmg).
• Documentation: Includes local model guides, print/PDF export notes, and stability instructions.

Ghost Writer returns to focused writing, using local AI as an assistant rather than a replacement. It’s perfect for privacy-focused, efficiency-seeking creators. As local LLMs advance, tools integrating AI into traditional workflows will grow in popularity.