Shrimp and Crab Congee: Practical Exploration of Enterprise-level Context Engineering

Shrimp and Crab Congee is an open-source AI project initiated from personal interest, focusing on building enterprise-level context engineering systems. It aims to fill the gap in context management in current LLM applications and unlock the task-completion potential of large language models. The project adopts a modular architecture, providing flexible and scalable solutions. It offers practical values such as enhancing model understanding capabilities, reducing development complexity, and ensuring data security and compliance. It can be applied to multiple scenarios like intelligent customer service and enterprise knowledge assistants, and continues to develop as an open-source project.

The name of the open-source project "Shrimp and Crab Congee" (Xiā Xiè Zhōu) comes from a classic dish in southern China, symbolizing the integration of various ingredients through slow cooking. Founder Philip built this project out of personal interest, focusing on enterprise-level context engineering. In the era of booming LLM development, many projects stay at the level of simple API calls and ignore the key link of context engineering. The birth of Shrimp and Crab Congee is precisely to fill this gap.

Context engineering is an engineering discipline focused on optimizing and managing the input context of LLMs. Unlike prompt engineering, which focuses on optimizing single queries, it aims to build a complete and sustainable enterprise-level context management system. Core dimensions include: historical session management (maintaining coherence in multi-turn conversations), knowledge base integration (combining external information such as enterprise private knowledge), task state tracking (maintaining consistent state in complex tasks), and personalized adaptation (dynamically adjusting context strategies).

Shrimp and Crab Congee adopts a modular architecture with the core concept of "layered decoupling". It includes: 1. Context storage layer: supports in-memory cache (high frequency, low latency), Redis cluster (distributed sharing), vector database (semantic retrieval); 2. Context processing engine: intelligent truncation strategy (retaining key information within limited tokens), automatic summarization function (simplifying long sessions); 3. Plug-in extension framework: allows developers to write plugins to expand context sources (such as CRM, knowledge bases, etc.) and enhance applicable scenarios.

Shrimp and Crab Congee provides an implementable context engineering methodology for enterprise-level AI applications: 1. Enhancing model understanding capabilities: For example, in customer service scenarios, associating user historical work orders and other information to make answers more accurate and personalized; 2. Reducing development complexity: A unified abstraction layer allows developers to focus on business logic without worrying about underlying context processing; 3. Ensuring data security and compliance: Supports encrypted storage, access control, audit logs, desensitization of sensitive information, and meets requirements such as GDPR.

The context engineering capabilities of Shrimp and Crab Congee can be applied to multiple fields: 1. Intelligent customer service systems: Maintain customer profiles across sessions and seamlessly transfer context; 2. Enterprise knowledge assistants: Integrate multi-source information such as internal documents and automatically associate background knowledge; 3. Code-assisted development: Maintain project-level code context and understand codebase architecture; 4. Data analysis and decision support: Incorporate historical analysis results to assist comprehensive judgment.

Shrimp and Crab Congee is an open-source project in a stage of rapid development, and community contributions are welcome. The future roadmap includes: supporting more LLM providers (OpenAI, Anthropic, local models, etc.), improving the visual monitoring and management interface, establishing best practice documents and example libraries, and exploring deep integration with Agent frameworks.

Shrimp and Crab Congee demonstrates the importance of context engineering in enterprise-level AI applications. It is not only a technical tool but also a reflection of engineering thinking—building a sustainable, maintainable, and scalable context management system. It provides a reference path for enterprise AI implementation teams, and excellent context engineering requires continuous refinement and optimization.