MyTwinAgent: AI Coworker Development Kit for Boston Tech Week 2026 Hackathon

MyTwinAgent is an open-source project released by DivyaPrakash04 on GitHub (original project name: MyTwinAgent-rasa-bos-hackathon-2026, release date: 2026-05-30), serving as the official starter kit and event hub for the Boston Tech Week 2026 Hackathon. Built on the Rasa framework, this project integrates Speechmatics (speech recognition), Rime (speech synthesis), Nebius large language model inference, and cross-session memory capabilities, providing developers with a complete tech stack for building intelligent office assistants and supporting deep integration with external tools.

The concept of an "Always-On AI Coworker" is moving from science fiction to reality. The Boston Tech Week 2026 Hackathon focuses on technical competition around building practical AI coworkers, and MyTwinAgent serves as the official starter kit providing a fully functional, clearly structured open-source foundation. Unlike simple chatbots or voice assistants, an AI coworker needs to have continuous work capabilities, context understanding, historical conversation memory, and natural voice communication skills—MyTwinAgent demonstrates a feasible path to realizing this vision.

1. Rasa Framework: As the core dialogue framework, it uses Transformer-based NLU and dialogue management models, supporting complex multi-turn conversations with modular scalability;
2. Voice Interaction: Integrates Speechmatics (speech recognition, supporting multiple languages/accents and noisy environments) and Rime (high-quality TTS with natural expressiveness);
3. LLM Inference: Uses Nebius LLM services, supporting multiple open-source model options for flexible expansion;
4. Cross-Session Memory: Persistently stores user profiles and historical conversation summaries to achieve long-term memory;
5. Expansion Capabilities: Supports external tool integration via ReAct sub-agents (inference + action) and MCP protocol.

• The Rasa framework has been production-tested, and its decoupled architecture (NLU + dialogue management) ensures intelligent interaction;
• Speechmatics maintains high recognition accuracy in noisy office environments;
• Rime's neural network TTS solves the problem of traditional mechanical voices;
• The Nebius platform supports flexible model selection and seamless expansion, reducing operation and maintenance costs;
• Cross-session memory involves storage/update/retrieval strategies that balance efficiency and capacity;
• ReAct enables AI to perform external operations, while MCP implements standardized tool communication.

• Meeting Assistant: Listens to meetings, records key points, identifies action items, and follows up;
• Customer Service: Handles common inquiries, assists with form filling, and transfers complex issues;
• Knowledge Worker Assistant: Manages schedules, filters emails, finds documents, and drafts replies;
• Team Collaboration Coordinator: Tracks task progress, reminds of deadlines, and summarizes status reports.

• Latency Issue: Reduces response latency through streaming processing (recognizing while speaking) and parallelization optimization;
• Error Handling: The dialogue management module includes rich degradation logic to maintain a good user experience when speech recognition errors occur, LLM responses are inappropriate, or external services are unavailable.

MyTwinAgent is an important milestone in the development of AI coworker technology, proving that integrating mature technologies can build feature-rich intelligent office assistants. The open-source collaboration model allows developers to focus on innovation and avoid reinventing the wheel. In the future, AI coworkers will move from proof of concept to enterprise applications, and developers participating in such projects can learn cutting-edge technologies and contribute to future human-machine collaboration.