Reading
This is an intelligent interaction system developed based on the SoftBank NAO humanoid robot platform, integrating computer vision, speech recognition, and the ChatGPT large language model. It realizes three core functions: face recognition, natural dialogue, and autonomous dancing, with behavior control implemented using a Finite State Machine (FSM) architecture.
Section 01
This project is an intelligent interaction system developed based on the SoftBank NAO humanoid robot platform, integrating computer vision, speech recognition, and the ChatGPT large language model. It realizes three core functions: face recognition, natural dialogue, and autonomous dancing, with behavior control using a Finite State Machine (FSM) architecture. It is a graduation design practice on multimodal human-robot interaction.
Section 02
In the field of human-robot interaction, traditional rule-based or pre-scripted interaction methods are rigid and lack flexibility. With the maturity of large language models (LLMs), embedding AI dialogue capabilities into physical robots has become possible. NAO is a classic humanoid robot platform developed by SoftBank Robotics, equipped with rich sensors, flexible movement capabilities, and a mature development framework. As a graduation design, this project explores combining ChatGPT's intelligent dialogue capabilities with NAO's physical interaction capabilities to create a robot system with social attributes.
Section 03
Adopting a Finite State Machine (FSM) architecture, three core behavior states are defined:
Advantages: Clear state boundaries, simple transition logic, easy to debug and extend; Trigger events include voice commands (Hey NAO/Dance NAO, etc.), face recognition events, and audio detection.
Section 04
Section 05
Development team division:
Team members: David Shi, Ousama Alabdullah, Humaira Saddat
Section 06
Limitations of the system and improvement suggestions:
Section 07
This project is an excellent graduation design work, demonstrating the combination of cutting-edge AI technology and a mature robot platform. It realizes the orderly coordination of three functions through the FSM architecture, providing a reference example for robot development and human-robot interaction learning.
Keep going with more reads from the same topic.
Nornir MCP Server is an enterprise-level server based on the Model Context Protocol (MCP). It seamlessly integrates large language models (such as Claude) with the Nornir network automation framework, supporting natural language orchestration for multi-vendor network devices (Cisco, Arista, Juniper, etc.), and providing production-grade features like a dual-engine architecture (NAPALM + Netmiko), intelligent filtering, and a secure sandbox.
Bibliothèque Française LLM is a structured indexing and annotation project for French public domain literature designed specifically for large language models (LLMs). It integrates multiple authoritative sources such as DraCor, Common Corpus, and Wikisource, providing metadata indexing categorized by genre, author, and era, as well as in-depth annotations for dramatic texts (including characters, lines, stage directions, etc.). Its aim is to enable LLMs to efficiently read and understand classic French literary works.
Splinter is a minimalist, high-performance key-value (KV) and vector storage system enabling zero-latency inter-process communication via shared memory and atomic operations. With only 766 lines of core code, it supports millions of operations per second and 768-dimensional vector storage, offering a new architectural approach for local LLM inference and data-intensive applications.
Folkering OS is the world's first AI-native bare-metal operating system, entirely written in Rust no_std without relying on Linux, POSIX, or libc. It can generate commands from scratch, compile them into WASM, and run them in 10 seconds, achieving true self-evolution.