Therapeutic Sonic Interaction Design Framework: A Systematic Methodology from Sonification of Movement to Clinical Application

This article proposes a therapeutic sonic interaction design framework for motor rehabilitation, which uses movement sonification technology to convert body movements into real-time auditory feedback. The framework includes three core contributions: 1) Conceptual reconstruction (calibrating sound variability to match listeners' perceptual abilities and clinical needs); 2) A design platform (structured architecture drawing on mixing workflows); 3) A user-centered development approach (integrating medical intervention science). The article demonstrates applications using the HearWalk gait rehabilitation system as an example and discusses the role and boundaries of AI in design.

Traditional rehabilitation relies on visual feedback and verbal guidance, which has limitations such as insufficient real-time perception and difficulty in multi-dimensional monitoring. Movement sonification technology converts body movements into auditory feedback to help patients perceive their movement status, but it has not been systematically integrated into clinical practice due to the lack of standardized methodologies and the failure to incorporate clinical perspectives.

The three core contributions of the framework are: 1. Conceptual reconstruction: Defining the design task as calibrating sound variability (parameters such as pitch and loudness) to match listeners' perceptual abilities and clinical needs; 2. Design platform: Drawing on mixing workflows, it is divided into input layer (sensor data), mapping layer (mapping of movement features to sound parameters), synthesis layer (sound generation), mixing layer (effect processing), and output layer (sound output), supporting rapid iteration; 3. User-centered approach: Through four stages—demand mining, prototype iteration, clinical validation, and scaling preparation—it deeply integrates the perspectives of clinical stakeholders.

The HearWalk gait rehabilitation system is an application case of the framework, targeting gait problems in hemiplegic patients. The design mapping strategy is as follows: pitch corresponds to the step length of the affected side, rhythm corresponds to step frequency, and spatial positioning corresponds to center of gravity transfer. During development, the design platform was used to quickly iterate mapping parameters, and validation through user-centered methods (doctor evaluation, patient trials, clinical pilots) improved gait symmetry.

AI can assist in literature reviews, mapping strategy generation, sound design description, user feedback analysis, and document generation; however, perceptual judgment (whether the sound is intuitive and pleasant), clinical context understanding, ethical value judgment, and creative design still require human leadership, and AI is positioned as a design assistant.

The framework provides a systematic methodology for therapeutic sonic interaction design, and the HearWalk case proves its feasibility. In the future, it is necessary to combine AI assistance, focus on user needs, and promote the application of technology in the rehabilitation field. Design philosophy: Technology serves people and is rooted in real needs.