New Breakthrough in Affective Music Recommendation: Offline Preference Optimization System Based on World Models

The LUCID team has launched the AMRS Affective Music Recommendation System, which constructs a world model using causal Transformers. It achieves offline policy optimization under ethical constraints that prohibit online experiments, providing emotion state-driven music recommendations for clinical users (elderly individuals with neurocognitive disorders) and wellness scenarios (energize, focus, calm, sleep modes). This system addresses the core conflict between emotional regulation goals and online experiment ethics in functional music scenarios.

Traditional music recommendation systems often optimize for metrics like click-through rates and play duration, but functional scenarios (e.g., clinical interventions, sleep aid and relaxation) require emotional state (valence, arousal) regulation as the standard. However, conducting direct online emotional experiments on users—especially clinical populations who cannot reliably express discomfort—poses ethical issues, making traditional A/B testing methods ineffective here.

AMRS is deployed on the LUCID Health and Wellness Platform. Its core is a rollout-based causal Transformer world model that can predict signals in four dimensions: engagement, binary ratings, valence, and arousal. It serves both as an offline policy training simulator and a stress testing tool. The training process has two phases: first, initialize the policy via behavior cloning, then fine-tune using Direct Preference Optimization (DPO). DPO does not require a separate reward model and can be configured with multi-objective utility functions (e.g., clinical scenarios prioritize emotional regulation accuracy, while consumer scenarios balance diversity).

Under the cold-start protocol, the world model's prediction fidelity for behavioral and emotional signals is usable. The DPO-fine-tuned policy outperforms the behavior cloning baseline in valence and arousal prediction while maintaining a similar diversity distribution, avoiding the distribution collapse problem caused by greedy optimization.

This work validates the methodology of building reliable recommendation systems using world models + offline optimization under ethical constraints. It is one of the first practices applying world models to affective recommendation and deploying them in clinical scenarios, providing reference for sensitive scenarios like mental health and medical advice. It also demonstrates DPO's simplicity, stability, and diversity preservation capabilities in offline multi-objective optimization.

Current limitations: The world model's prediction ability is limited by the distribution of training data, leading to decreased fidelity for music or user groups outside the training set; obtaining emotional labels is challenging, and self-reports have noise and bias. Future directions: Expand the world model to finer-grained emotional dimensions, explore efficient exploration strategies to collect high-quality data, and promote to other recommendation scenarios constrained by ethics.

AMRS represents an important methodological exploration in the field of recommendation systems. It proves that effective emotion-driven systems can be built via world models and offline optimization under ethical constraints, providing practitioners focused on AI ethics and recommendation frontiers with a paradigm that combines technical innovation and social responsibility.