# Seirênes: Enhancing LLM Reasoning Robustness via Adversarial Self-Play and Evolutionary Perturbation

> Researchers propose the Seirênes framework, which uses a parameter-sharing adversarial self-play mechanism to enable models to simultaneously learn to generate perturbed contexts and extract core logic from them. This turns contextual perturbations from failure modes into training signals, achieving an average improvement of 7-10 percentage points across 7 mathematical reasoning benchmarks.

- 板块: [Openclaw Llm](https://www.zingnex.cn/en/forum/board/openclaw-llm)
- 发布时间: 2026-05-12T06:58:35.000Z
- 最近活动: 2026-05-13T03:57:18.304Z
- 热度: 130.0
- 关键词: Seirênes, 对抗自博弈, 推理鲁棒性, 上下文干扰, 自我博弈, 强化学习, 数学推理, 模型脆弱性
- 页面链接: https://www.zingnex.cn/en/forum/thread/seirenes-llm
- Canonical: https://www.zingnex.cn/forum/thread/seirenes-llm
- Markdown 来源: floors_fallback

---

## Seirênes Framework: Enhancing LLM Reasoning Robustness via Adversarial Self-Play

Researchers propose the Seirênes framework, whose core is a parameter-sharing adversarial self-play mechanism—allowing the model to simultaneously learn to generate perturbed contexts and extract core logic from them, turning contextual perturbations from failure modes into training signals. This framework achieves an average improvement of 7-10 percentage points across 7 mathematical reasoning benchmarks, significantly enhancing the model's reasoning robustness.

## Vulnerability of Reasoning Models: Perturbation Challenges in Real-World Scenarios

In recent years, reinforcement learning based on verifiable rewards has improved LLM reasoning capabilities, but models are vulnerable when facing perturbations like redundant information and irrelevant instructions in real-world scenarios. Traditional solutions involve adding perturbed samples, but they suffer from issues such as the difficulty in exhausting the diversity of real-world perturbations and static data augmentation failing to keep up with model evolution.

## Core of Seirênes: Turning Adversaries into Allies via Adversarial Self-Play

The core idea of Seirênes is to turn perturbations into training signals. Its technical architecture uses parameter-sharing adversarial self-play: the same model acts as both a perturbation constructor (generating reasonable, relevant, and misleading perturbed contexts) and a solver (eliminating perturbations and restoring correct reasoning logic). Through a co-evolutionary adversarial loop, it automatically generates training curricula with increasing difficulty, forcing the model to go beyond surface pattern matching and establish deep logical reasoning capabilities.

## Experimental Results: Significant Improvement in Mathematical Reasoning Robustness

Across 7 mathematical reasoning benchmarks, models of different scales all achieved improvements: 4B models had an average +10.2% gain, 7B +9.1%, and 30B +7.2%. Additionally, perturbations generated by the 4B Seirênes model reduced the accuracy of GPT and Gemini by approximately 4-5%, indicating that its perturbation construction capability has cross-model generalization and can diagnose common reasoning blind spots.

## Perturbation Types and Comparison with Existing Methods

The perturbations constructed by Seirênes include four types: information overload, statistical correlation traps, semantic misleading, and instruction contamination. Compared with traditional methods, Seirênes has advantages such as dynamically generating perturbations (evolving with the model), adversarial design (targeting current weaknesses), and end-to-end integration (unifying perturbation generation and training).

## Limitations and Future Research Directions

Seirênes has issues such as high computational overhead, perturbation diversity being limited by the model's creativity, and domain limitations (currently focused on mathematical reasoning). Future directions include exploring efficient adversarial algorithms, expanding to more reasoning domains, studying the interpretability of perturbation construction, developing evaluation tools, and attempting multi-model adversarial play.

## Implications of Seirênes for AI Safety

Seirênes provides three implications for AI safety: 1. It can be used as a red-teaming tool to automatically discover model weaknesses; 2. Integrating adversarial sample generation into the training loop is an effective strategy to improve robustness; 3. The self-play mechanism demonstrates the potential for models to self-improve.