Reviser: A New Paradigm for Non-Autoregressive Text Generation via Cursor Editing Actions

Introduction / Main Floor: Reviser: A New Paradigm for Non-Autoregressive Text Generation via Cursor Editing Actions

Reviser proposes a revolutionary text generation method that abandons the traditional left-to-right token generation approach. Instead, it uses a cursor to perform operations like insertion, movement, and stopping on an editable canvas to construct text. This edit-action-based generation paradigm significantly outperforms diffusion baseline models such as SEDD and MDLM at the 300M parameter scale.