WONN: A New Oscillatory Neural Network Architecture Based on Winfree Synchronization Dynamics

WONN is a brand-new neural network architecture that introduces Winfree oscillatory synchronization dynamics into deep learning. It performs computation through the collective evolution and synchronization of phase oscillators in a circular phase space, opening up a new bio-inspired path for neural network design. This article will discuss it from aspects such as background, architecture design, experimental verification, implementation details, and future prospects.

The deep learning field has long been dominated by static feature transformation architectures (e.g., CNN, Transformer), while biological neural computing often completes information processing through rhythmic oscillation and synchronization of neurons. The Winfree model was proposed by Arthur Winfree in 1967 to describe the synchronization phenomenon of biochemical oscillators. Its core is that coupled oscillators adjust their phases through interaction to achieve synchronization, a principle widely present in nature (e.g., firefly flashing, coordination of cardiac pacemaker cells). WONN extends this model to neural networks, evolving neural representations in the circular phase space $(S^1)^d$, where each neuron's state is a phase angle, and information processing is essentially a dynamic synchronization process.

WONN has three core innovations: 1. Flexible interaction parameterization (learnable coupling strength and patterns to adapt to complex high-dimensional data); 2. Hierarchical grouped synchronization dynamics (oscillators are grouped, with intra-group synchronization and inter-group phase relationships maintained, simulating brain functional partitioning); 3. Phase-frequency dual-state design (phase captures activation patterns, frequency determines evolution speed, enhancing expressive ability). Its working mechanism includes: initialization (input encoded into initial phase), dynamic evolution (multi-step discrete Winfree iteration to update phase), readout conversion (phase mapped to task output), and inter-layer transfer (output of the previous layer is reparameterized as the initial state of the next layer).

WONN has demonstrated applicability in multiple tasks: 1. Image recognition: Competes with mainstream architectures on benchmark tests such as CIFAR-10/100 and ImageNet-100/1K; 2. Maze-Hard path planning: Evaluates paths through an energy voting mechanism, showing potential for combinatorial optimization; 3. Sudoku logical reasoning: Converges to constraint-satisfying solutions via cyclic Winfree dynamics, demonstrating the ability to coordinate multiple variables.

WONN is implemented based on PyTorch, with core modules including: wlayer.py (core logic of Winfree layer), wnet.py (assembles the complete model), and modules.py (shared modules such as attention and phase embedding). Training features support distributed data parallelism (DDP), exponential moving average (EMA), torch.compile acceleration, and log tool integration. Key hyperparameters include the number of channels (CH), number of dynamic steps (T), and number of groups (G).

Significance of WONN: Theoretically, it provides a new perspective on the essence of neural computing, proving that dynamic computing based on synchronous oscillation can construct effective deep learning architectures; Practically, it is suitable for rhythmic, periodic, or time-series tasks, providing tools for robustness and interpretability research. Future directions: Explore complex network topologies and coupling patterns, study time-series prediction/sequence modeling performance, combine with architectures like Transformer, and develop dedicated hardware acceleration solutions.