GYRO Optimizer: Injecting 'Gyroscopic Stability' Mechanism into Adam via Geometric Projection

Introduction / Main Floor: GYRO Optimizer: Injecting 'Gyroscopic Stability' Mechanism into Adam via Geometric Projection

GYRO is a new deep learning optimizer that effectively suppresses gradient oscillation in high-dimensional optimization by introducing a geometric projection step before Adam's gradient update. It maintains the same computational complexity as Adam while improving training stability.