Research

• Sep 2025 · NeurIPS 2025 On the Convergence Properties of Stochastic Gradient Descent with Adaptive Momentum

  We analyze the convergence behaviour of SGD variants equipped with adaptive momentum terms, establishing tight upper bounds under non-convex smooth objectives.