Understanding Gradient Descent on the Edge of Stability in Deep Learning

作者: Sanjeev Arora, Zhiyuan Li, Abhishek Panigrahi

摘要

Deep learning experiments by \citet{cohen2021gradient} using deterministic Gradient Descent (GD) revealed an