Multi-scale Feature Learning Dynamics: Insights for Double Descent

摘要

An intriguing phenomenon that arises from the high-dimensional learning dynamics of neural networks is the phenomenon of “double descent”. The more commonly studied aspect of this phenomenon corresponds to