Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers

Abstract

The fundamental learning theory behind neural networks remains largely open. What classes of functions can neural networks actually learn? Why doesn't the trained network overfit when it is overparameterized?