Complexity of neural networks
MATHEMATICAL PICTURE LANGUAGE
Kaifeng Bu - Harvard University and Tsinghua University
One of the central problems in the study of deep learning theory is to understand complexity of the neural networks. In this talk, we will introduce the topological entropy from dynamic system as a measure of complexity of neural networks. We will also discuss the depth-width trade-offs of neural networks via topological entropy.