Expressive Power

Why Robust Generalization in Deep Learning is Difficult: Perspective of Expressive Power
We provide theoretical evidence that the hardness of robust generalization may stem from the expressive power of deep neural networks. Even when standard generalization is easy, robust generalization provably requires the size of DNNs to be exponentially large.
Binghui Li, Jikai Jin, Han Zhong, John E. Hopcroft, Liwei Wang
PDF Cite ArXiv
Why Robust Generalization in Deep Learning is Difficult: Perspective of Expressive Power