When Do Neural Networks Outperform Kernel Methods?
Behrooz Ghorbani,Song Mei,Theodor Misiakiewicz,Andrea Montanari
We hypothesize that such a latent low-dimensional structure is present in image classification. We numerically test this hypothesis by showing that specific perturbations of the training distribution degrade the performances of RKHS methods much more significantly than NNs.
