Harmonics of learning: a mathematical theory for the emergence of Fourier features in learning systems such as neural networks
Artificial neural networks (ANNs) show a notable pattern when trained on natural data, regardless of the exact initialization, data set, ...