Random matrix theory in machine learning

Abstract: In this thesis, we review some applications of random matrix theory in machine learning and theoretical deep learning. More specifically, we review data modelling in the regime of numerous and large dimensional data, a method for estimating covariance matrix distances in the aforementioned regime, as well as an asymptotic analysis of a simple neural network model in the limit where the number of neurons is large and the data is both numerous and large dimensional. We also review some recent research where random matrix models and methods have been applied to Hessian matrices of neural networks with interesting results. As becomes apparent, random matrix theory is a useful tool for various machine learning applications and it is a fruitful field of mathematics toexplore, in particular, in the context of theoretical deep learning.