Advanced search

Found 1 essay matching the above criteria.

1. 1. Investigating Relations between Regularization and Weight Initialization in Artificial Neural Networks

   University essay from Lunds universitet/Beräkningsbiologi och biologisk fysik - Genomgår omorganisation

   Author : Rasmus Sjöö; [2022]
   Keywords : Artificial Neural Networks; L1 Regularization; L2 Regularization; Loss Function; Maximum Likelihood; Regularization Strength Synthetic Data Generation; Weight Initialization; Physics and Astronomy;

   Abstract : L2 regularization is a common method used to prevent overtraining in artificial neural networks. However, an issue with this method is that the regularization strength has to be properly adjusted for it to work as intended. This value is usually found by trial and error which can take some time, especially for larger networks. READ MORE