Essays about: "L2 regularization strength"
Found 3 essays containing the words L2 regularization strength.
-
1. Investigating Relations between Regularization and Weight Initialization in Artificial Neural Networks
University essay from Lunds universitet/Beräkningsbiologi och biologisk fysik - Genomgår omorganisationAbstract : L2 regularization is a common method used to prevent overtraining in artificial neural networks. However, an issue with this method is that the regularization strength has to be properly adjusted for it to work as intended. This value is usually found by trial and error which can take some time, especially for larger networks. READ MORE
-
2. Optimizing L2-regularization for Binary Classification Tasks
University essay from Lunds universitet/Beräkningsbiologi och biologisk fysik - Genomgår omorganisationAbstract : An Artificial Neural Network (ANN) is a type of machine learning algorithm with widespread usage. When training an ANN, there is a risk that it gets overtrained and cannot solve the task for new data. Methods to prevent this, such as L2-regularization, introduce hyperparameters that are time-consuming to optimize. READ MORE
-
3. Prediction of appropriate L2 regularization strengths through Bayesian formalism
University essay from Lunds universitet/Beräkningsbiologi och biologisk fysik - Genomgår omorganisation; Lunds universitet/Institutionen för astronomi och teoretisk fysik - Genomgår omorganisationAbstract : This paper proposes and investigates a Bayesian relation between optimal L2 regularization strengths and the number of training patterns and hidden nodes used for an artificial neural network. The results support the proposed dependence for number of training patterns, while the dependence on hidden architecture was less clear. READ MORE