Essays about: "Weight Decay"

Showing result 1 - 5 of 12 essays containing the words Weight Decay.

  1. 1. The Impact of Deep Neural Network Pruning on the Hyperparameter Performance Space: An Empirical Study

    University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

    Author : Jonna Matthiesen; [2023-10-24]
    Keywords : Compression; Deep Learning; DNN; Hyperparameters; Optimization; Pruning; Hyperparameter Optimisation; Hyperparameter Tuning;

    Abstract : With the continued growth of deep learning models in terms of size and computational requirements, the need for efficient models for deployment on resource-constrained devices becomes crucial. Structured pruning has emerged as a proven method to speed up models and reduce computational requirements. READ MORE

  3. 2. Uptake and retainment of radionuclides in edible mushrooms – from fruiting to cooking

    University essay from

    Author : Delshad Mansour Ayoubi; [2022-12-06]
    Keywords : Medical physics; Activity concentration; Transfer coefficient; Dose;

    Abstract : Purpose: The purpose of this study was to study the uptake, distribution and transfer of Mn-54, Zn-65, U-238, U-235, U-234, and Po-210 in mushrooms and their respective caps and stalks, the effects of chelates and ligands, and the potential release of radionuclides during a cooking procedure. Introduction: Fungi are organisms that are composed of a fruiting body (mushroom) and tubular hyphae, that branches out into complex networks called mycelium. READ MORE

  4. 3. Prolongation of shelf life of minimally processed spinach by combining vacuum impregnation and electric field treatments

    University essay from Lunds universitet/Livsmedelsteknik och nutrition (master)

    Author : Sophia Leffler; [2022]
    Keywords : spinach; pulsed electric field; moderate electric field; reversible electroporation; vacuum impregnation; shelf life; metabolic activity; respiration; food engineering; Agriculture and Food Sciences;

    Abstract : A continuous growth of the world population raises the importance of preserving food resources while maintaining their nutrient value. Leafy vegetables such as spinach are a food category which decay quickly, and a large amount ends up as food waste. READ MORE

  5. 4. Combined Regularisation Techniques for Artificial Neural Networks

    University essay from Lunds universitet/Beräkningsbiologi och biologisk fysik - Genomgår omorganisation

    Author : Joseph Binns; [2022]
    Keywords : Artificial Neural Networks; ANNs; Overfitting; Combined Regularisation Techniques; Regularisation Techniques; Regularisation; L2; Weight Decay; Dropout; Early Stopping; Physics and Astronomy;

    Abstract : Artificial neural networks are prone to overfitting – the process of learning details specific to a particular training data set. Success in preventing overfitting through combining the L2 and dropout regularisation techniques has led to the combination’s recent popularity. READ MORE

  6. 5. Understanding the phenomenon of Neural Collapse

    University essay from Umeå universitet/Institutionen för matematik och matematisk statistik

    Author : Siva Mokkapati; [2022]
    Keywords : Artificial Intelligence; Data Science; Deep Learning; Optimization;

    Abstract : In this paper, we try to understand the concept of ’Neural Collapse’ from a mathemati-cal point of view. The survey will be conducted based on [1]. The authors of [1] providea first global optimization landscape analysis of Neural Collapse. Mainly there are threeaspects the authors like to investigate. READ MORE