Essays about: "Weight Initialization"

Showing result 1 - 5 of 8 essays containing the words Weight Initialization.

  1. 1. Investigating Relations between Regularization and Weight Initialization in Artificial Neural Networks

    University essay from Lunds universitet/Beräkningsbiologi och biologisk fysik - Genomgår omorganisation

    Author : Rasmus Sjöö; [2022]
    Keywords : Artificial Neural Networks; L1 Regularization; L2 Regularization; Loss Function; Maximum Likelihood; Regularization Strength Synthetic Data Generation; Weight Initialization; Physics and Astronomy;

    Abstract : L2 regularization is a common method used to prevent overtraining in artificial neural networks. However, an issue with this method is that the regularization strength has to be properly adjusted for it to work as intended. This value is usually found by trial and error which can take some time, especially for larger networks. READ MORE

  3. 2. Self-Supervised Transformer Networks for Error Classification of Tightening Traces

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Dennis Bogatov Wilkman; [2022]
    Keywords : Transformers; Self-supervised Learning; Multi-Label Error Classification; Tightening Traces; Transformatorer; Självövervakad Inlärning; Klassificering av fel med flera etiketter; Skärpnings spår;

    Abstract : Transformers have shown remarkable results in the domains of Natural Language Processing and Computer Vision. This naturally raises the question whether the success could be replicated in other domains. READ MORE

  4. 3. Decoding Electrocorticography Signals by Deep Learning for Brain-Computer Interface

    University essay from KTH/Skolan för kemi, bioteknologi och hälsa (CBH)

    Author : Guillaume JUBIEN; [2019]
    Keywords : Deep learning; BCI; ECoG; Spatial filtering;

    Abstract : Brain-Computer Interface (BCI) offers the opportunity to paralyzed patients to control their movements without any neuromuscular activity. Signal processing of neuronal activity enables to decode movement intentions. Ability for patient to control an effector is closely linked to this decoding performance. READ MORE

  5. 4. Lifetime estimation of lithium-ion batteries for stationary energy storage system

    University essay from KTH/Skolan för kemivetenskap (CHE)

    Author : Joakim Andersson; [2017]
    Keywords : Li-ion battery; State of charge; State of health; Kalman filtering; Energy Storage;

    Abstract : With the continuing transition to renewable inherently intermittent energy sources like solar- and wind power, electrical energy storage will become progressively more important to manage energy production and demand. A key technology in this area is Li-ion batteries. READ MORE

  6. 5. A new scheme for training ReLU-based multi-layer feedforward neural networks

    University essay from KTH/Skolan för datavetenskap och kommunikation (CSC)

    Author : Hao Wang; [2017]
    Keywords : ReLU; feedforward neural network; ELM;

    Abstract : A new scheme for training Rectified Linear Unit (ReLU) based feedforward neural networks is examined in this thesis. The project starts with the row-by-row updating strategy designed for Single-hidden Layer Feedforward neural Networks (SLFNs). READ MORE