Essays about: "Gradient Decay"

Showing result 1 - 5 of 9 essays containing the words Gradient Decay.

  1. 1. Temporal Localization of Representations in Recurrent Neural Networks

    University essay from Högskolan Dalarna/Institutionen för information och teknik

    Author : Asadullah Najam; [2023]
    Keywords : Recurrent Neural Networks RNNs ; Deep Learning; Time Series Prediction; Exploding Values; Gradient Decay; Long Short-Term Memory LSTMs ; Gated Recurrent Units GRUs ; Attention Mechanism; Moving Representations; Localizing Representations;

    Abstract : Recurrent Neural Networks (RNNs) are pivotal in deep learning for time series prediction, but they suffer from 'exploding values' and 'gradient decay,' particularly when learning temporally distant interactions. Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU) have addressed these issues to an extent, but the precise mitigating mechanisms remain unclear. READ MORE

  2. 2. Modelling of gene regulatory and spatial mechanisms which pattern the early human neural tube

    University essay from Lunds universitet/Beräkningsbiologi och biologisk fysik - Genomgår omorganisation

    Author : Fredrik Bertilsson; [2022]
    Keywords : Biophysics; systems biology; gene regulatory networks; neural tube; isthmic organizer; midbrain-hindbrain boundary; WNT; FGF; morphogens; reaction-diffusion; finite-difference; 3D modelling; Physics and Astronomy;

    Abstract : Tissue patterning during development is thought to be driven largely by gene regulatory responses to spatial gradients of molecular signals, known as morphogens. In this thesis, early patterning of the human neural tube is studied using two different gene regulatory network models. READ MORE

  3. 3. Photo-chemical reactivity of dissolved organic carbon in subarctic lakes from northern Sweden

    University essay from Lunds universitet/Institutionen för naturgeografi och ekosystemvetenskap

    Author : Hani Younes; [2020]
    Keywords : Photo-reactivity; DOM; subarctic lakes; EEM-PARAFAC. Brownification; Earth and Environmental Sciences;

    Abstract : Dissolved organic matter (DOM) is the major absorber of sunlight in most natural waters and a critical component of the carbon cycle in aquatic systems. The photochemical decomposition of DOM can have a significant impact on the landscape-atmosphere carbon exchange. READ MORE

  4. 4. Morphological characterization of neural tissue microstructure using the orientationally-averaged diffusion MRI signal

    University essay from Linköpings universitet/Avdelningen för medicinsk teknik

    Author : Iulian Emil Tampu; [2019]
    Keywords : MRI; diffusion MRI; orientationally-averaged signal; powder-signal; microstructure;

    Abstract : Diffusion-weighted magnetic resonance imaging (dMRI) is a powerful tool for thecharacterisation of neural tissue microstructural features. The role of neural projectioncurvature on the diffusion signal was recently studied for three temporal regimes of the diffusion pulse sequence in search for a description of the different decay trends in the orientationally-averaged diffusion signal reported in in vivo human studies. READ MORE

  5. 5. Optimizing Genetic Training Parameters for Neural Networks in Survival Analysis

    University essay from Lunds universitet/Beräkningsbiologi och biologisk fysik - Genomgår omorganisation; Lunds universitet/Institutionen för astronomi och teoretisk fysik - Genomgår omorganisation

    Author : Ludvig Siwe; [2018]
    Keywords : Artificial Neural Network; Genetic Algorithm; Survival Analysis; Physics and Astronomy;

    Abstract : Artificial neural networks have been used to solve different problems, one being survival analysis of medical data. For survival analysis, the main interest is often how samples become sorted by their outputs, which makes survival analysis a rank based problem. READ MORE