Essays about: "Magnitude Based Pruning"

Found 2 essays containing the words Magnitude Based Pruning.

  1. 1. Unstructured pruning of pre-trained language models tuned for sentiment classification.

    University essay from KTH/Matematisk statistik

    Author : Oscar Nordström; [2022]
    Keywords : Unstructured pruning; transformer; BERT; sentiment classification; natural language processing; neural networks; deep learning; Ostrukturerad pruning; transformer; BERT; sentimentklassifikation; språkbehandling; neurala nätverk; djup inlärning;

    Abstract : Transformer-based models are frequently used in natural language processing. These models are oftenlarge and pre-trained for general language understanding and then fine-tuned for a specific task. Becausethese models are large, they have a high memory requirement and have high inference time. READ MORE

  3. 2. Empirical Investigation of the Effect of Pruning Artificial Neural Networks With Respect to Increased Generalization Ability

    University essay from Institutionen för datavetenskap

    Author : Nicklas Weman; [2010]
    Keywords : Artifical Neural Networks; Pruning; Empirical Investigation; Proben1; Magnitude Based Pruning; Optimal Brain Damage; Optimal Brain Surgeon;

    Abstract : This final thesis covers the basics of artificial neural networks, with focus on supervised learning, pruning and the problem of achieving good generalization ability. An empirical investigation is conducted on twelve dierent problems originating from the Proben1 benchmark collection. READ MORE