Essays about: "Pre-training"

Showing result 1 - 5 of 64 essays containing the word Pre-training.

  1. 1. Image Quality Assessment Pipeline and Semi-Automated Annotation method for Synthetic Data

    University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

    Author : Liam Le Tran; Edina Dedovic; [2023-10-24]
    Keywords : Facial Expression Recognition; FACS; Action Units; styleGAN2-ada; synthetic data; Image Quality Assessment; Multi-stage Pre-training; Pipeline Processing; Semi-automated Human Annotation;

    Abstract : Predicting human emotions through facial expression, particularly in relation to medication field such as clinical trial settings, has garnered scientific interest in recent years due to significant understanding of the impact of treatment on emotions and social functioning. This thesis aims to improve performance of a FER model using large scale of synthetic data. READ MORE

  2. 2. Utilizing Transformers with Domain-Specific Pretraining and Active Learning to Enable Mining of Product Labels

    University essay from Uppsala universitet/Avdelningen för beräkningsvetenskap

    Author : Erik Norén; [2023]
    Keywords : Machine Learning; Natural Language Processing; NLP; BERT; Active Learning; AL; Pharmacovigilance; UMC; Uppsala Monitoring Centre; Structured Product Label; SPL; Transformers; Domain-Specific Pretraining; NER; Named Entity Recognition; Adverse Drug Reaction; ADR;

    Abstract : Structured Product Labels (SPLs), the package inserts that accompany drugs governed by the Food and Drugs Administration (FDA), hold information about Adverse Drug Reactions (ADRs) that exists associated with drugs post-market. This information is valuable for actors working in the field of pharmacovigilance aiming to improve the safety of drugs. READ MORE

  3. 3. Evaluating the Viability of Synthetic Pre-training Data for Face Recognition Using a CNN-Based Multiclass Classifier

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Lars Bergström; Dag Hjelm; [2023]
    Keywords : ;

    Abstract : Today, face recognition is becoming increasingly accurate and faster with deep learning methods such as convolutional neural networks (CNNs), and is now widely used in areas such as security and entertainment. Typically, these CNNs are trained using real-face datasets like CASIA-WebFace, which was put together using web-crawling of IMDB. READ MORE

  4. 4. Football Trajectory Modeling Using Masked Autoencoders : Using Masked Autoencoder for Anomaly Detection and Correction for Football Trajectories

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Sandra Tor; [2023]
    Keywords : Machine Learning; Autoencoders; Masked autoencoders; Time series; Trajectory modeling; Time series modeling; Anomaly detection; Anomaly correction; Football; Maskininlärning; Autoencoders; Maskerade autoencoders; Tidsserie; Banmodellering; Tidsseriemodellering; Avvikelsedetektering; Avvikelsekorrigering; Fotboll;

    Abstract : Football trajectory modeling is a powerful tool for predicting and evaluating the movement of a football and its dynamics. Masked autoencoders are scalable self-supervised learners used for representation learning of partially observable data. READ MORE

  5. 5. The Impact of the Retrieval Text Set for Text Sentiment Classification With the Retrieval-Augmented Language Model REALM

    University essay from KTH/Matematik (Inst.)

    Author : Oscar Blommegård; [2023]
    Keywords : The Impact of the Retrieval Text Set for Text Sentiment Classification With the Retrieval-Augmented Language Model REALM; Hämtningsförstärkta språkmodeller; Natural Language Processing; Transformers; Djupinlärning; Textklassificering;

    Abstract : Large Language Models (LLMs) have demonstrated impressive results across various language technology tasks. By training on large corpora of diverse text collections from the internet, these models learn to process text effectively, allowing them to acquire comprehensive world knowledge. READ MORE