Essays about: "Transformers"

Showing result 11 - 15 of 261 essays containing the word Transformers.

  1. 11. Utilizing Transformers with Domain-Specific Pretraining and Active Learning to Enable Mining of Product Labels

    University essay from Uppsala universitet/Avdelningen för beräkningsvetenskap

    Author : Erik Norén; [2023]
    Keywords : Machine Learning; Natural Language Processing; NLP; BERT; Active Learning; AL; Pharmacovigilance; UMC; Uppsala Monitoring Centre; Structured Product Label; SPL; Transformers; Domain-Specific Pretraining; NER; Named Entity Recognition; Adverse Drug Reaction; ADR;

    Abstract : Structured Product Labels (SPLs), the package inserts that accompany drugs governed by the Food and Drugs Administration (FDA), hold information about Adverse Drug Reactions (ADRs) that exists associated with drugs post-market. This information is valuable for actors working in the field of pharmacovigilance aiming to improve the safety of drugs. READ MORE

  3. 12. Estimating eco-friendly driving behavior in various traffic situations, using machine learning

    University essay from Linköpings universitet/Institutionen för datavetenskap

    Author : Ludvig Fors; [2023]
    Keywords : Machine learning; transformers; neural networks; casual inference; K-Means; driver behavior; fuel consumption;

    Abstract : This thesis investigates how various driver signals, signals that a truck driver can interact with, influences fuel consumption and what are the optimal values of these signals in various traffic conditions. More specifically, the objective is to estimate good driver behavior in various traffic conditions and compare bad driver behavior in similar situations to see how performing a specific driver action, changing a driver signal from the bad driver value to the corresponding good driver value impacts the fuel consumption. READ MORE

  4. 13. Air quality prediction in metropolitan areas using deep learning methods

    University essay from Stockholms universitet/Institutionen för data- och systemvetenskap

    Author : Augustin Ionut Ionascu; [2023]
    Keywords : air quality; forecasting; time-series; univariate; multivariate; multi-step; Attention; Transformer;

    Abstract : The rapid growth of the world's urban population shows that people are increasingly moving to cities. In recent decades, the frequent occurrence of smog caused by increasing industrialization has brought environmental pollution to record highs. READ MORE

  5. 14. Using Machine Learning to Optimize Near-Earth Object Sighting Data at the Golden Ears Observatory

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Laura Murphy; [2023]
    Keywords : Near-Earth Object Detection; Machine Learning; Deep Learning; Visual Transformers;

    Abstract : This research project focuses on improving Near-Earth Object (NEO) detection using advanced machine learning techniques, particularly Vision Transformers (ViTs). The study addresses challenges such as noise, limited data, and class imbalance. READ MORE

  6. 15. Head-to-head Transfer Learning Comparisons made Possible : A Comparative Study of Transfer Learning Methods for Neural Machine Translation of the Baltic Languages

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Mathias Stenlund; [2023]
    Keywords : machine translation; transfer learning; Latvian; Lithuanian; low-resource languages; transformers; parent language; child language; comparative study;

    Abstract : The struggle of training adequate MT models using data-hungry NMT frameworks for low-resource language pairs has created a need to alleviate the scarcity of sufficiently large parallel corpora. Different transfer learning methods have been introduced as possible solutions to this problem, where a new model for a target task is initialized using parameters learned from some other high-resource task. READ MORE