Essays about: "BERT"

Showing result 1 - 5 of 136 essays containing the word BERT.

  1. 1. Multilingual Transformer Models for Maltese Named Entity Recognition

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Kris Farrugia; [2022]
    Keywords : low-resource; named-entity; information extraction; Maltese;

    Abstract : The recently developed state-of-the-art models for Named Entity Recognition are heavily dependent upon huge amounts of available annotated data. Consequently, it is extremely challenging for data-scarce languages to obtain significant result. READ MORE

  3. 2. Knowledge Distillation of DNABERT for Prediction of Genomic Elements

    University essay from KTH/Skolan för kemi, bioteknologi och hälsa (CBH)

    Author : Joana Palés Huix; [2022]
    Keywords : Knowledge distillation; Transformers; BERT; Genomics; Promoter identification; Explainability;

    Abstract : Understanding the information encoded in the human genome and the influence of each part of the DNA sequence is a fundamental problem of our society that can be key to unveil the mechanism of common diseases. With the latest technological developments in the genomics field, many research institutes have the tools to collect massive amounts of genomic data. READ MORE

  4. 3. Compressing Deep Learning models for Natural Language Understanding

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Nadir Ait Lahmouch; [2022]
    Keywords : Natural Language Processing; Deep learning; BERT; Knowledge Distillation; Pruning.;

    Abstract : Uppgifter för behandling av naturliga språk (NLP) har under de senaste åren visat sig vara särskilt effektiva när man använder förtränade språkmodeller som BERT. Det enorma kravet på datorresurser som krävs för att träna sådana modeller gör det dock svårt att använda dem i verkligheten. READ MORE

  5. 4. Federated Learning for Natural Language Processing using Transformers

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Gustav Kjellberg; [2022]
    Keywords : Machine Learning; Federated Learning; Distributed Machine Learning; Natural Language Processing; BERT; ALBERT; Transformers; Data Privacy.; Maskininlärning; Federerad inlärning; Distribuerad Maskininlärning; Språkteknologi; BERT; ALBERT; Transformers; Dataintegritet.;

    Abstract : The use of Machine Learning (ML) in business has increased significantly over the past years. Creating high quality and robust models requires a lot of data, which is at times infeasible to obtain. As more people are becoming concerned about their data being misused, data privacy is increasingly strengthened. READ MORE

  6. 5. Predicting Political Party Affiliation in the Swedish Parliament using Natural Language Processing

    University essay from Uppsala universitet/Statistiska institutionen

    Author : Johannes Zetterberg; [2022]
    Keywords : Machine learning; support vector machines; naive Bayes; transformer; BERT; text classification; NLP;

    Abstract : Text classification is a fundamental part of natural language processing. In this thesis, methods for text classification are used in an attempt to predict the political party affiliation of members of parliament (MPs). READ MORE