Essays about: "BERT"

Showing result 6 - 10 of 213 essays containing the word BERT.

  1. 6. Natural Language Inference Transfer Learning in a Multi-Task Contract Dataset : In the Case of ContractNLI: a Document Information Extraction System

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Yiu Kei Tang; [2023]
    Keywords : ;

    Abstract : This thesis investigates the enhancement of legal contract Natural Language Inference (NLI) classification through supervised fine-tuning on general domain NLI, in the case of ContractNLI and Span NLI BERT (Koreeda and Manning, 2021), a multi-task document information extraction dataset and framework. Annotated datasets of a specific professional domain are scarce due to the high time and labour cost required to create them. READ MORE

  3. 7. Utilizing Transformers with Domain-Specific Pretraining and Active Learning to Enable Mining of Product Labels

    University essay from Uppsala universitet/Avdelningen för beräkningsvetenskap

    Author : Erik Norén; [2023]
    Keywords : Machine Learning; Natural Language Processing; NLP; BERT; Active Learning; AL; Pharmacovigilance; UMC; Uppsala Monitoring Centre; Structured Product Label; SPL; Transformers; Domain-Specific Pretraining; NER; Named Entity Recognition; Adverse Drug Reaction; ADR;

    Abstract : Structured Product Labels (SPLs), the package inserts that accompany drugs governed by the Food and Drugs Administration (FDA), hold information about Adverse Drug Reactions (ADRs) that exists associated with drugs post-market. This information is valuable for actors working in the field of pharmacovigilance aiming to improve the safety of drugs. READ MORE

  4. 8. Detection of insurance fraud using NLP and ML

    University essay from Lunds universitet/Matematisk statistik

    Author : Rasmus Bäcklund; Hampus Öhman; [2023]
    Keywords : Technology and Engineering;

    Abstract : Machine-Learning can sometimes see things we as humans can not. In this thesis we evaluated three different Natural Language Procces-techniques: BERT, word2vec and linguistic analysis (UDPipe), on their performance in detecting insurance fraud based on transcribed audio from phone calls (referred to as audio data) and written text (referred to as text-form data), related to insurance claims. READ MORE

  5. 9. Mitigating Unintended Bias in Toxic Comment Detection using Entropy-based Attention Regularization

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Fabio Camerota; [2023]
    Keywords : XLNet; BERT; Toxic Comment Classification; Entropy-based Attention Regularization; XLNet; BERT; Toxisk Kommentar Klassificering; Entropibaserad uppmärksamhetsreglering;

    Abstract : The proliferation of hate speech is a growing challenge for social media platforms, as toxic online comments can have dangerous consequences also in real life. There is a need for tools that can automatically and reliably detect hateful comments, and deep learning models have proven effective in solving this issue. READ MORE

  6. 10. Speech Classification using Acoustic embedding and Large Language Models Applied on Alzheimer’s Disease Prediction Task

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Maryam Kheirkhahzadeh; [2023]
    Keywords : Speech classification; Alzheimer’s disease detection; GPT-3; BERT; Text embedding; Dementia; wav2vec2.0; Klassificering av tal; detektion av Alzheimer’s sjukdom; GPT-3; BERT; textinbäddning; demens; wav2vec2.0;

    Abstract : Alzheimer’s sjukdom är en neurodegenerativ sjukdom som leder till demens. Den kan börja tyst i de tidiga stadierna och fortsätta under åren till en allvarlig och obotlig fas. Språkstörningar uppstår ofta som ett av de tidiga symptomen och kan till slut leda till fullständig mutism i de avancerade stadierna av sjukdomen. READ MORE