Essays about: "Transformer-based Pre-trained Language Model"

Showing result 1 - 5 of 14 essays containing the words Transformer-based Pre-trained Language Model.

1. 1. Nested Noun Phrase Detection in English Text with BERT

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Shweta Misra; [2023]
   Keywords : Phrase detection; nested noun phrase identification; phrase structure identification; sentence parsing; transformer models; machine learning; natural language processing; Frasdetektering; kapslad substantivfrasidentifiering; frasstrukturidentifiering; meningsanalys; transformers-modeller; maskininlärning; naturlig språkbehandling;

   Abstract : In this project, we address the task of nested noun phrase identification in English sentences, where a phrase is defined as a group of words functioning as one unit in a sentence. Prior research has extensively explored the identification of various phrases for language understanding and text generation tasks. READ MORE

3. 2. Comparative Analysis of Transformer and CNN Based Models for 2D Brain Tumor Segmentation

   University essay from Linköpings universitet/Institutionen för medicinsk teknik

   Author : Henrik Träff; [2023]
   Keywords : Machine Learning; ML; AI; Computer vision; Vision Transformer; Swin Transformer; U-Net; nnU-Net; Brain Tumor Segmentation; Deep Learning;

   Abstract : A brain tumor is an abnormal growth of cells within the brain, which can be categorized into primary and secondary tumor types. The most common type of primary tumors in adults are gliomas, which can be further classified into high-grade gliomas (HGGs) and low-grade gliomas (LGGs). READ MORE

4. 3. An Automated Discharge Summary System Built for Multiple Clinical English Texts by Pre-trained DistilBART Model

   University essay from Stockholms universitet/Institutionen för data- och systemvetenskap

   Author : Sahel Alaei; [2023]
   Keywords : Language model; discharge summary; automated summary; pre- trained model; DistilBART; transformer; ROUGE; MIMIC-III;

   Abstract : The discharge summary is an important document, summarizing a patient’s medical information during their hospital stay. It is crucial for communication between clinicians and primary care physicians. Creating a discharge sum- mary is a necessary task. However, it is time-consuming for physicians. READ MORE

5. 4. Text simplification in Swedish using transformer-based neural networks

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Samuel Söderberg; [2023]
   Keywords : Machine learning; Natural language processing; Text simplification; Datasets; Maskininlärning; Neurolingvistisk programmering; Textförenkling; Dataset;

   Abstract : Textförenkling innebär modifiering av text så att den blir lättare att läsa genom ersättning av komplexa ord, ändringar av satsstruktur och/eller borttagning av onödig information. Forskning existerar kring textförenkling på svenska, men användandet av neurala nätverk inom området är begränsat. READ MORE

6. 5. Self-Supervised Fine-Tuning of sentence embedding models using a Smooth Inverse Frequency model : Automatic creation of labels with Smooth Inverse Frequency model

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Vittorio Pellegrini; [2023]
   Keywords : Natural Language Processing; sentence embeddings; Transformer-based architectures; sentence paraphrasing; sentence similarity; sentence clustering; Naturlig språkbehandling; inbäddning av meningar; transformatorbaserade arkitekturer; parafrasering av meningar; meningslikhet; klustring av meningar Canvas Lärplattform; Dockerbehållare; Prestandajustering;

   Abstract : Sentence embedding models play a key role in the field of Natural Language Processing. They can be exploited for the resolution of several tasks like sentence paraphrasing, sentence similarity, and sentence clustering. READ MORE