Essays about: "Contextualized Language Models"
Showing result 1 - 5 of 6 essays containing the words Contextualized Language Models.
-
1. Improving BERTScore for Machine Translation Evaluation Through Contrastive Learning
University essay from Uppsala universitet/Institutionen för lingvistik och filologiAbstract : Since the advent of automatic evaluation, tasks within Natural Language Processing (NLP), including Machine Translation, have been able to better utilize both time and labor resources. Later, multilingual pre-trained models (MLMs)have uplifted many languages’ capacity to participate in NLP research. READ MORE
-
2. Analyzing the Anisotropy Phenomenon in Transformer-based Masked Language Models
University essay from Uppsala universitet/Institutionen för lingvistik och filologiAbstract : In this thesis, we examine the anisotropy phenomenon in popular masked language models, BERT and RoBERTa, in detail. We propose a possible explanation for this unreasonable phenomenon. READ MORE
-
3. Unsupervised Lexical Semantic Change Detection with Context-Dependent Word Representations
University essay from Uppsala universitet/Institutionen för lingvistik och filologiAbstract : In this work, we explore the usefulness of contextualized embeddings from language models on lexical semantic change (LSC) detection. With diachronic corpora spanning two time periods, we construct word embeddings for a selected set of target words, aiming at detecting potential LSC of each target word across time. READ MORE
-
4. Automatic Categorization of News Articles With Contextualized Language Models
University essay from Linköpings universitet/Artificiell intelligens och integrerade datorsystemAbstract : This thesis investigates how pre-trained contextualized language models can be adapted for multi-label text classification of Swedish news articles. Various classifiers are built on pre-trained BERT and ELECTRA models, exploring global and local classifier approaches. READ MORE
-
5. Building a Medical Recommendation System : A case study on digitalizing evidence-based radiology
University essay from Uppsala universitet/Avdelningen för systemteknikAbstract : In this thesis, we show how a text-based Recommendation Systems can greatly benefit from neural statistical language models, more particularly BERT. We evaluate the framework on a digital and collaborative platform for radiologists, by automatically suggesting scientific papers from the medical database PubMed, to provide evidence in diagnostic radiology. READ MORE