Essays about: "Cross-lingual"

Showing result 1 - 5 of 35 essays containing the word Cross-lingual.

1. 1. Monolingual and Cross-Lingual Survey Response Annotation

   University essay from Uppsala universitet/Institutionen för lingvistik och filologi

   Author : Yahui Zhao; [2023]
   Keywords : transfer learning; zero-shot cross-lingual transfer; model-based transfer; multilingual pre-trained language models; sequence labeling; open-ended questions; democracy;

   Abstract : Multilingual natural language processing (NLP) is increasingly recognized for its potential in processing diverse text-type data, including those from social media, reviews, and technical reports. Multilingual language models like mBERT and XLM-RoBERTa (XLM-R) play a pivotal role in multilingual NLP. READ MORE

3. 2. Cross-Lingual and Genre-Supervised Parsing and Tagging for Low-Resource Spoken Data

   University essay from Uppsala universitet/Institutionen för lingvistik och filologi

   Author : Iliana Fosteri; [2023]
   Keywords : dependency parsing; part-of-speech tagging; low-resource languages; transcribed speech; large language models; cross-lingual learning; transfer learning; multi-task learning; Universal Dependencies;

   Abstract : Dealing with low-resource languages is a challenging task, because of the absence of sufficient data to train machine-learning models to make predictions on these languages. One way to deal with this problem is to use data from higher-resource languages, which enables the transfer of learning from these languages to the low-resource target ones. READ MORE

4. 3. Exploring Cross-Lingual Transfer Learning for Swedish Named Entity Recognition : Fine-tuning of English and Multilingual Pre-trained Models

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Daniel Lai Wikström; Axel Sparr; [2023]
   Keywords : NER; Cross-lingual transfer; Transformer; BERT; Deep Learning; namnigenkänning; NER; multilingvistisk överföring; Transformer; BERT; deep learning;

   Abstract : Named Entity Recognition (NER) is a critical task in Natural Language Processing (NLP), and recent advancements in language model pre-training have significantly improved its performance. However, this improvement is not universally applicable due to a lack of large pre-training datasets or computational budget for smaller languages. READ MORE

5. 4. Multilingual Transformer Models for Maltese Named Entity Recognition

   University essay from Uppsala universitet/Institutionen för lingvistik och filologi

   Author : Kris Farrugia; [2022]
   Keywords : low-resource; named-entity; information extraction; Maltese;

   Abstract : The recently developed state-of-the-art models for Named Entity Recognition are heavily dependent upon huge amounts of available annotated data. Consequently, it is extremely challenging for data-scarce languages to obtain significant result. READ MORE

6. 5. Distilling Multilingual Transformer Models for Efficient Document Retrieval : Distilling multi-Transformer models with distillation losses involving multi-Transformer interactions

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Xuecong Liu; [2022]
   Keywords : Dense Passage Retrieval; Knowledge Distillation; Multilingual Transformer; Document Retrieval; Open Domain Question Answering; Tät textavsnittssökning; kunskapsdestillering; flerspråkiga transformatorer; dokumentsökning; domänlöst frågebesvarande;

   Abstract : Open Domain Question Answering (OpenQA) is a task concerning automatically finding answers to a query from a given set of documents. Language-agnostic OpenQA is an increasingly important research area in the globalised world, where the answers can be in a different language from the question. READ MORE