Essays about: "cross-lingual"

Showing result 16 - 20 of 35 essays containing the word cross-lingual.

  1. 16. Automatic Speech Recognition for low-resource languages using Wav2Vec2 : Modern Standard Arabic (MSA) as an example of a low-resource language

    University essay from Högskolan Dalarna/Institutionen för information och teknik

    Author : Taha Zouhair; [2021]
    Keywords : Automatic Speech Recognition; Facebook Wav2Vec; Mozilla Common Voice; Low-Resource Language;

    Abstract : The need for fully automatic translation at DigitalTolk, a Stockholm-based company providing translation services, leads to exploring Automatic Speech Recognition as a first step for Modern Standard Arabic (MSA). Facebook AI recently released a second version of its Wav2Vec models, dubbed Wav2Vec 2. READ MORE

  3. 17. Large-Context Question Answering with Cross-Lingual Transfer

    University essay from Uppsala universitet/Institutionen för informationsteknologi

    Author : Markus Sagen; [2021]
    Keywords : Long-Context Multilingual Model; Longformer XLM-R; Longformer; Long-term Context; Extending Context; Extend Context; Large-Context; Long-Context; Large Context; Long Context; Cross-Lingual; Multi-Lingual; Cross Lingual; Multi Lingual; QA; Question-Answering; Question Answering; Transformer model; Machine Learning; Transfer Learning; SQuAD; Memory; Transfer Learning; Long-Context; Long Context; Efficient; Monolingual; Multilingual; QA model; Language Model; Huggingface; BERT; RoBERTa; XLM-R; mBERT; Multilingual BERT; Efficient Transformers; Reformer; Linformer; Performer; Transformer-XL; Wikitext-103; TriviaQA; HotpotQA; WikiHopQA; VINNOVA; Peltarion; AI; LM; MLM; Deep Learning; Natural Language Processing; NLP; Attention; Transformers; Transfer Learning; Datasets;

    Abstract : Models based around the transformer architecture have become one of the most prominent for solving a multitude of natural language processing (NLP)tasks since its introduction in 2017. However, much research related to the transformer model has focused primarily on achieving high performance and many problems remain unsolved. READ MORE

  4. 18. Investigating the Effect of Complementary Information Stored in Multiple Languages on Question Answering Performance : A Study of the Multilingual-T5 for Extractive Question Answering

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Björn Aurell Hansson; [2021]
    Keywords : Machine learning; Transformers; multilingual-T5; question answering; NLP; Maskininlärning; transformatormodeller; frågeställning; naturlig språkbehandling.;

    Abstract : Extractive question answering is a popular domain in the field of natural language processing, where machine learning models are tasked with answering questions given a context. Historically the field has been centered on monolingual models, but recently more and more multilingual models have been developed, such as Google’s MT5 [1]. READ MORE

  5. 19. Multilingual Zero-Shot and Few-Shot Causality Detection

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Sebastian Michael Reimann; [2021]
    Keywords : classification; causality; causal relation; multilingual; cross-lingual; zero-shot; few-shot; bert; xlm-r; laser;

    Abstract : Relations that hold between causes and their effects are fundamental for a wide range of different sectors. Automatically finding sentences that express such relations may for example be of great interest for the economy or political institutions. READ MORE

  6. 20. The Influence of M-BERT and Sizes on the Choice of Transfer Languages in Parsing

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Yifei Zhang; [2021]
    Keywords : ;

    Abstract : In this thesis, we explore the impact of M-BERT and different transfer sizes on the choice of different transfer languages in dependency parsing. In order to investigate our research questions, we conduct a series of experiments on the treebanks in Universal Dependencies with UUParser. READ MORE