Essays about: "Multilingual"

Showing result 1 - 5 of 124 essays containing the word Multilingual.

  1. 1. Multilingual Transformer Models for Maltese Named Entity Recognition

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Kris Farrugia; [2022]
    Keywords : low-resource; named-entity; information extraction; Maltese;

    Abstract : The recently developed state-of-the-art models for Named Entity Recognition are heavily dependent upon huge amounts of available annotated data. Consequently, it is extremely challenging for data-scarce languages to obtain significant result. READ MORE

  2. 2. Analysis of Syntactic Behaviour of Neural Network Models by Using Gradient-Based Saliency Method : Comparative Study of Chinese and English BERT, Multilingual BERT and RoBERTa

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Jiayi Zhang; [2022]
    Keywords : neural network models; gradient-based saliency; BERT; mBERT; RoBERTa;

    Abstract : Neural network models such as Transformer-based BERT, mBERT and RoBERTa are achieving impressive performance (Devlin et al., 2019; Lewis et al., 2020; Liu et al., 2019; Raffel et al. READ MORE

  3. 3. Distillation or loss of information? : The effects of distillation on model redundancy

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Eva Elzbieta Sventickaite; [2022]
    Keywords : distillation; distillation effects; distilbert; distilmbert; distilroberta; distilgpt-2; distilled neurons; redundancy; redundancy in neural networks; redundancy in language models; neuron reduction in language models; distilled language models;

    Abstract :     The necessity for billions of parameters in large language models has lately been questioned as there are still unanswered questions regarding how information is captured in the networks. It could be argued that without this knowledge, there may be a tendency to overparametarize the models. READ MORE

  4. 4. Can Wizards be Polyglots: Towards a Multilingual Knowledge-grounded Dialogue System

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Evelyn Kai Yan Liu; [2022]
    Keywords : Knowledge-grounded dialogue; Dialogue systems; Generative question answering; Multilingual question answering; Multilingual dialogue systems; Transfer learning; Multi-task learning; Sequential training; Conversational AI; Natural Language Processing NLP ; Deep learning; Machine learning;

    Abstract : The research of open-domain, knowledge-grounded dialogue systems has been advancing rapidly due to the paradigm shift introduced by large language models (LLMs). While the strides have improved the performance of the dialogue systems, the scope is mostly monolingual and English-centric. READ MORE

  5. 5. “But it doesn't really have to do with the bilingualism”: Family language policies in transnational families of bilingual autistic children

    University essay from Stockholms universitet/Centrum för tvåspråkighetsforskning

    Author : Anna Metreveli; [2022]
    Keywords : autism; bilingualism; family language policy; neurodiversity; ableism; ideology; transnational families;

    Abstract : Family language policy (FLP) investigates family members’ language ideologies, practices, and management strategies. With the growing number of autistic children exposed to bi- or multilingual environments, there is a gap in the existing body of FLP research that has not focused before on speaking and non-speaking autistic children from transnational families. READ MORE