Essays about: "Multilingual Models"

Showing result 11 - 15 of 49 essays containing the words Multilingual Models.

  1. 11. Distillation or loss of information? : The effects of distillation on model redundancy

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Eva Elzbieta Sventickaite; [2022]
    Keywords : distillation; distillation effects; distilbert; distilmbert; distilroberta; distilgpt-2; distilled neurons; redundancy; redundancy in neural networks; redundancy in language models; neuron reduction in language models; distilled language models;

    Abstract :     The necessity for billions of parameters in large language models has lately been questioned as there are still unanswered questions regarding how information is captured in the networks. It could be argued that without this knowledge, there may be a tendency to overparametarize the models. READ MORE

  3. 12. Can Wizards be Polyglots: Towards a Multilingual Knowledge-grounded Dialogue System

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Evelyn Kai Yan Liu; [2022]
    Keywords : Knowledge-grounded dialogue; Dialogue systems; Generative question answering; Multilingual question answering; Multilingual dialogue systems; Transfer learning; Multi-task learning; Sequential training; Conversational AI; Natural Language Processing NLP ; Deep learning; Machine learning;

    Abstract : The research of open-domain, knowledge-grounded dialogue systems has been advancing rapidly due to the paradigm shift introduced by large language models (LLMs). While the strides have improved the performance of the dialogue systems, the scope is mostly monolingual and English-centric. READ MORE

  4. 13. Sentence Embeddings and Automatic Classification of Menu Items

    University essay from Uppsala universitet/Institutionen för informationsteknologi

    Author : Aljaz Kovac; [2022]
    Keywords : ;

    Abstract : Caspeco AB is a company in Uppsala that specializes in providing IT solutions to the hospitality industry. Their customers (restaurants, pubs, etc.) classify their menu items freely, which leads to a classification that is often inconsistent and unreliable. READ MORE

  5. 14. Unsupervised multilingual distractor generation for fill-in-the-blank questions

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Zhe Han; [2022]
    Keywords : Multilingual; Distractor; BERT;

    Abstract : Fill-in-the-blank multiple choice questions (MCQs) play an important role in the educational field, but the manual generation of them is quite resource-consuming, so it has gradually turned into an attractive NLP task. Thereinto, question creation itself has become a mainstream NLP research topic, while distractor (wrong alternative) generation (DG) still remains out of the spotlight. READ MORE

  6. 15. Cross-lingual and Multilingual Automatic Speech Recognition for Scandinavian Languages

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Rafal Černiavski; [2022]
    Keywords : cross-lingual; multilingual; automatic speech recognition; ASR;

    Abstract : Research into Automatic Speech Recognition (ASR), the task of transforming speech into text, remains highly relevant due to its countless applications in industry and academia. State-of-the-art ASR models are able to produce nearly perfect, sometimes referred to as human-like transcriptions; however, accurate ASR models are most often available only in high-resource languages. READ MORE