Essays about: "cross-lingual"

Showing result 11 - 15 of 35 essays containing the word cross-lingual.

  1. 11. Task-agnostic knowledge distillation of mBERT to Swedish

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Added Kina; [2022]
    Keywords : Natural Language Processing; Transformers; Knowledge Distillation; BERT; Multilingual Models; Cross-Lingual Transfer; Naturlig bearbetning av språk; Transformatorer; Kunskapsdestillation; BERT; Flerspråkiga modeller; Tvärspråklig inlärningsöverföring;

    Abstract : Large transformer models have shown great performance in multiple natural language processing tasks. However, slow inference, strong dependency on powerful hardware, and large energy consumption limit their availability. READ MORE

  2. 12. Techniques for Multilingual Document Retrieval for Open-Domain Question Answering : Using hard negatives filtering, binary retrieval and data augmentation

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Carlos Lago Solas; [2022]
    Keywords : OpenQA; Multilingual Transformers; Document retrieval; Data augmentation.; OpenQA; Flerspråkiga Transformatorer; Dokumenthämtning; Dataförstärkning.;

    Abstract : Open Domain Question Answering (OpenQA) systems find an answer to a question from a large collection of unstructured documents. In this information era, we have an immense amount of data at our disposal. However, filtering all the content and trying to find the answers to our questions can be too time-consuming and ffdiicult. READ MORE

  3. 13. Multilingual Speech Emotion Recognition using pretrained models powered by Self-Supervised Learning

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Felix Luthman; [2022]
    Keywords : Speech; Audio; Emotion Recognition; Cross-lingual; Multilingual; Self- Supervised Learning; Wav2vec 2.0; HuBERT; UniSpeech; UniSpeech-SAT; WavLM; Språk; Ljud; Känsloigenkänning; Tvärspråklig; Flerspråkig; Själv-Övervakad Inlärning; Wav2vec 2.0; HuBERT; UniSpeech; UniSpeech-SAT; WavLM;

    Abstract : Society is based on communication, for which speech is the most prevalent medium. In day to day interactions we talk to each other, but it is not only the words spoken that matters, but the emotional delivery as well. Extracting emotion from speech has therefore become a topic of research in the area of speech tasks. READ MORE

  4. 14. Improving BERTScore for Machine Translation Evaluation Through Contrastive Learning

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Oreen Yousuf; [2022]
    Keywords : machine translation; evaluation; BERTScore; contrastive learning; SimCSE; Hausa; Somali; Chinese;

    Abstract : Since the advent of automatic evaluation, tasks within Natural Language Processing (NLP), including Machine Translation, have been able to better utilize both time and labor resources. Later, multilingual pre-trained models (MLMs)have uplifted many languages’ capacity to participate in NLP research. READ MORE

  5. 15. Generative Adversarial Networks for Cross-Lingual Voice Conversion

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Fredrik Ankaräng; [2021]
    Keywords : Generative Adversarial Network; CycleGAN; Cross-Lingual Voice Conversion; Speech Synthesis; Machine Learning;

    Abstract : Speech synthesis is a technology that increasingly influences our daily lives, in the form of smart assistants, advanced translation systems and similar applications. In this thesis, the phenomenon of making one’s voice sound like the voice of someone else is explored. READ MORE