Essays about: "Multilingual Models"
Showing result 16 - 20 of 49 essays containing the words Multilingual Models.
-
16. Task-agnostic knowledge distillation of mBERT to Swedish
University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)Abstract : Large transformer models have shown great performance in multiple natural language processing tasks. However, slow inference, strong dependency on powerful hardware, and large energy consumption limit their availability. READ MORE
-
17. Methods for increasing cohesion in automatically extracted summaries of Swedish news articles : Using and extending multilingual sentence transformers in the data-processing stage of training BERT models for extractive text summarization
University essay from Linköpings universitet/Institutionen för datavetenskapAbstract : Developments in deep learning and machine learning overall has created a plethora of opportunities for easier training of automatic text summarization (ATS) models for producing summaries with higher quality. ATS can be split into extractive and abstractive tasks; extractive models extract sentences from the original text to create summaries. READ MORE
-
18. Investigating Few-Shot Transfer Learning for Address Parsing : Fine-Tuning Multilingual Pre-Trained Language Models for Low-Resource Address Segmentation
University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)Abstract : Address parsing is the process of splitting an address string into its different address components, such as street name, street number, et cetera. Address parsing has been quite extensively researched and there exist some state-ofthe-art address parsing solutions, mostly unilingual. READ MORE
-
19. Multilingual Speech Emotion Recognition using pretrained models powered by Self-Supervised Learning
University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)Abstract : Society is based on communication, for which speech is the most prevalent medium. In day to day interactions we talk to each other, but it is not only the words spoken that matters, but the emotional delivery as well. Extracting emotion from speech has therefore become a topic of research in the area of speech tasks. READ MORE
-
20. Improving BERTScore for Machine Translation Evaluation Through Contrastive Learning
University essay from Uppsala universitet/Institutionen för lingvistik och filologiAbstract : Since the advent of automatic evaluation, tasks within Natural Language Processing (NLP), including Machine Translation, have been able to better utilize both time and labor resources. Later, multilingual pre-trained models (MLMs)have uplifted many languages’ capacity to participate in NLP research. READ MORE