Essays about: "Multilingual Sentence Embeddings"

Showing result 1 - 5 of 7 essays containing the words Multilingual Sentence Embeddings.

  1. 1. Sentence Embeddings and Automatic Classification of Menu Items

    University essay from Uppsala universitet/Institutionen för informationsteknologi

    Author : Aljaz Kovac; [2022]
    Keywords : ;

    Abstract : Caspeco AB is a company in Uppsala that specializes in providing IT solutions to the hospitality industry. Their customers (restaurants, pubs, etc.) classify their menu items freely, which leads to a classification that is often inconsistent and unreliable. READ MORE

  2. 2. Methods for increasing cohesion in automatically extracted summaries of Swedish news articles : Using and extending multilingual sentence transformers in the data-processing stage of training BERT models for extractive text summarization

    University essay from Linköpings universitet/Institutionen för datavetenskap

    Author : Elsa Andersson; [2022]
    Keywords : NLP; automatic text summarization; extractive summarization; BERT; sentence embeddings; cohesion;

    Abstract : Developments in deep learning and machine learning overall has created a plethora of opportunities for easier training of automatic text summarization (ATS) models for producing summaries with higher quality. ATS can be split into extractive and abstractive tasks; extractive models extract sentences from the original text to create summaries. READ MORE

  3. 3. Improving BERTScore for Machine Translation Evaluation Through Contrastive Learning

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Oreen Yousuf; [2022]
    Keywords : machine translation; evaluation; BERTScore; contrastive learning; SimCSE; Hausa; Somali; Chinese;

    Abstract : Since the advent of automatic evaluation, tasks within Natural Language Processing (NLP), including Machine Translation, have been able to better utilize both time and labor resources. Later, multilingual pre-trained models (MLMs)have uplifted many languages’ capacity to participate in NLP research. READ MORE

  4. 4. Multilingual Zero-Shot and Few-Shot Causality Detection

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Sebastian Michael Reimann; [2021]
    Keywords : classification; causality; causal relation; multilingual; cross-lingual; zero-shot; few-shot; bert; xlm-r; laser;

    Abstract : Relations that hold between causes and their effects are fundamental for a wide range of different sectors. Automatically finding sentences that express such relations may for example be of great interest for the economy or political institutions. READ MORE

  5. 5. DistillaBSE: Task-agnostic  distillation of multilingual sentence  embeddings : Exploring deep self-attention distillation with switch transformers

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Boris Bubla; [2021]
    Keywords : Transformers; Knowledge Distillation; Language Agnostic BERT Sentence Embeddings; Natural Language Processing; Switch Transformers; Transformatorer; kunskapsdestillation; språkagnostisk inbäddning av BERT- mening; naturlig bearbetning av språk; switchtransformatorer;

    Abstract : The recent development of massive multilingual transformer networks has resulted in drastic improvements in model performance. These models, however, are so large they suffer from large inference latency and consume vast computing resources. Such features hinder widespread adoption of the models in industry and some academic settings. READ MORE