Essays about: "kunskapsdestillering"

Found 2 essays containing the word kunskapsdestillering.

  1. 1. Distilling Multilingual Transformer Models for Efficient Document Retrieval : Distilling multi-Transformer models with distillation losses involving multi-Transformer interactions

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Xuecong Liu; [2022]
    Keywords : Dense Passage Retrieval; Knowledge Distillation; Multilingual Transformer; Document Retrieval; Open Domain Question Answering; Tät textavsnittssökning; kunskapsdestillering; flerspråkiga transformatorer; dokumentsökning; domänlöst frågebesvarande;

    Abstract : Open Domain Question Answering (OpenQA) is a task concerning automatically finding answers to a query from a given set of documents. Language-agnostic OpenQA is an increasingly important research area in the globalised world, where the answers can be in a different language from the question. READ MORE

  3. 2. The Impact of Scaling Down a Language Model Used for Text Summarization

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Marcus Lindström; [2020]
    Keywords : ;

    Abstract : Machine learning based language models have achieved state-of-the-art results on a variety of tasks. However, their applicability in commercial uses is becoming increasingly difficult to motivate due to their ever-increasing size. READ MORE