Essays about: "Transformatormodeller"

Showing result 1 - 5 of 6 essays containing the word Transformatormodeller.

  1. 1. Recommendation of Text Properties for Short Texts with the Use of Machine Learning : A Comparative Study of State-of-the-Art Techniques Including BERT and GPT-2

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Luciano Zapata; [2023]
    Keywords : Text classification; Short texts; Deep Learning; BERT; GPT; GPT-2; Transformers; Natural Language Processing; Textklassificering; Korta Texter; Djupinlärning; BERT; GPT; GPT-2; Transformatorer; Naturlig språkbehandling;

    Abstract : Text mining has gained considerable attention due to the extensive usage ofelectronic documents. The significant increase in electronic document usagehas created a necessity to process and analyze them effectively. READ MORE

  3. 2. Distilling Multilingual Transformer Models for Efficient Document Retrieval : Distilling multi-Transformer models with distillation losses involving multi-Transformer interactions

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Xuecong Liu; [2022]
    Keywords : Dense Passage Retrieval; Knowledge Distillation; Multilingual Transformer; Document Retrieval; Open Domain Question Answering; Tät textavsnittssökning; kunskapsdestillering; flerspråkiga transformatorer; dokumentsökning; domänlöst frågebesvarande;

    Abstract : Open Domain Question Answering (OpenQA) is a task concerning automatically finding answers to a query from a given set of documents. Language-agnostic OpenQA is an increasingly important research area in the globalised world, where the answers can be in a different language from the question. READ MORE

  4. 3. Task-agnostic knowledge distillation of mBERT to Swedish

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Added Kina; [2022]
    Keywords : Natural Language Processing; Transformers; Knowledge Distillation; BERT; Multilingual Models; Cross-Lingual Transfer; Naturlig bearbetning av språk; Transformatorer; Kunskapsdestillation; BERT; Flerspråkiga modeller; Tvärspråklig inlärningsöverföring;

    Abstract : Large transformer models have shown great performance in multiple natural language processing tasks. However, slow inference, strong dependency on powerful hardware, and large energy consumption limit their availability. READ MORE

  5. 4. Classifying and Comparing Latent Space Representation of Unstructured Log Data.

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Bharat Sharma; [2021]
    Keywords : Machine learning; Natural language processing; Deep learning; Classification; Supervised learning; Transformer models; Sentence embeddings; Doc2Vec; Deep averaging networks.; Maskininlärning; naturligtspråkbehandling; djupinlärning; klassificering; övervakad inlärning; transformeringsmodeller; meningsinbäddningar; Doc2Vec; djupa linjärkombinerande nätverk.;

    Abstract : This thesis explores and compares various methods for producing vector representation of unstructured log data. Ericsson wanted to investigate machine learning methods to analyze logs produced by their systems to reduce the cost and effort required for manual log analysis. READ MORE

  6. 5. Explainable Antibiotics Prescriptions in NLP with Transformer Models

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Omar Emilio Contreras Zaragoza; [2021]
    Keywords : Transformer models; NLP; Explainable AI; Medical domain; Antibiotics prescription; SHAP; Integrated Gradients; Transformatormodeller; NLP; förklarbar AI; medicinsk domän; antibiotikarecept; SHAP; Integrated Gradients;

    Abstract : The overprescription of antibiotics has resulted in bacteria resistance, which is considered a global threat to global health. Deciding if antibiotics should be prescribed or not from individual visits of patients’ medical records in Swedish can be considered a text classification task, one of the applications of Natural Language Processing (NLP). READ MORE