Essays about: "pre-trained language models"

Showing result 1 - 5 of 99 essays containing the words pre-trained language models.

1. 1. An In-Depth study on the Utilization of Large Language Models for Test Case Generation

   University essay from Umeå universitet/Institutionen för datavetenskap

   Author : Nicole Johnsson; [2024]
   Keywords : Large Language Models; Test Case Generation; Retrieval Augmented Generation; Machine Learning; Generative AI;

   Abstract : This study investigates the utilization of Large Language Models for Test Case Generation. The study uses the Large Language model and Embedding model provided by Llama, specifically Llama2 of size 7B, to generate test cases given a defined input. READ MORE

3. 2. Self-Supervised Learning for Tabular Data: Analysing VIME and introducing Mix Encoder

   University essay from Lunds universitet/Fysiska institutionen

   Author : Max Svensson; [2024]
   Keywords : Machine Learning; Self-supervised learning; AI; Physics; Medicine; Physics and Astronomy;

   Abstract : We introduce Mix Encoder, a novel self-supervised learning framework for deep tabular data models based on Mixup [1]. Mix Encoder uses linear interpolations of samples with associated pretext tasks to form useful pre-trained representations. READ MORE

4. 3. Nested Noun Phrase Detection in English Text with BERT

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Shweta Misra; [2023]
   Keywords : Phrase detection; nested noun phrase identification; phrase structure identification; sentence parsing; transformer models; machine learning; natural language processing; Frasdetektering; kapslad substantivfrasidentifiering; frasstrukturidentifiering; meningsanalys; transformers-modeller; maskininlärning; naturlig språkbehandling;

   Abstract : In this project, we address the task of nested noun phrase identification in English sentences, where a phrase is defined as a group of words functioning as one unit in a sentence. Prior research has extensively explored the identification of various phrases for language understanding and text generation tasks. READ MORE

5. 4. Information Extraction for Test Identification in Repair Reports in the Automotive Domain

   University essay from Uppsala universitet/Institutionen för lingvistik och filologi

   Author : Huang Jie; [2023]
   Keywords : text classification; information retrieval; contrastive learning; prompt-based fine-tuning; large language models;

   Abstract : The knowledge of tests conducted on a problematic vehicle is essential for enhancing the efficiency of mechanics. Therefore, identifying the tests performed in each repair case is of utmost importance. This thesis explores techniques for extracting data from unstructured repair reports to identify component tests. READ MORE

6. 5. Round-Trip Translation : A New Path for Automatic Program Repair using Large Language Models

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Fernando Vallecillos Ruiz; [2023]
   Keywords : Automatic Program Repair; Software Engineering; Large Language Models; Round-Trip Translation; Neural Machine Translation; Automatisk programreparation; Mjukvaruutveckling; Stora språkmodeller; Tur och retur-översättning; Neural maskinöversättning;

   Abstract : Research shows that grammatical mistakes in a sentence can be corrected by machine translating it to another language and back. We investigate whether this correction capability of Large Language Models (LLMs) extends to Automatic Program Repair (APR), a software engineering task. READ MORE