Essays about: "T5"

Showing result 1 - 5 of 22 essays containing the word T5.

1. 1. Where to Fuse

   University essay from Lunds universitet/Matematisk statistik

   Author : Lukas Petersson; [2024]
   Keywords : Technology and Engineering;

   Abstract : This thesis investigates fusion techniques in multimodal transformer models, focusing on enhancing the capabilities of large language models in understanding not just text, but also other modalities like images, audio, and sensor data. The study compares late fusion (concatenating modality tokens after separate encoding) and early fusion (concatenating before encoding) techniques, examining their respective advantages and disadvantages. READ MORE

3. 2. Automatic Semantic Role Labelling (SRL) in Swedish

   University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

   Author : Lucy Yang Buhr; [2023-10-05]
   Keywords : Semantic role labelling; SRL; transfer learning; multi-task learning; multilingual transfer; T5; mT5;

   Abstract : In this paper, using deep learning networks, the first end-to-end semantic role labelling model (SRL) has been developed for Swedish texts. This Swedish SRL model can, with a given Swedish sentence, perform trigger identification, frame classification and argument extraction tasks automatically in a series. READ MORE

4. 3. Text to Music Audio Generation using Latent Diffusion Model : A re-engineering of AudioLDM Model

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Ernan Wang; [2023]
   Keywords : Text to Music Audio Generation; Latent Diffusion; AudioLDM; Sampling Methods; Denoising Diffusion Probabilistic Model DDPM ; Denoising Diffusion Implicit Model DDIM ; Text till musik Ljudgenerering; Latent Diffusion; AudioLDM; Samplingsmetoder; DDPM; DDIM;

   Abstract : In the emerging field of audio generation using diffusion models, this project pioneers the adaptation of the AudioLDM model framework, initially designed for text-to-daily sounds generation, towards text-to-music audio generation. This shift addresses a gap in the current scope of audio diffusion models, predominantly focused on everyday sounds. READ MORE

5. 4. Prompt-learning and Zero-shot Text Classification with Domain-specific Textual Data

   University essay from Uppsala universitet/Institutionen för lingvistik och filologi

   Author : Hengyu Luo; [2023]
   Keywords : prompt-learning; zero-shot; few-shot; text classification; domain-specific; retail sector domain; customer-agent interaction; transformer; large language models; ChatGPT; natural language processing; machine learning; deep learning;

   Abstract : The rapid growth of textual data in the digital age presents unique challenges in domain-specific text classification, particularly the scarcity of labeled data for many applications, due to expensive cost of manual labeling work. In this thesis, we explore the applicability of prompt-learning method, which is well-known for being suitable in few-shot scenarios and much less data-consuming, as an emerging alternative to traditional fine-tuning methods, for domain-specific text classification in the context of customer-agent interactions in the retail sector. READ MORE

6. 5. Evaluating Text Summarization Models on Resumes : Investigating the Quality of Generated Resume Summaries and their Suitability as Resume Introductions

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Amanda Krohn; [2023]
   Keywords : Natural language processing; Abstractive text summarization; Transformer architecture; Fine-tuning; Resumes; Språkteknologi; Abstrakt textsammanfattning; Transformer-arkitektur; Finjustering; CV;

   Abstract : This thesis aims to evaluate different abstractive text summarization models and techniques for summarizing resumes. It has two main objectives: investigate the models’ performance on resume summarization and assess the suitability of the generated summaries as resume introductions. READ MORE