Essays about: "Transformer models"

Showing result 1 - 5 of 197 essays containing the words Transformer models.

  1. 1. Automated product categorization using transformer models

    University essay from Lunds universitet/Institutionen för datavetenskap

    Author : Joel Bäcker; Victor Winkelmann; [2024]
    Keywords : Technology and Engineering;

    Abstract : .... READ MORE

  3. 2. Where to Fuse

    University essay from Lunds universitet/Matematisk statistik

    Author : Lukas Petersson; [2024]
    Keywords : Technology and Engineering;

    Abstract : This thesis investigates fusion techniques in multimodal transformer models, focusing on enhancing the capabilities of large language models in understanding not just text, but also other modalities like images, audio, and sensor data. The study compares late fusion (concatenating modality tokens after separate encoding) and early fusion (concatenating before encoding) techniques, examining their respective advantages and disadvantages. READ MORE

  4. 3. A Comparative Analysis of Whisper and VoxRex on Swedish Speech Data

    University essay from Uppsala universitet/Statistiska institutionen

    Author : Max Fredriksson; Elise Ramsay Veljanovska; [2024]
    Keywords : ASR; Automatic Speech Recognition; Swedish Speech Recognition; Speech Recognition Models; Speech-to-Text; Whisper; VoxRex; Wav2Vec; Model Comparison; Transformer Models; Neural Networks; Machine Learning; WER; Word Error Rate; Transcription;

    Abstract : With the constant development of more advanced speech recognition models, the need to determine which models are better in specific areas and for specific purposes becomes increasingly crucial. Even more so for low-resource languages such as Swedish, dependent on the progress of models for the large international languages. READ MORE

  5. 4. Transforming Chess: Investigating Decoder-Only Architecture for Generating Realistic Game-Like Positions

    University essay from Umeå universitet/Institutionen för datavetenskap

    Author : William Pettersson; [2024]
    Keywords : Transformer; Decoder; Decoder-only; AI; Artificial intelligence; Generating; generative model; Chess;

    Abstract : Chess is a deep and intricate game, the master of which depends on learning tens of thousands of the patterns that may occur on the board. At Noctie, their mission is to aid this learning process through humanlike chess AI. A prominent challenge lies in curating instructive chess positions for students. READ MORE

  6. 5. Predicting Navigational Patterns in Web Applications using Machine Learning Techniques

    University essay from Lunds universitet/Institutionen för reglerteknik

    Author : Patric Balan; Gustav Jönemo; [2024]
    Keywords : Technology and Engineering;

    Abstract : In large corporations, customer support is a costly service, and an area of constant optimization. Solutions to increase efficiency and decrease bottlenecks are constantly needed. READ MORE