Essays about: "Transformer"

Showing result 1 - 5 of 373 essays containing the word Transformer.

  1. 1. Automated product categorization using transformer models

    University essay from Lunds universitet/Institutionen för datavetenskap

    Author : Joel Bäcker; Victor Winkelmann; [2024]
    Keywords : Technology and Engineering;

    Abstract : .... READ MORE

  3. 2. Where to Fuse

    University essay from Lunds universitet/Matematisk statistik

    Author : Lukas Petersson; [2024]
    Keywords : Technology and Engineering;

    Abstract : This thesis investigates fusion techniques in multimodal transformer models, focusing on enhancing the capabilities of large language models in understanding not just text, but also other modalities like images, audio, and sensor data. The study compares late fusion (concatenating modality tokens after separate encoding) and early fusion (concatenating before encoding) techniques, examining their respective advantages and disadvantages. READ MORE

  4. 3. A Comparative Analysis of Whisper and VoxRex on Swedish Speech Data

    University essay from Uppsala universitet/Statistiska institutionen

    Author : Max Fredriksson; Elise Ramsay Veljanovska; [2024]
    Keywords : ASR; Automatic Speech Recognition; Swedish Speech Recognition; Speech Recognition Models; Speech-to-Text; Whisper; VoxRex; Wav2Vec; Model Comparison; Transformer Models; Neural Networks; Machine Learning; WER; Word Error Rate; Transcription;

    Abstract : With the constant development of more advanced speech recognition models, the need to determine which models are better in specific areas and for specific purposes becomes increasingly crucial. Even more so for low-resource languages such as Swedish, dependent on the progress of models for the large international languages. READ MORE

  5. 4. Transforming Chess: Investigating Decoder-Only Architecture for Generating Realistic Game-Like Positions

    University essay from Umeå universitet/Institutionen för datavetenskap

    Author : William Pettersson; [2024]
    Keywords : Transformer; Decoder; Decoder-only; AI; Artificial intelligence; Generating; generative model; Chess;

    Abstract : Chess is a deep and intricate game, the master of which depends on learning tens of thousands of the patterns that may occur on the board. At Noctie, their mission is to aid this learning process through humanlike chess AI. A prominent challenge lies in curating instructive chess positions for students. READ MORE

  6. 5. Inductive fast charging of IoT devices : An in-depth analysis of short-range wireless charging technologies based on induction

    University essay from Umeå universitet/Institutionen för fysik

    Author : Franz Wikner; [2024]
    Keywords : Electromagnetic power transfer; Inductive power transfer; Short distance WPT;

    Abstract : In the era of Internet of things (IoT), sensor-equipped devices exchange data over networks. In battery powered IoT devices, the lifespan of the devices is often much longer than the battery life, leading to multiple costly and environmentally hazardous battery replacements during the operational life of the devices. READ MORE