Essays about: "Transformer thesis"

Showing result 1 - 5 of 230 essays containing the words Transformer thesis.

  1. 1. Where to Fuse

    University essay from Lunds universitet/Matematisk statistik

    Author : Lukas Petersson; [2024]
    Keywords : Technology and Engineering;

    Abstract : This thesis investigates fusion techniques in multimodal transformer models, focusing on enhancing the capabilities of large language models in understanding not just text, but also other modalities like images, audio, and sensor data. The study compares late fusion (concatenating modality tokens after separate encoding) and early fusion (concatenating before encoding) techniques, examining their respective advantages and disadvantages. READ MORE

  2. 2. Transforming Chess: Investigating Decoder-Only Architecture for Generating Realistic Game-Like Positions

    University essay from Umeå universitet/Institutionen för datavetenskap

    Author : William Pettersson; [2024]
    Keywords : Transformer; Decoder; Decoder-only; AI; Artificial intelligence; Generating; generative model; Chess;

    Abstract : Chess is a deep and intricate game, the master of which depends on learning tens of thousands of the patterns that may occur on the board. At Noctie, their mission is to aid this learning process through humanlike chess AI. A prominent challenge lies in curating instructive chess positions for students. READ MORE

  3. 3. Predicting Navigational Patterns in Web Applications using Machine Learning Techniques

    University essay from Lunds universitet/Institutionen för reglerteknik

    Author : Patric Balan; Gustav Jönemo; [2024]
    Keywords : Technology and Engineering;

    Abstract : In large corporations, customer support is a costly service, and an area of constant optimization. Solutions to increase efficiency and decrease bottlenecks are constantly needed. READ MORE

  4. 4. Local voltage control in a low voltage grid with high photovoltaic penetration

    University essay from Lunds universitet/Institutionen för reglerteknik

    Author : Joakim Bakklund; [2024]
    Keywords : Technology and Engineering;

    Abstract : This thesis examines how active power control (Volt-Watt control) and reactive power compensation (Volt-VAr control) can help limit voltage increases on the low voltage grid due to high photovoltaic (PV), installations. Due to the large increase in interest to install small scale PV-systems within residential areas the Distribution System Operator E. READ MORE

  5. 5. Key Sentence Extraction From CRISPR-Cas9 Articles Using Sentence Transformers

    University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

    Author : Sandra Henningsson; Brage Stranden Lae; [2023-11-09]
    Keywords : NLP; Transformers; CRISPR; semantic search; keyphrase extraction;

    Abstract : The annotation of CRISPR-related articles and extraction of key content has traditionally relied on manual efforts. Manual annotation is error-prone and timeconsuming. This thesis presents an alternative approach using transfer learning and pre-trained models based on the Transformer architecture. READ MORE