Essays about: "Input modalities"

Showing result 1 - 5 of 21 essays containing the words Input modalities.

  1. 1. Where to Fuse

    University essay from Lunds universitet/Matematisk statistik

    Author : Lukas Petersson; [2024]
    Keywords : Technology and Engineering;

    Abstract : This thesis investigates fusion techniques in multimodal transformer models, focusing on enhancing the capabilities of large language models in understanding not just text, but also other modalities like images, audio, and sensor data. The study compares late fusion (concatenating modality tokens after separate encoding) and early fusion (concatenating before encoding) techniques, examining their respective advantages and disadvantages. READ MORE

  3. 2. 3D Object Manipulation in Volumetric Video Production

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Xinyi Wang; [2023]
    Keywords : Volumetric Video Production; Holographic Communication; Digital Human with 3D Object Manipulation; Human-Computer Interaction; Volumetrisk videoproduktion; holografisk kommunikation; digital människa med 3D-objektmanipulation; människadatorinteraktion;

    Abstract : Remote communication methods have been changing these years and becoming even more important due to the global pandemic. Holographic communication, often represented by volumetric video, is one of the emerging communication methods. Unfortunately, there are few researches on combining 3D objects with volumetric videos. READ MORE

  4. 3. AI-assisted Image Manipulation with Eye Tracking

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Rej Karlander; Julia Wang; [2023]
    Keywords : Human-computer interaction; Accessibility; Assistive technologies; Eye tracking; Input modalities; Image editing; Generative models; Människa–datorinteraktion; Tillgänglighet; Eye Tracking; Inmatningsenheter; Bildredigering; Maskininlärningsmodeller;

    Abstract : Image editing tools can pose a challenge for motor impaired individuals who wish to perform image manipulation. The process includes many steps and can be difficult given a lack of tactile input such as mouse and keyboard. READ MORE

  5. 4. Avatar Control using Eye-Tracking in Virtual Reality : A user study on the sense of embodiment, user experience and workload using a Unity3D Prototype

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Axel Goris; [2023]
    Keywords : Virtual Reality; Avatar Embodiment; Eye Tracking; User Experience; Accessibility; Virtuell Verklighet; Avatar förkroppsligande; Ögonspårning; Användarupplevelse; Tillgänglighet;

    Abstract : This master’s thesis investigates methods for improving accessibility in virtual reality (VR), focusing on avatar control for individuals with limited mobility. VR offers an opportunity to help them with specific rehabilitation. READ MORE

  6. 5. Large-scale transfer of lesion segmentations from PET to CT

    University essay from Uppsala universitet/Institutionen för informationsteknologi

    Author : Taeyang Choi; [2023]
    Keywords : ;

    Abstract : The introduction of AI technology has sparked a revolutionary lesion segmentation solution to address challenges in the medical field. After extensive research, the competencies of this technology have been verified. READ MORE