Essays about: "multimodal fusion"

Showing result 1 - 5 of 18 essays containing the words multimodal fusion.

  1. 1. Where to Fuse

    University essay from Lunds universitet/Matematisk statistik

    Author : Lukas Petersson; [2024]
    Keywords : Technology and Engineering;

    Abstract : This thesis investigates fusion techniques in multimodal transformer models, focusing on enhancing the capabilities of large language models in understanding not just text, but also other modalities like images, audio, and sensor data. The study compares late fusion (concatenating modality tokens after separate encoding) and early fusion (concatenating before encoding) techniques, examining their respective advantages and disadvantages. READ MORE

  3. 2. Movement Estimation with SLAM through Multimodal Sensor Fusion

    University essay from Linköpings universitet/Medie- och Informationsteknik; Linköpings universitet/Tekniska fakulteten

    Author : Jimmy Cedervall Lamin; [2024]
    Keywords : slam; discrete-slam; continuous-slam; synchronous; asynchronous; computer vision; BRISK; opencv; ceres; visual; inertial; sensor fusion; multimodal; Simultaneous Localization and Mapping; time offset; pose estimation; quaternions; movement estimation;

    Abstract : In the field of robotics and self-navigation, Simultaneous Localization and Mapping (SLAM) is a technique crucial for estimating poses while concurrently creating a map of the environment. Robotics applications often rely on various sensors for pose estimation, including cameras, inertial measurement units (IMUs), and more. READ MORE

  4. 3. Classifying femur fractures using federated learning

    University essay from Linköpings universitet/Statistik och maskininlärning

    Author : Hong Zhang; [2024]
    Keywords : Atypical femur fracture; Federated Learning; Neural Network; Classification;

    Abstract : The rarity and subtle radiographic features of atypical femoral fractures (AFF) make it difficult to distinguish radiologically from normal femoral fractures (NFF). Compared with NFF, AFF has subtle radiological features and is associated with the long-term use of bisphosphonates for the treatment of osteoporosis. READ MORE

  5. 4. Building Information Modeling Connection Recommendation Based on Machine Learning Using Multimodal Information

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Zixin Zhou; [2023]
    Keywords : Building information modeling; Tekla Structures; Connection; Classification; Machine learning; Multimodal data fusion;

    Abstract : Den ökande komplexiteten i byggprojekt ger upphov till behovet av ett effektivt sätt att designa, hantera och underhålla strukturer. Byggnadsinformationsmodellering (BIM) underlättar dessa processer genom att tillhandahålla en digital representation av fysiska strukturer. READ MORE

  6. 5. Robust Multi-Modal Fusion for 3D Object Detection : Using multiple sensors of different types to robustly detect, classify, and position objects in three dimensions.

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Viktor Kårefjärd; [2023]
    Keywords : Computer Vision; 3D Object Detection; Multi-Modal Fusion; Deep Learning; Datorseenden; 3D-objektdetektion; Multimodal fusion; Djupinlärning;

    Abstract : The computer vision task of 3D object detection is fundamentally necessary for autonomous driving perception systems. These vehicles typically feature a multitude of sensors, such as cameras, radars, and light detection and ranging sensors. READ MORE