Essays about: "Multimodal data fusion"

Showing result 1 - 5 of 15 essays containing the words Multimodal data fusion.

  1. 1. Where to Fuse

    University essay from Lunds universitet/Matematisk statistik

    Author : Lukas Petersson; [2024]
    Keywords : Technology and Engineering;

    Abstract : This thesis investigates fusion techniques in multimodal transformer models, focusing on enhancing the capabilities of large language models in understanding not just text, but also other modalities like images, audio, and sensor data. The study compares late fusion (concatenating modality tokens after separate encoding) and early fusion (concatenating before encoding) techniques, examining their respective advantages and disadvantages. READ MORE

  3. 2. Classifying femur fractures using federated learning

    University essay from Linköpings universitet/Statistik och maskininlärning

    Author : Hong Zhang; [2024]
    Keywords : Atypical femur fracture; Federated Learning; Neural Network; Classification;

    Abstract : The rarity and subtle radiographic features of atypical femoral fractures (AFF) make it difficult to distinguish radiologically from normal femoral fractures (NFF). Compared with NFF, AFF has subtle radiological features and is associated with the long-term use of bisphosphonates for the treatment of osteoporosis. READ MORE

  4. 3. Building Information Modeling Connection Recommendation Based on Machine Learning Using Multimodal Information

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Zixin Zhou; [2023]
    Keywords : Building information modeling; Tekla Structures; Connection; Classification; Machine learning; Multimodal data fusion;

    Abstract : Den ökande komplexiteten i byggprojekt ger upphov till behovet av ett effektivt sätt att designa, hantera och underhålla strukturer. Byggnadsinformationsmodellering (BIM) underlättar dessa processer genom att tillhandahålla en digital representation av fysiska strukturer. READ MORE

  5. 4. Robust Multi-Modal Fusion for 3D Object Detection : Using multiple sensors of different types to robustly detect, classify, and position objects in three dimensions.

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Viktor Kårefjärd; [2023]
    Keywords : Computer Vision; 3D Object Detection; Multi-Modal Fusion; Deep Learning; Datorseenden; 3D-objektdetektion; Multimodal fusion; Djupinlärning;

    Abstract : The computer vision task of 3D object detection is fundamentally necessary for autonomous driving perception systems. These vehicles typically feature a multitude of sensors, such as cameras, radars, and light detection and ranging sensors. READ MORE

  6. 5. Land Use/Land Cover Classification From Satellite Remote Sensing Images Over Urban Areas in Sweden : An Investigative Multiclass, Multimodal and Spectral Transformation, Deep Learning Semantic Image Segmentation Study

    University essay from Linköpings universitet/Institutionen för datavetenskap

    Author : Oskar Aidantausta; Patrick Asman; [2023]
    Keywords : data fusion; deep learning; land use land cover classification; multiclass; multimodal; remote sensing; semantic segmentation; Sentinel satellite; spectral index; U-Net; Urban Atlas;

    Abstract : Remote Sensing (RS) technology provides valuable information about Earth by enabling an overview of the planet from above, making it a much-needed resource for many applications. Given the abundance of RS data and continued urbanisation, there is a need for efficient approaches to leverage RS data and its unique characteristics for the assessment and management of urban areas. READ MORE