Essays about: "Multimodal Machine Learning"

Showing result 6 - 10 of 25 essays containing the words Multimodal Machine Learning.

  1. 6. Playstyle Generation with Multimodal Generative Adversarial Imitation Learning : Style-reward from Human Demonstration for Playtesting Agents

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : William Ahlberg; [2023]
    Keywords : Imitation Learning; Reinforcement Learning; Game-testing; Imitationsinlärning; Förstärkande inlärning; Speltestning;

    Abstract : Playtesting plays a crucial role in video game production. The presence of gameplay issues and faulty design choices can be of great detriment to the overall player experience. READ MORE

  3. 7. Messing With The Gap: On The Modality Gap Phenomenon In Multimodal Contrastive Representation Learning

    University essay from Uppsala universitet/Industriell teknik

    Author : Mohammad Al-Jaff; [2023]
    Keywords : Multimodal machine learning; Representation learning; Self-supervised learning; contrastive learning; computer vision; computational biology; bioinformatics;

    Abstract : In machine learning, a sub-field of computer science, a two-tower architecture model is a specialised type of neural network model that encodes paired data from different modalities (like text and images, sound and video, or proteomics and gene expression profiles) into a shared latent representation space. However, when training these models using a specific contrastive loss function, known as the multimodalinfoNCE loss, seems to often lead to a unique geometric phenomenon known as the modality gap. READ MORE

  4. 8. Hierarchical Fusion Approaches for Enhancing Multimodal Emotion Recognition in Dialogue-Based Systems : A Systematic Study of Multimodal Emotion Recognition Fusion Strategy

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Yuqi Liu; [2023]
    Keywords : Multimodal; emotion recognition; hierarchical fusion; context modeling; attention mechanism; feature-level fusion; decision-level fusion; machine learning; deep learning; Multimodal; emotion recognition; hierarkisk fusion; kontextmodellering; uppmärksamhetsmekanism; funktionssammanfogning på nivån för egenskaper; beslutsnivås-funktionssammanfogning; maskininlärning; djupinlärning;

    Abstract : Multimodal Emotion Recognition (MER) has gained increasing attention due to its exceptional performance. In this thesis, we evaluate feature-level fusion, decision-level fusion, and two proposed hierarchical fusion methods for MER systems using a dialogue-based dataset. READ MORE

  5. 9. Duplicate detection of multimodal and domain-specific trouble reports when having few samples : An evaluation of models using natural language processing, machine learning, and Siamese networks pre-trained on automatically labeled data

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Viktor Karlstrand; [2022]
    Keywords : Duplicate detection; Bug reports; Trouble reports; Natural language processing; Information retrieval; Machine learning; Siamese neural network; Transformers; Automated data labeling; Shapley values; Dubblettdetektering; Felrapporter; Buggrapporter; Naturlig språkbehandling; Informationssökning; Maskininlärning; Siamesiska neurala nätverk; Transformatorer; Automatiserad datamärkning; Shapley-värden;

    Abstract : Trouble and bug reports are essential in software maintenance and for identifying faults—a challenging and time-consuming task. In cases when the fault and reports are similar or identical to previous and already resolved ones, the effort can be reduced significantly making the prospect of automatically detecting duplicates very compelling. READ MORE

  6. 10. Pediatric Brain Tumor Type Classification in MR Images Using Deep Learning

    University essay from Linköpings universitet/Institutionen för medicinsk teknik

    Author : Tamara Bianchessi; [2022]
    Keywords : pediatric brain tumors; MR image analysis; deep learning; classification; model explainability;

    Abstract : Brain tumors present the second highest cause of death among pediatric cancers. About 60% are located in the posterior fossa region of the brain; among the most frequent types the ones considered for this project were astrocytomas, medulloblastomas, and ependymomas. READ MORE