Essays about: "Multimodal learning"

Showing result 16 - 20 of 65 essays containing the words Multimodal learning.

  1. 16. Predicting Chronic Kidney Disease using a multimodal Machine Learning approach

    University essay from Stockholms universitet/Institutionen för data- och systemvetenskap

    Author : Aakruti Mishra; Navaneeth Puthiyandi; [2023]
    Keywords : Chronic kidney disease; Multimodal approach; ROCKET; Random Forest; XGBoost; MIMIC-III database; Data imbalance; Temporal and static modalities; Soft voting;

    Abstract : Chronic Kidney Disease (CKD) is a common and dangerous health condition that requires early detection and treatment to be effective. Current diagnostic methods are time-consuming and expensive. In this research, we hope to construct a predictive model for CKD utilizing a combination of time series and static variables for early detection of CKD. READ MORE

  2. 17. Playstyle Generation with Multimodal Generative Adversarial Imitation Learning : Style-reward from Human Demonstration for Playtesting Agents

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : William Ahlberg; [2023]
    Keywords : Imitation Learning; Reinforcement Learning; Game-testing; Imitationsinlärning; Förstärkande inlärning; Speltestning;

    Abstract : Playtesting plays a crucial role in video game production. The presence of gameplay issues and faulty design choices can be of great detriment to the overall player experience. READ MORE

  3. 18. Messing With The Gap: On The Modality Gap Phenomenon In Multimodal Contrastive Representation Learning

    University essay from Uppsala universitet/Industriell teknik

    Author : Mohammad Al-Jaff; [2023]
    Keywords : Multimodal machine learning; Representation learning; Self-supervised learning; contrastive learning; computer vision; computational biology; bioinformatics;

    Abstract : In machine learning, a sub-field of computer science, a two-tower architecture model is a specialised type of neural network model that encodes paired data from different modalities (like text and images, sound and video, or proteomics and gene expression profiles) into a shared latent representation space. However, when training these models using a specific contrastive loss function, known as the multimodalinfoNCE loss, seems to often lead to a unique geometric phenomenon known as the modality gap. READ MORE

  4. 19. Graphic Novels and Reading:The impact of reading graphic novels in theupper secondary classroom

    University essay from Malmö universitet/Institutionen för kultur, språk och medier (KSM)

    Author : Sanna Hedin; Cathrine Flymén; [2023]
    Keywords : Graphic Novel; English as a Foreign Language; Reading Motivation; Reading Comprehension; Multiliteracy; Critical Literacy;

    Abstract : According to recent reports (Dahlberg & Jarnlo, 2021), young Swedish people are amongthose who read the least number of printed books in the world. This study aims to investigatewhat current research postulates regarding how reading graphic novels may affect the readingmotivation, cultural awareness, and critical literacy, among upper secondary school students. READ MORE

  5. 20. Hierarchical Fusion Approaches for Enhancing Multimodal Emotion Recognition in Dialogue-Based Systems : A Systematic Study of Multimodal Emotion Recognition Fusion Strategy

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Yuqi Liu; [2023]
    Keywords : Multimodal; emotion recognition; hierarchical fusion; context modeling; attention mechanism; feature-level fusion; decision-level fusion; machine learning; deep learning; Multimodal; emotion recognition; hierarkisk fusion; kontextmodellering; uppmärksamhetsmekanism; funktionssammanfogning på nivån för egenskaper; beslutsnivås-funktionssammanfogning; maskininlärning; djupinlärning;

    Abstract : Multimodal Emotion Recognition (MER) has gained increasing attention due to its exceptional performance. In this thesis, we evaluate feature-level fusion, decision-level fusion, and two proposed hierarchical fusion methods for MER systems using a dialogue-based dataset. READ MORE