Essays about: "multimodal interaction"

Showing result 1 - 5 of 42 essays containing the words multimodal interaction.

1. 1. The Effectiveness of a Web-Based Multimodal Interactive Story on Upper-Secondary Students' Reading Comprehension in English

   University essay from Malmö universitet/Institutionen för kultur, språk och medier (KSM)

   Author : Dakota Lagercrantz; [2024]
   Keywords : Multimodal; Interactive Story; Literature; Education; Pedagogy; English; ESL;

   Abstract : The current study investigates the effectiveness of a multimodal interactive story, student use and perceptions of the interactive story, and one teacher’s beliefs regarding the use of multimodal resources in upper-secondary L2 literature education. The study aims to draw conclusions on the potential effectiveness of the tool, student interaction behaviour with interactive story, student perceptions on the tool, and teacher receptibility toward new multimodal tools. READ MORE

3. 2. Unleashing the Power of AI Mobile Robots: A Journey into CognitiveLoad, Multimodal Signalling, and Trust in Multi-Robot Team

   University essay from Umeå universitet/Institutionen för datavetenskap

   Author : Madeleine Englund; [2023]
   Keywords : ;

   Abstract : This Master's thesis examines the impact of multimodal signalling on cognitive load, trust, and usability in multi-robot teams using a within-subjects design. The study investigates whether feedback through multimodal signalling effectively conveys trust and minimises cognitive load for operators. READ MORE

4. 3. Real-time visual feedback of emotional expression in singing

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Xuehua Fu; [2023]
   Keywords : Sound and Music Computing; Music Visualization; Cross-modal Feedback; Mapping; Music Expressivity; Multimodal Interaction; Ljud-och musikberäkning; Musikvisualisering; Korsmodal återkoppling; Kartläggning; Musikexpressivitet; Multimodal interaktion;

   Abstract : The thesis project concerns the development and evaluation of a real-time music visualization system aimed at creating a multi-modal perceptual experience of music emotions. The purpose of the project is to provide singers with real-time visual feedback on their singing, to enhance their expression of emotions in the music. READ MORE

5. 4. Bilingualism in Multimodal Language Processing: A priming study on processing of gestures in English temporal expressions

   University essay from Lunds universitet/Kognitionsvetenskap

   Author : Sonja Holmer; [2023]
   Keywords : bilingualism; multimodal language processing; gesture; abstract language; integrated systems hypothesis; Philosophy and Religion; Languages and Literatures;

   Abstract : At its core, language is multimodal (Kendon, 1986; McNeill, 1994), and information presented through different channels of information, such as visually, in the shape of gestures, or verbally, in the shape of speech or signs, together facilitate online language processing (Kelly, Healey, Özyürek, & Holler, 2015; Kelly, Özyürek, & Maris, 2010). This thesis extends previous studies on multimodal processing (Kelly et al. READ MORE

6. 5. Hierarchical Fusion Approaches for Enhancing Multimodal Emotion Recognition in Dialogue-Based Systems : A Systematic Study of Multimodal Emotion Recognition Fusion Strategy

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Yuqi Liu; [2023]
   Keywords : Multimodal; emotion recognition; hierarchical fusion; context modeling; attention mechanism; feature-level fusion; decision-level fusion; machine learning; deep learning; Multimodal; emotion recognition; hierarkisk fusion; kontextmodellering; uppmärksamhetsmekanism; funktionssammanfogning på nivån för egenskaper; beslutsnivås-funktionssammanfogning; maskininlärning; djupinlärning;

   Abstract : Multimodal Emotion Recognition (MER) has gained increasing attention due to its exceptional performance. In this thesis, we evaluate feature-level fusion, decision-level fusion, and two proposed hierarchical fusion methods for MER systems using a dialogue-based dataset. READ MORE