Essays about: "Efficient Transformers"

Showing result 1 - 5 of 24 essays containing the words Efficient Transformers.

  1. 1. Operational resilience strategies in times of global disruptions : A study of a Swedish national energy company

    University essay from KTH/Skolan för industriell teknik och management (ITM)

    Author : Gustav Lindstrand; Anna Oldestam; [2023]
    Keywords : operational resilience; procurement strategy; supply chain disruptions.; operational resilience; inköpsstrategi; supply chain disruptions.;

    Abstract : This study investigates strategies for improving the operational resilience, i.e. an organisation’s capacity to minimise, manage, and recover from disruptions quickly, ensuring continuity in its primary business processes. READ MORE

  3. 2. Efficient Utilization of Video Embeddings from Video-Language Models

    University essay from Linköpings universitet/Datorseende

    Author : Felix Lindgren; [2023]
    Keywords : VLM; CLIP; transformers; machine learning; video retrieval; activitynet; efficient training; aggregation;

    Abstract : In the digital age where video content is abundant, this thesis investigates the efficient adaptation of an existing video-language model (VLM) to new data. The research leverages CLIP, a robust language-vision model, for various video-related tasks including video retrieval. READ MORE

  4. 3. Harnessing AI for Suicidal Ideation Detection: Thoroughly Evaluating and Fine-Tuning Transformer Models to Identify Suicidal Ideation in Social Media Posts

    University essay from Lunds universitet/Nationalekonomiska institutionen; Lunds universitet/Statistiska institutionen

    Author : Johannes Altnäs; Keshav Sompura; [2023]
    Keywords : suicidal ideation; transformers; mental health; BERT; social media; Business and Economics;

    Abstract : This thesis explored the application of pre-trained transformer models in detecting suicidal ideation in social media posts. We leveraged social media data from platforms like Reddit and Twitter and applied a robust hyperparameter random search strategy to fine-tune and evaluate existing transformer models. READ MORE

  5. 4. 3D Gaze Estimation on Near Infrared Images Using Vision Transformers

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Emil Emir Vardar; [2023]
    Keywords : Gaze estimation; Eye tracking; Vision Transformers ViTs ; Hybrid ViTs; Deep learning; Near-infrared NIR images; Ögonblicksuppskattning; Blickspårning; Vision Transformers ViTs ; Hybrida ViTs; Djupinlärning; Nära-infraröda NIR bilder;

    Abstract : Gaze estimation is the process of determining where a person is looking, which has recently become a popular research area due to its broad range of applications. For example, tools that estimate gaze are used for research, medical diagnosis, virtual and augmented reality, driver assistance system, and many more. READ MORE

  6. 5. Convolution- compacted vision transformers for prediction of local wall heat flux at multiple Prandtl numbers in turbulent channel flow

    University essay from KTH/Skolan för teknikvetenskap (SCI)

    Author : Yuning Wang; [2023]
    Keywords : Turbulent flow; Heat transfer; Vision transformer; Convolutional neural network; Machine learning;

    Abstract : Predicting wall heat flux accurately in wall-bounded turbulent flows is critical fora variety of engineering applications, including thermal management systems andenergy-efficient designs. Traditional methods, which rely on expensive numericalsimulations, are hampered by increasing complexity and extremly high computationcost. READ MORE