Essays about: "Transformers"

Showing result 6 - 10 of 261 essays containing the word Transformers.

  1. 6. Nested Noun Phrase Detection in English Text with BERT

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Shweta Misra; [2023]
    Keywords : Phrase detection; nested noun phrase identification; phrase structure identification; sentence parsing; transformer models; machine learning; natural language processing; Frasdetektering; kapslad substantivfrasidentifiering; frasstrukturidentifiering; meningsanalys; transformers-modeller; maskininlärning; naturlig språkbehandling;

    Abstract : In this project, we address the task of nested noun phrase identification in English sentences, where a phrase is defined as a group of words functioning as one unit in a sentence. Prior research has extensively explored the identification of various phrases for language understanding and text generation tasks. READ MORE

  3. 7. Few-Shot Learning for Quality Inspection

    University essay from Högskolan i Halmstad/Akademin för informationsteknologi

    Author : Jesper Palmér; Ahmad Alsalehy; [2023]
    Keywords : Few-Shot Learning; AI; Transformers; ViT Deviation; Vision Transformers;

    Abstract : The goal of this project is to find a suitable Few-Shot Learning (FSL) model that can be used in a fault detection system for use in an industrial setting. A dataset of Printed Circuit Board (PCB) images has been created to train different FSL models. READ MORE

  4. 8. Learning Embeddings for Fashion Images

    University essay from Linköpings universitet/Datorseende

    Author : Simon Hermansson; [2023]
    Keywords : Computer Vision; Machine Learning; Image Retrieval; CLIP; Masked Autoencoders MAE ; Vision Transformers; Image Captioning; Price Prediction; AI for Fashion;

    Abstract : Today the process of sorting second-hand clothes and textiles is mostly manual. In this master’s thesis, methods for automating this process as well as improving the manual sorting process have been investigated. READ MORE

  5. 9. A lightweight deep learning architecture for text embedding : Comparison between the usage of Transformers and Mixers for textual embedding

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Corentin Royer; [2023]
    Keywords : Deep Learning; Entity Retrieval; Mixer; Transformer;

    Abstract : Text embedding is a widely used method for comparing pieces of text together by mapping them to a compact vector space. One such application is deduplication which consists in finding textual records that refer to the same underlying idea in order to merge them or delete one of them. READ MORE

  6. 10. Transformer Offline Reinforcement Learning for Downlink Link Adaptation

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Alexander Mo; [2023]
    Keywords : Link Adaptation; Transformers; Reinforcement Learning; Sequence Modelling; Decision Transformer; Deep Neural Networks; Radio Resource Management; Telecommunication; Länkanpassning; Transformers; Reinforcement Learning; Sekvensmodellering; Beslutsstöd; Djupa neurala nätverk; Dataresurshantering; Telekommunikation;

    Abstract : Recent advancements in Transformers have unlocked a new relational analysis technique for Reinforcement Learning (RL). This thesis researches the models for DownLink Link Adaptation (DLLA). READ MORE