Essays about: "Transformer-based architectures"

Showing result 1 - 5 of 12 essays containing the words Transformer-based architectures.

  1. 1. Comparative Analysis of Transformer and CNN Based Models for 2D Brain Tumor Segmentation

    University essay from Linköpings universitet/Institutionen för medicinsk teknik

    Author : Henrik Träff; [2023]
    Keywords : Machine Learning; ML; AI; Computer vision; Vision Transformer; Swin Transformer; U-Net; nnU-Net; Brain Tumor Segmentation; Deep Learning;

    Abstract : A brain tumor is an abnormal growth of cells within the brain, which can be categorized into primary and secondary tumor types. The most common type of primary tumors in adults are gliomas, which can be further classified into high-grade gliomas (HGGs) and low-grade gliomas (LGGs). READ MORE

  2. 2. A Transformer-Based Scoring Approach for Startup Success Prediction : Utilizing Deep Learning Architectures and Multivariate Time Series Classification to Predict Successful Companies

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Gustaf Halvardsson; [2023]
    Keywords : Machine learning; Time Series Classification; Transformers; Gated Recurrent Unit; Venture Capital; Maskininlärning; tidsseriesklassifiering; Transformer; Gated Recurrent Unit; riskkapital;

    Abstract : The Transformer, an attention-based deep learning architecture, has shown promising capabilities in both Natural Language Processing and Computer Vision. Recently, it has also been applied to time series classification, which has traditionally used statistical methods or the Gated Recurrent Unit (GRU). READ MORE

  3. 3. Self-Supervised Fine-Tuning of sentence embedding models using a Smooth Inverse Frequency model : Automatic creation of labels with Smooth Inverse Frequency model

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Vittorio Pellegrini; [2023]
    Keywords : Natural Language Processing; sentence embeddings; Transformer-based architectures; sentence paraphrasing; sentence similarity; sentence clustering; Naturlig språkbehandling; inbäddning av meningar; transformatorbaserade arkitekturer; parafrasering av meningar; meningslikhet; klustring av meningar Canvas Lärplattform; Dockerbehållare; Prestandajustering;

    Abstract : Sentence embedding models play a key role in the field of Natural Language Processing. They can be exploited for the resolution of several tasks like sentence paraphrasing, sentence similarity, and sentence clustering. READ MORE

  4. 4. Synthetic data generation for domain adaptation of a retriever-reader Question Answering system for the Telecom domain : Comparing dense embeddings with BM25 for Open Domain Question Answering

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Filip Döringer Kana; [2023]
    Keywords : Natural Language Processing; Transformers; Deep Learning; Question Answering; Data Generation; Språkteknologi; Transformers; Djupinlärning; Frågebesvaring; Datagenerering;

    Abstract : Having computer systems capable of answering questions has been a goal within Natural Language Processing research for many years. Machine Learning systems have recently become increasingly proficient at this task with large language models obtaining state-of-the-art performance. READ MORE

  5. 5. Night-time Vehicle Detection Based on Observable Light Cues Using Deep Learning

    University essay from Lunds universitet/Institutionen för reglerteknik

    Author : Celine Ivarsson; Jennifer Zacke; [2023]
    Keywords : Technology and Engineering;

    Abstract : This thesis investigates the issue of computer vision-based detection of oncoming cars during night-time, a critical road safety issue for automated high-beam assist. We propose a holistic image classification approach that uses deep learning methods to detect light artifacts from an oncoming car’s headlights before the car is entirely visible. READ MORE