Essays about: "Self-Attention"

Showing result 1 - 5 of 15 essays containing the word Self-Attention.

  1. 1. Comparison of VADER and Pre-Trained RoBERTa: A Sentiment Analysis Application

    University essay from Lunds universitet/Statistiska institutionen

    Author : Linda Erwe; Xin Wang; [2024]
    Keywords : sentiment analysis; natural language processing; BERT; VADER; sustainability report; Mathematics and Statistics;

    Abstract : Purpose: The purpose of this study is to examine how the overall sentiment results from VADER and a pre-trained RoBERTa model differ. The study investigates potential differences in terms of the median and shape of the two distributions. Data: The sustainability reports of 50 independent random companies are selected as the sample. READ MORE

  3. 2. Using Machine Learning to Optimize Near-Earth Object Sighting Data at the Golden Ears Observatory

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Laura Murphy; [2023]
    Keywords : Near-Earth Object Detection; Machine Learning; Deep Learning; Visual Transformers;

    Abstract : This research project focuses on improving Near-Earth Object (NEO) detection using advanced machine learning techniques, particularly Vision Transformers (ViTs). The study addresses challenges such as noise, limited data, and class imbalance. READ MORE

  4. 3. Evaluating Text Summarization Models on Resumes : Investigating the Quality of Generated Resume Summaries and their Suitability as Resume Introductions

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Amanda Krohn; [2023]
    Keywords : Natural language processing; Abstractive text summarization; Transformer architecture; Fine-tuning; Resumes; Språkteknologi; Abstrakt textsammanfattning; Transformer-arkitektur; Finjustering; CV;

    Abstract : This thesis aims to evaluate different abstractive text summarization models and techniques for summarizing resumes. It has two main objectives: investigate the models’ performance on resume summarization and assess the suitability of the generated summaries as resume introductions. READ MORE

  5. 4. Graph Neural Network for Traffic Flow Forecasting : Does an enriched adjacency matrix with low dimensional dataenhance the performance of GNN for traffic flow forecasting?

    University essay from Högskolan i Halmstad/Akademin för informationsteknologi

    Author : Fredrik Kortetjärvi; Rohullah Khorami; [2023]
    Keywords : Graph Neural Network;

    Abstract : Nowadays, machine learning methods are used in many applications and deployed in manyelectronic devices to solve problems and predict future states. One of the challenges mostbig cities confront is traffic jams since the roads are crammed with more and more vehicles, which will easily cause traffic congestion. READ MORE

  6. 5. Model of detection of phishing URLsbased on machine learning

    University essay from Blekinge Tekniska Högskola/Institutionen för datavetenskap

    Author : Kateryna Burbela; [2023]
    Keywords : Phishing; URL address; Deep learning; Convolutional layer; Multi-head self-attention.;

    Abstract : Background: Phishing attacks continue to pose a significant threat to internetsecurity. One of the most common forms of phishing is through URLs, whereattackers disguise malicious URLs as legitimate ones to trick users into clickingon them. READ MORE