Essays about: "Transformer architecture"
Showing result 1 - 5 of 51 essays containing the words Transformer architecture.
-
1. Transforming Chess: Investigating Decoder-Only Architecture for Generating Realistic Game-Like Positions
University essay from Umeå universitet/Institutionen för datavetenskapAbstract : Chess is a deep and intricate game, the master of which depends on learning tens of thousands of the patterns that may occur on the board. At Noctie, their mission is to aid this learning process through humanlike chess AI. A prominent challenge lies in curating instructive chess positions for students. READ MORE
-
2. Key Sentence Extraction From CRISPR-Cas9 Articles Using Sentence Transformers
University essay from Göteborgs universitet/Institutionen för data- och informationsteknikAbstract : The annotation of CRISPR-related articles and extraction of key content has traditionally relied on manual efforts. Manual annotation is error-prone and timeconsuming. This thesis presents an alternative approach using transfer learning and pre-trained models based on the Transformer architecture. READ MORE
-
3. Approximating Reasoning with Transformer Language Models
University essay from Göteborgs universitet/Institutionen för data- och informationsteknikAbstract : We conduct experiments with BART, a generative language-model architecture, to investigate its capabilities for approximating reasoning by learning from data. For this we use the SimpleLogic dataset, a dataset of satisfiability problems in propositional logic originally created by Zhang et al. (2022). READ MORE
-
4. Few-Shot Learning for Quality Inspection
University essay from Högskolan i Halmstad/Akademin för informationsteknologiAbstract : The goal of this project is to find a suitable Few-Shot Learning (FSL) model that can be used in a fault detection system for use in an industrial setting. A dataset of Printed Circuit Board (PCB) images has been created to train different FSL models. READ MORE
-
5. A lightweight deep learning architecture for text embedding : Comparison between the usage of Transformers and Mixers for textual embedding
University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)Abstract : Text embedding is a widely used method for comparing pieces of text together by mapping them to a compact vector space. One such application is deduplication which consists in finding textual records that refer to the same underlying idea in order to merge them or delete one of them. READ MORE
