Essays about: "Fine-Tuned BERT"

Showing result 1 - 5 of 49 essays containing the words Fine-Tuned BERT.

1. 1. Approximating Reasoning with Transformer Language Models

   University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

   Author : Daniel Enström; Viktor Kjellberg; [2023-10-19]
   Keywords : natural language processing; nlp; automated reasoning; logic; inference; machine learning; transformers; language models; BERT; BART;

   Abstract : We conduct experiments with BART, a generative language-model architecture, to investigate its capabilities for approximating reasoning by learning from data. For this we use the SimpleLogic dataset, a dataset of satisfiability problems in propositional logic originally created by Zhang et al. (2022). READ MORE

3. 2. Performance Benchmarking and Cost Analysis of Machine Learning Techniques : An Investigation into Traditional and State-Of-The-Art Models in Business Operations

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Jacob Lundgren; Sam Taheri; [2023]
   Keywords : Artificial Intelligence AI ; Machine Learning; Big Data; Natural Language Processing NLP ; Pre-Trained BERT; Fine-Tuned BERT; TF-IDF; Logistic Regression; Support Vector Machine SVM ; Cloud GPU; Operating Costs; Performance Efficiency; Business Intelligence;

   Abstract : Eftersom samhället blir allt mer datadrivet revolutionerar användningen av AI och maskininlärning sättet företag fungerar och utvecklas på. Denna studie utforskar användningen av AI, Big Data och Natural Language Processing (NLP) för att förbättra affärsverksamhet och intelligens i företag. READ MORE

4. 3. Punctuation Restoration as Post-processing Step for Swedish Language Automatic Speech Recognition

   University essay from Luleå tekniska universitet/Institutionen för system- och rymdteknik

   Author : Ishika Gupta; [2023]
   Keywords : Transformer; BERT; KB-BERT; NLP; punctuation restoration; deep learning; neural networks;

   Abstract : This thesis focuses on the Swedish language, where punctuation restoration, especially as a postprocessing step for the output of Automatic Speech Recognition (ASR) applications, needs furtherresearch. I have collaborated with NewsMachine AB, a company that provides large-scale mediamonitoring services for its clients, for which it employs ASR technology to convert spoken contentinto text. READ MORE

5. 4. Context-aware Swedish Lexical Simplification : Using pre-trained language models to propose contextually fitting synonyms

   University essay from Linköpings universitet/Institutionen för datavetenskap

   Author : Emil Graichen; [2023]
   Keywords : automatic text simplification; lexical simplification; Swedish; BERT; GPT-3; evaluation dataset; synonymy;

   Abstract : This thesis presents the development and evaluation of context-aware Lexical Simplification (LS) systems for the Swedish language. In total three versions of LS models, LäsBERT, LäsBERT-baseline, and LäsGPT, were created and evaluated on a newly constructed Swedish LS evaluation dataset. READ MORE

6. 5. Analysing the possibilities of a needs-based house configurator

   University essay from Luleå tekniska universitet/Institutionen för system- och rymdteknik

   Author : Roman Ermolaev; [2023]
   Keywords : Needs-based; Configurator; House configurator; CNN; BERT; DistilBERT; Swedish;

   Abstract : A needs-based configurator is a system or tool that assists users in customizing products based on their specific needs. This thesis investigates the challenges of obtaining data for a needs-based machine learning house configurator and identifies suitable models for its implementation. READ MORE