Essays about: "Pre-trained Transformer Models"

Showing result 1 - 5 of 48 essays containing the words Pre-trained Transformer Models.

  1. 1. Key Sentence Extraction From CRISPR-Cas9 Articles Using Sentence Transformers

    University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

    Author : Sandra Henningsson; Brage Stranden Lae; [2023-11-09]
    Keywords : NLP; Transformers; CRISPR; semantic search; keyphrase extraction;

    Abstract : The annotation of CRISPR-related articles and extraction of key content has traditionally relied on manual efforts. Manual annotation is error-prone and timeconsuming. This thesis presents an alternative approach using transfer learning and pre-trained models based on the Transformer architecture. READ MORE

  3. 2. Evaluating and optimizing Transformer models for predicting chemical reactions

    University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

    Author : Siva Manohar Koki; Supriya Kancharla; [2023-10-23]
    Keywords : Chemformer; transformer; evaluation; explainable AI; fine-tuning; machine learning;

    Abstract : In this thesis, we assess the effectiveness of a transformer model specifically trained to predict chemical reactions. The model, named Chemformer, is a sequence-tosequence model that uses the transformer’s encoder and decoder stacks. READ MORE

  4. 3. Nested Noun Phrase Detection in English Text with BERT

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Shweta Misra; [2023]
    Keywords : Phrase detection; nested noun phrase identification; phrase structure identification; sentence parsing; transformer models; machine learning; natural language processing; Frasdetektering; kapslad substantivfrasidentifiering; frasstrukturidentifiering; meningsanalys; transformers-modeller; maskininlärning; naturlig språkbehandling;

    Abstract : In this project, we address the task of nested noun phrase identification in English sentences, where a phrase is defined as a group of words functioning as one unit in a sentence. Prior research has extensively explored the identification of various phrases for language understanding and text generation tasks. READ MORE

  5. 4. Artificial Intelligence-driven web development and agile project management using OpenAI API and GPT technology : A detailed report on technical integration and implementation of GPT models in CMS with API and agile web development for quality user-centered AI chat service experience

    University essay from Mittuniversitetet/Institutionen för data- och elektroteknik (2023-)

    Author : Damjan Tosic; [2023]
    Keywords : ChatGPT; OpenAI API; WordPress; artificial intelligence; web development; user interface; chat service; agile project management; prompt engineering;

    Abstract : This graduation report explores the integration of Artificial Intelligence (AI) tools, specifically OpenAI's Generative Pre-trained Transformer (GPT) technology, into web development processes using WordPress (WP) for developing a AI-driven chat service. The focus of the project is on ImagineX AB, a private company that offers the educational service ChatGPT Utbildning aimed at teaching professionals to effectively utilize ChatGPT. READ MORE

  6. 5. Performance Benchmarking and Cost Analysis of Machine Learning Techniques : An Investigation into Traditional and State-Of-The-Art Models in Business Operations

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Jacob Lundgren; Sam Taheri; [2023]
    Keywords : Artificial Intelligence AI ; Machine Learning; Big Data; Natural Language Processing NLP ; Pre-Trained BERT; Fine-Tuned BERT; TF-IDF; Logistic Regression; Support Vector Machine SVM ; Cloud GPU; Operating Costs; Performance Efficiency; Business Intelligence;

    Abstract : Eftersom samhället blir allt mer datadrivet revolutionerar användningen av AI och maskininlärning sättet företag fungerar och utvecklas på. Denna studie utforskar användningen av AI, Big Data och Natural Language Processing (NLP) för att förbättra affärsverksamhet och intelligens i företag. READ MORE