Essays about: "Transformers"

Showing result 16 - 20 of 261 essays containing the word Transformers.

  1. 16. Fine-tuning a BERT-based NER Model for Positive Energy Districts

    University essay from Högskolan Dalarna/Institutionen för information och teknik

    Author : Karen Ortega; Fei Sun; [2023]
    Keywords : Positive Energy District PED ; Named Entity Recognition NER ; Bidirectional Encoder Representations from Transformers BERT ; Pipeline; Fine-tune;

    Abstract : This research presents an innovative approach to extracting information from Positive Energy Districts (PEDs), urban areas generating surplus energy. PEDs are integral to the European Commission's SET Plan, tackling housing challenges arising from population growth. READ MORE

  3. 17. Using Transformers To Improve Search Functions

    University essay from Lunds universitet/Institutionen för datavetenskap

    Author : Alice Berggren; Linnea Palmblad; [2023]
    Keywords : Technology and Engineering;

    Abstract : .... READ MORE

  4. 18. The Impact of the Retrieval Text Set for Text Sentiment Classification With the Retrieval-Augmented Language Model REALM

    University essay from KTH/Matematik (Inst.)

    Author : Oscar Blommegård; [2023]
    Keywords : The Impact of the Retrieval Text Set for Text Sentiment Classification With the Retrieval-Augmented Language Model REALM; Hämtningsförstärkta språkmodeller; Natural Language Processing; Transformers; Djupinlärning; Textklassificering;

    Abstract : Large Language Models (LLMs) have demonstrated impressive results across various language technology tasks. By training on large corpora of diverse text collections from the internet, these models learn to process text effectively, allowing them to acquire comprehensive world knowledge. READ MORE

  5. 19. Evaluation of deep learning methods for industrial automation

    University essay from Umeå universitet/Institutionen för datavetenskap

    Author : Ragnar Onning; [2023]
    Keywords : artificial intelligence; machine learning; deep learning; cnn; transformer; swin; swin transformer;

    Abstract : The rise and adaptation of the transformer architecture from natural language processing to visual tasks have proven a useful and powerful tool. Subsequent architectures such as visual transformers (ViT) and shifting window (SWIN) transformers have proven to be comparable and oftentimes exceed convolutional neural networks (CNNs) in terms of accuracy. READ MORE

  6. 20. Modeling Credit Default Swap Spreads with Transformers : A Thesis in collaboration with Handelsbanken

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Johan Luhr; [2023]
    Keywords : Machine Learning; Transformer; Finance; Credit Default Swap; Credit Valuation Adjustment; Time Series Data; Maskininlärning; Transformer; Finance; Kreditswapp; Kredit Värderings Justering; Tidsserie data;

    Abstract : In the aftermath of the credit crisis in 2007, the importance of Credit Valuation Adjustment (CVA) rose in the Over The Counter (OTC) derivative pricing process. One important part of the pricing process is to determine Probability of Defaults (PDs) of the counterparty in question. READ MORE