Essays about: "fine-tuning"

Showing result 1 - 5 of 201 essays containing the word fine-tuning.

  1. 1. AI-based image generation: The impact of fine-tuning on fake image detection

    University essay from Stockholms universitet/Institutionen för data- och systemvetenskap

    Author : Nick Hagström; Anders Rydberg; [2024]
    Keywords : Fake image detection; LoRA; DreamBooth; Stable Diffusion; Image generation;

    Abstract : Machine learning-based image generation models such as Stable Diffusion are now capable of generating synthetic images that are difficult to distinguish from real images, which gives rise to a number of legal and ethical concerns. As a potential measure of mitigation, it is possible to train neural networks to detect the digital artifacts present in the images synthesized by many generative models. READ MORE

  2. 2. Key Sentence Extraction From CRISPR-Cas9 Articles Using Sentence Transformers

    University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

    Author : Sandra Henningsson; Brage Stranden Lae; [2023-11-09]
    Keywords : NLP; Transformers; CRISPR; semantic search; keyphrase extraction;

    Abstract : The annotation of CRISPR-related articles and extraction of key content has traditionally relied on manual efforts. Manual annotation is error-prone and timeconsuming. This thesis presents an alternative approach using transfer learning and pre-trained models based on the Transformer architecture. READ MORE

  3. 3. The Impact of Deep Neural Network Pruning on the Hyperparameter Performance Space: An Empirical Study

    University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

    Author : Jonna Matthiesen; [2023-10-24]
    Keywords : Compression; Deep Learning; DNN; Hyperparameters; Optimization; Pruning; Hyperparameter Optimisation; Hyperparameter Tuning;

    Abstract : With the continued growth of deep learning models in terms of size and computational requirements, the need for efficient models for deployment on resource-constrained devices becomes crucial. Structured pruning has emerged as a proven method to speed up models and reduce computational requirements. READ MORE

  4. 4. Evaluating and optimizing Transformer models for predicting chemical reactions

    University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

    Author : Siva Manohar Koki; Supriya Kancharla; [2023-10-23]
    Keywords : Chemformer; transformer; evaluation; explainable AI; fine-tuning; machine learning;

    Abstract : In this thesis, we assess the effectiveness of a transformer model specifically trained to predict chemical reactions. The model, named Chemformer, is a sequence-tosequence model that uses the transformer’s encoder and decoder stacks. READ MORE

  5. 5. Natural Language Inference Transfer Learning in a Multi-Task Contract Dataset : In the Case of ContractNLI: a Document Information Extraction System

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Yiu Kei Tang; [2023]
    Keywords : ;

    Abstract : This thesis investigates the enhancement of legal contract Natural Language Inference (NLI) classification through supervised fine-tuning on general domain NLI, in the case of ContractNLI and Span NLI BERT (Koreeda and Manning, 2021), a multi-task document information extraction dataset and framework. Annotated datasets of a specific professional domain are scarce due to the high time and labour cost required to create them. READ MORE