Essays about: "distillation"

Showing result 1 - 5 of 85 essays containing the word distillation.

  1. 1. Utilizing energy-saving techniques to reduce energy and memory consumption when training machine learning models : Sustainable Machine Learning

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Khalid El Yaacoub; [2024]
    Keywords : Sustainable AI; Machine learning; Quantization-Aware Training; Model Distillation; Quantized Distillation; Siamese Neural Networks; Continual Learning; Experience Replay; Data Efficient AI; Energy Consumption; Energy-Savings; Sustainable ML; Computation resources; Hållbar maskin inlärning; Hållbar AI; Maskininlärning; Quantization-Aware Training; Model Distillation; Quantized Distillation; siamesiska neurala nätverk; Continual Learning; Experience Replay; Dataeffektiv AI; Energiförbrukning; Energibesparingar; Beräkningsresurser;

    Abstract : Emerging machine learning (ML) techniques are showing great potential in prediction performance. However, research and development is often conducted in an environment with extensive computational resources and blinded by prediction performance. READ MORE

  2. 2. Methods for Developing TinyConvolutional Neural Networksfor Deployment on EmbeddedSystems

    University essay from Uppsala universitet/Institutionen för informationsteknologi

    Author : Egemen Yiğit Kömürcü; [2023]
    Keywords : ;

    Abstract : With the recent development in the Deep Learning area, computationally heavy tasks like object detection in images have become easier to compute and take less time to execute with powerful GPUs. Also, when employing sufficiently larger models, these daily tasks are predicted with greater accuracy. READ MORE

  3. 3. Understanding the Robustnessof Self Supervised Representations

    University essay from Luleå tekniska universitet/Institutionen för system- och rymdteknik

    Author : Johan Rodahl Holmgren; [2023]
    Keywords : Self-Supervision; AI; Robustness; Computer-Vision;

    Abstract : This work investigates the robustness of learned representations of self-supervised learn-ing approaches, focusing on distribution shifts in computer vision. Joint embedding architecture and method-based self-supervised learning approaches have shown advancesin learning representations in a label-free manner and efficient knowledge transfer towardreducing human annotation needs. READ MORE

  4. 4. Screening pyrolysis bio-oil as binder for carbon anode in aluminium production

    University essay from KTH/Fiber- och polymerteknologi

    Author : Yazhe Wang; [2023]
    Keywords : Biomass; Bio-oil; Bio-pitch; Carbon Anode; Aluminum production; Biomassa; Bioolja; Biobeck; Kolanod; Aluminium Produktion;

    Abstract : Den högkvalitativa stenkolstjäran, som används som anodbindemedel inom aluminiumindustrin, innebär utmaningar när det gäller att möta kraven på kolanod. Dess produktion är beroende av ohållbara fossila bränslen, vilket bidrar till ökade koldioxidutsläpp. READ MORE

  5. 5. Knowledge distillation for anomaly detection

    University essay from Uppsala universitet/Institutionen för informationsteknologi

    Author : Nils Gustav Erik Pettersson; [2023]
    Keywords : ;

    Abstract : The implementation of systems and methodologies for time series anomaly detection holds the potential of providing timely detection of faults and issues in a wide variety of technical systems. Ideally, these systems are able to identify deviations from the normal behavior of systems even before any problems manifest, thus enabling proactive maintenance. READ MORE