Essays about: "Knowledge Distillation"

Found 5 essays containing the words Knowledge Distillation.

  1. 1. Compression of Generative Networks for Single Image Super-Resolution

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS); KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Jacob Åslund; Anton Dahlin; [2020]
    Keywords : ;

    Abstract : In this research project we have compressed the model size of a generative neural network trained to upscale low resolution images. After first training a large network for this task, we used knowledge distillation to train smaller networks to approximate its output. READ MORE

  2. 2. Deep Neural Network Compression for Object Detection and Uncertainty Quantification

    University essay from Göteborgs universitet/Institutionen för data- och informationsteknik

    Author : Mohammad Ahraz Asif; Georgios Tzelepis; [2019-11-21]
    Keywords : Deep Learning; Model Compression; Knowledge Distillation; Bayesian Deep Learning; Object Detection;

    Abstract : Neural networks have been notorious for being computational expensive. Their demand for hardware resources prohibits their extensive use in embedded devices and puts restrictions on tasks like real time tracking. READ MORE

  3. 3. Towards Understanding the “User of the Future”

    University essay from KTH/Integrerad produktutveckling

    Author : Ramon Andres Amezcua Hidalgo; [2019]
    Keywords : ;

    Abstract : A fast-moving technological landscape is driving companies of today to constantly search for the solutions of tomorrow. As a result, companies are constantly searching for the next big thing and speculating on possible futures. READ MORE

  4. 4. Classifying hand-drawn documents in mobile settings, using transfer learning and model compression

    University essay from KTH/Skolan för datavetenskap och kommunikation (CSC)

    Author : Axel Riese; [2017]
    Keywords : computer vision; deep learning; model compression; transfer learning;

    Abstract : In recent years, the state-of-the-art in computer vision has improved immensely due to increased use of convolutional neural networks (CNN). However, the best-performing models are typically complex and too slow or too large for mobile use. READ MORE

  5. 5. Profitability of cogeneration in a chemical industry

    University essay from Högskolan i Gävle/Avdelningen för bygg- energi- och miljöteknik

    Author : Iñigo Monge Zaratiegui; [2017]
    Keywords : Cogeneration; boiler efficiency; Rankine cycle; steam;

    Abstract : A high demand of both electricity and heat exists in Arizona Chemical (a chemical plant dedicated to the distillation of Crude Tall Oil) for production processes. Due to the rising cost of resources and electricity, more and more companies are trying to decrease the energy expenses to increase their competitiveness in a global market, thus increasing their profit. READ MORE