Essays about: "gles attention"

Found 3 essays containing the words gles attention.

  1. 1. Incorporating Sparse Attention Mechanism into Transformer for Object Detection in Images

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Cuong Duc Dao; [2022]
    Keywords : Detection Transformer; Sparse Attentions; Sparsity; Attention Mechanism; Learnable sparsity; Object Detection; Detektionstransformator; gles attention; gleshet; träningsbar gleshet; objektdetektion;

    Abstract : DEtection TRansformer, DETR, introduces an innovative design for object detection based on softmax attention. However, the softmax operation produces dense attention patterns, i.e., all entries in the attention matrix receive a non-zero weight, regardless of their relevance for detection. READ MORE

  3. 2. Benchmarking Deep Reinforcement Learning on Continuous Control Tasks : AComparison of Neural Network Architectures and Environment Designs

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Daniel Sahlin; [2022]
    Keywords : Deep learning; Reinforcement learning; Reward functions; Neural networks; Furuta pendulum; Djupinlärning; Förstärkningsinlärning; Belöningsfunktioner; Neurala nätverk; Furuta-pendel;

    Abstract : Deep Reinforcement Learning (RL) has received much attention in recent years. This thesis investigates how reward functions, environment termination conditions, Neural Network (NN) architectures, and the type of the deep RL algorithm aect the performance for continuous control tasks. READ MORE

  4. 3. Skogsskötsel för att minimera stormfällning över järnväg

    University essay from SLU/Southern Swedish Forest Research Centre

    Author : Magnus Orsander; [2003]
    Keywords : skogsskötsel; stormfällning; skador på järnvägsspår;

    Abstract : The society of today is dependent of secure transports and deliveries of electrical power. Interruptions in different activities because of fallen trees cost a great deal of money in form of reparations and claimed damages for transport companies and electrical suppliers. Fallen trees along some railway sections are a severe problem. READ MORE