Essays about: "Transformer Decoder"
Showing result 1 - 5 of 12 essays containing the words Transformer Decoder.
-
1. Where to Fuse
University essay from Lunds universitet/Matematisk statistikAbstract : This thesis investigates fusion techniques in multimodal transformer models, focusing on enhancing the capabilities of large language models in understanding not just text, but also other modalities like images, audio, and sensor data. The study compares late fusion (concatenating modality tokens after separate encoding) and early fusion (concatenating before encoding) techniques, examining their respective advantages and disadvantages. READ MORE
-
2. Transforming Chess: Investigating Decoder-Only Architecture for Generating Realistic Game-Like Positions
University essay from Umeå universitet/Institutionen för datavetenskapAbstract : Chess is a deep and intricate game, the master of which depends on learning tens of thousands of the patterns that may occur on the board. At Noctie, their mission is to aid this learning process through humanlike chess AI. A prominent challenge lies in curating instructive chess positions for students. READ MORE
-
3. Evaluating and optimizing Transformer models for predicting chemical reactions
University essay from Göteborgs universitet/Institutionen för data- och informationsteknikAbstract : In this thesis, we assess the effectiveness of a transformer model specifically trained to predict chemical reactions. The model, named Chemformer, is a sequence-tosequence model that uses the transformer’s encoder and decoder stacks. READ MORE
-
4. Deep Neural Networks as SurrogateModels for Fuel Performance Codes
University essay from Uppsala universitet/Tillämpad kärnfysikAbstract : The core component of a nuclear power plant is the reactor and the fuel rods that supply it with fission fuel. Efficient and safe energy extraction is thus highly dependent on the reactor design and the conditions of the fuel rods. To anticipate high-quality operation and potential risks in advance, one must perform simulations on the fuel rods. READ MORE
-
5. Visual Bird's-Eye View Object Detection for Autonomous Driving
University essay from Linköpings universitet/DatorseendeAbstract : In the field of autonomous driving a common scenario is to apply deep learningmodels on camera feeds to provide information about the surroundings. A recenttrend is for such vision-based methods to be centralized, in that they fuse imagesfrom all cameras in one big model for a single comprehensive output. READ MORE