Essays about: "Adhithyan Kalaivanan"

Found 1 essay containing the words Adhithyan Kalaivanan.

  1. 1. On Linear Mode Connectivity up to Permutation of Hidden Neurons in Neural Network : When does Weight Averaging work?

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Adhithyan Kalaivanan; [2023]
    Keywords : Mode Connectivity; Representation Learning; Loss Landscape; Network Symmetry; Lägesanslutning; representationsinlärning; förlustlandskap; nätverkssymmetri;

    Abstract : Neural networks trained using gradient-based optimization methods exhibit a surprising phenomenon known as mode connectivity, where two independently trained network weights are not isolated low loss minima in the parameter space. Instead, they can be connected by simple curves along which the loss remains low. READ MORE