Essays about: "Joseph Attieh"

Found 1 essay containing the words Joseph Attieh.

  1. 1. Optimizing the Performance of Text Classification Models by Improving the Isotropy of the Embeddings using a Joint Loss Function

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Joseph Attieh; [2022]
    Keywords : Text Classification; Isotropy; Embeddings; BERT; IsoScore; Klassificering av Text; Isotropi; Inbäddningar; BERT; IsoScore;

    Abstract : Recent studies show that the spatial distribution of the sentence representations generated from pre-trained language models is highly anisotropic, meaning that the representations are not uniformly distributed among the directions of the embedding space. Thus, the expressiveness of the embedding space is limited, as the embeddings are less distinguishable and less diverse. READ MORE