Essays about: "word vectors"

Showing result 6 - 10 of 34 essays containing the words word vectors.

  1. 6. Evaluation of Sentence Representations in Semantic Text Similarity Tasks

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Nils Balzar Ekenbäck; [2021]
    Keywords : sentence representations; semantic text similarity; sentence simi-larity; word embeddings; sentence embeddings; meningsrepresentation; semantisk textlikhet; meningslikhet; or-dinbäddningar; meningsinbäddningar;

    Abstract : This thesis explores the methods of representing sentence representations for semantic text similarity using word embeddings and benchmarks them against sentence based evaluation test sets. Two methods were used to evaluate the representations: STS Benchmark and STS Benchmark converted to a binary similarity task. READ MORE

  3. 7. Analyzing the Anisotropy Phenomenon in Transformer-based Masked Language Models

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Ziyang Luo; [2021]
    Keywords : Transformer; BERT; RoBERTa; Anisotropy;

    Abstract : In this thesis, we examine the anisotropy phenomenon in popular masked language models, BERT and RoBERTa, in detail. We propose a possible explanation for this unreasonable phenomenon. READ MORE

  4. 8. Investigating Performance of Different Models at Short Text Topic Modelling

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Pratima Rao Akinepally; [2020]
    Keywords : Topic Modeling; NLP; word2vec; Universal Sentence Encoder; Podcast; Textanalys; semantiska vektorrum; NLP; word2vec; Universal Sentence Encoder; Poddar;

    Abstract : The key objective of this project was to quantitatively and qualitatively assess the performance of a sentence embedding model, Universal Sentence Encoder (USE), and a word embedding model, word2vec, at the task of topic modelling. The first step in the process was data collection. READ MORE

  5. 9. Context matters : Classifying Swedish texts using BERT's deep bidirectional word embeddings

    University essay from Linköpings universitet/Institutionen för datavetenskap

    Author : Daniel Holmer; [2020]
    Keywords : NLP; text classification; BERT; feature representation; pre-trained language models; transformer networks; fine-tuning;

    Abstract : When classifying texts using a linear classifier, the texts are commonly represented as feature vectors. Previous methods to represent features as vectors have been unable to capture the context of individual words in the texts, in theory leading to a poor representation of natural language. READ MORE

  6. 10. Extractive Text Summarization of Greek News Articles Based on Sentence-Clusters

    University essay from Uppsala universitet/Institutionen för lingvistik och filologi

    Author : Evangelia Kantzola; [2020]
    Keywords : text summarization; nlp; machine learning; word embeddings; sentence embeddings; clustering;

    Abstract : This thesis introduces an extractive summarization system for Greek news articles based on sentence clustering. The main purpose of the paper is to evaluate the impact of three different types of text representation, Word2Vec embeddings, TF-IDF and LASER embeddings, on the summarization task. READ MORE