Essays about: "Multilingual BERT"

Showing result 6 - 10 of 22 essays containing the words Multilingual BERT.

1. 6. Unsupervised multilingual distractor generation for fill-in-the-blank questions

   University essay from Uppsala universitet/Institutionen för lingvistik och filologi

   Author : Zhe Han; [2022]
   Keywords : Multilingual; Distractor; BERT;

   Abstract : Fill-in-the-blank multiple choice questions (MCQs) play an important role in the educational field, but the manual generation of them is quite resource-consuming, so it has gradually turned into an attractive NLP task. Thereinto, question creation itself has become a mainstream NLP research topic, while distractor (wrong alternative) generation (DG) still remains out of the spotlight. READ MORE

3. 7. Task-agnostic knowledge distillation of mBERT to Swedish

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Added Kina; [2022]
   Keywords : Natural Language Processing; Transformers; Knowledge Distillation; BERT; Multilingual Models; Cross-Lingual Transfer; Naturlig bearbetning av språk; Transformatorer; Kunskapsdestillation; BERT; Flerspråkiga modeller; Tvärspråklig inlärningsöverföring;

   Abstract : Large transformer models have shown great performance in multiple natural language processing tasks. However, slow inference, strong dependency on powerful hardware, and large energy consumption limit their availability. READ MORE

4. 8. Methods for increasing cohesion in automatically extracted summaries of Swedish news articles : Using and extending multilingual sentence transformers in the data-processing stage of training BERT models for extractive text summarization

   University essay from Linköpings universitet/Institutionen för datavetenskap

   Author : Elsa Andersson; [2022]
   Keywords : NLP; automatic text summarization; extractive summarization; BERT; sentence embeddings; cohesion;

   Abstract : Developments in deep learning and machine learning overall has created a plethora of opportunities for easier training of automatic text summarization (ATS) models for producing summaries with higher quality. ATS can be split into extractive and abstractive tasks; extractive models extract sentences from the original text to create summaries. READ MORE

5. 9. How to improve Swedish sentiment polarityclassification using context analysis

   University essay from Uppsala universitet/Institutionen för lingvistik och filologi

   Author : Ludvig Nilsson; Olle Djerf; [2021]
   Keywords : Context analysis; machine learning; Natural Language Processing;

   Abstract : This thesis considers sentiment polarity analysis in Swedish. De-spite being the most widely spoken of the Nordic languages less re-search in sentiment has been conducted in this area compared toneighboring languages. As such this is a largely exploratory projectusing techniques that have shown positive results for other languages. READ MORE

6. 10. Low-resource Language Question Answering Systemwith BERT

   University essay from Mittuniversitetet/Institutionen för informationssystem och –teknologi

   Author : Herman Jansson; [2021]
   Keywords : BERT; Question Answering system; Reading Comprehension; Low resource language; SQuADv2;

   Abstract : The complexity for being at the forefront regarding information retrieval systems are constantly increasing. Recent technology of natural language processing called BERT has reached superhuman performance in high resource languages for reading comprehension tasks. READ MORE