Essays about: "Transformermodell"

Found 2 essays containing the word Transformermodell.

  1. 1. What the BERT? : Fine-tuning KB-BERT for Question Classification

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Jonatan Cervall; [2021]
    Keywords : BERT; KB-BERT; Question Classification; TREC; Li and Roth Taxonomy; BERT; KB-BERT; Frågeklassificering; TREC; Li och Roth Taxonomi;

    Abstract : This work explores the capabilities of KB-BERT on the downstream task of Question Classification. The TREC data set for Question Classification with the Li and Roth taxonomy was translated to Swedish, by manually correcting the output of Google’s Neural Machine Translation. 500 new data points were added. READ MORE

  2. 2. Extracting Structured Data from Free-Text Clinical Notes : The impact of hierarchies in model training

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Mohammad Omer; [2021]
    Keywords : Diagnosis Code Assignment; Hierarchical Training; Transformer Model; BERT; SNOMED CT; ICD-9; MIMIC-III; Diagnoskodstilldelning; Hierarkisk Träning; Transformermodell; BERT; SNOMED CT; ICD-9; MIMIC-III;

    Abstract : Diagnosis code assignment is a field that looks at automatically assigning diagnosis codes to free-text clinical notes. Assigning a diagnosis code to clinical notes manually needs expertise and time. Being able to do this automatically makes getting structured data from free-text clinical notes in Electronic Health Records easier. READ MORE