Essays about: "distilmbert"
Found 1 essay containing the word distilmbert.
-
1. Distillation or loss of information? : The effects of distillation on model redundancy
University essay from Uppsala universitet/Institutionen för lingvistik och filologiAbstract : The necessity for billions of parameters in large language models has lately been questioned as there are still unanswered questions regarding how information is captured in the networks. It could be argued that without this knowledge, there may be a tendency to overparametarize the models. READ MORE
Result pages:
1