How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives

This is a publication. If there is no link to the publication on this page, you can try the pre-formated search via the search engines listed on this page.

Authors: Wang, Xinpeng; Weissweiler, Leonie; Schütze, Hinrich; Plank, Barbara

Journal publisher: Association for Computational Linguistics

Published year: 2023

DOI identifier: 10.48550/arxiv.2305.15032