TinyBERT: Distilling BERT for Natural Language Understanding

Xiaoqi Jiao(Wuhan National Laboratory for Optoelectronics), Yichun Yin(Huawei Technologies (Sweden)), Lifeng Shang(Huawei Technologies (Sweden)), Fang Wang(Wuhan National Laboratory for Optoelectronics), Linlin Li(Huawei Technologies (United Kingdom)), Xiao Dong Chen(Nanjing Forestry University), Xin Jiang(Huawei Technologies (Sweden))
Cited by 1,633


Related Papers