Preprint2019
Tiny BERT
Unknown
TinyBERT distills BERT into a compact model using attention transfer and two-stage distillation for efficient NLU.
0Sep 1, 2019Attention Mechanisms
arXiv
AI Research
AI & ML Research Papers
A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.