Recommended citation: Nathan Brown, Ashton Williamson, Tahj Anderson, and Logan Lawrence. 2023. ."Efficient Transformer Knowledge Distillation: A Performance Review." In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 54–65, Singapore. Association for Computational Linguistics
Download Paper