Precise knowledge distillation through top N reranking by Technical Terrence Team 07/11/2024 0 We propose to use n-best reranking to improve sequence-level knowledge distillation (Kim and Rush, 2016), where we extract pseudo-labels for ...