Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 7870--7881, 2020.

Chen, Sanyuan and Hou, Yutai and Cui, Yiming and Che, Wanxiang and Liu, Ting and Yu, Xiangzhan