I am a PhD student at UCL NLP, co-supervised by Prof. Pontus Stenetorp and Prof. Sebastian Riedel. I was affiliated with Montreal Institute of Learning Algorithm (MILA), and Alberta Machine Intelligence Institute (AMII). I received Master of Mathematics (Computer Science Option) from University of Waterloo. I got Bachelor of Engineering from Tongji University, Shanghai, China.

I was supervised by researchers from several institutes, including Prof. Olga Vechtomova from University of Waterloo, Prof. Lili Mou from University of Alberta & AMII, Prof. Laurent Charlin from MILA, Prof. Randy Goebel from University of Alberta, Prof. Tianwei Yu from Emory University, Prof. Min Yang from Chinese Academy of Sciences and Prof. Ye Luo from Tongji University.

My primary research interest is Natural Language Processing (NLP).

This is my CV.

Selected Publications

Please check the full list of my publications here.

Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity
Yao Lu, Max Bartolo, Alastair Moore, Sebastian Riedel and Pontus Stenetorp
arXiv 2021

Multi-XScience: A Large-scale Dataset for Extreme Multi-document Summarization of Scientific Articles
Yao Lu, Yue Dong and Laurent Charlin
EMNLP, 2020
[slides] [dataset][appendix]

Discrete Optimization for Unsupervised Sentence Summarization with Word-Level Extraction
Raphael Schumann, Lili Mou, Yao Lu, Olga Vechtomova and Katja Markert
ACL, 2020

A Multi-task Learning Framework for Abstractive Text Summarization
Yao Lu, Linqing Liu, Zhile Jiang, Min Yang and Randy Goebel
AAAI Conference on Artificial Intelligence (AAAI, student poster), 2019

Generative Adversarial Network for Abstractive Text Summarization
Linqing Liu, Yao Lu, Min Yang, Qiang Qu, and Jia Zhu
AAAI Conference on Artificial Intelligence (AAAI, abstract), 2018
[supplementary file][output summary]

Distilling Task-Specific Knowledge from BERT into Simple Neural Networks
Yao Lu*, Raphael Tang*, Linqing Liu*, Lili Mou, Olga Vechtomova and Jimmy Lin (equal contribution, order flipped)
arxiv pre-print, 2019

Natural language generation for effective knowledge distillation
Raphael Tang, Yao Lu and Jimmy Lin
Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP, 2019

Detecting "Smart" Spammers On Social Network: A Topic Model Approch
Linqing Liu, Yao Lu, Ye Luo, Renxian Zhang, Laurent Itti, and Jianwei Lu
the North American Chapter of the Association for Computational Linguistics (NAACL, student session). 2016


Awards and Honors

  • Top 3 of Microsoft Beauty of Programming Competition, 2016
  • First Prize in National Mathematics Competition, 2014
  • First Class Scholarship, Tongji University, 2014 & 2015
  • Outstanding Student, Tongji University, 2014