Publications

• Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval
  Luyu Gao and Jamie Callan
  arXiv:2108.05540 2021. Paper

• Is Your Language Model Ready for Dense Representation Fine-tuning?
  Luyu Gao and Jamie Callan
  In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP, to appear). 2021. Paper

• Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup
  Luyu Gao, Yunyi Zhang, Jiawei Han and Jamie Callan
  The 6th Workshop on Representation Learning for NLP (RepL4NLP). 2021. Paper

• COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List
  Luyu Gao, Zhuyun Dai, and Jamie Callan
  Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL). 2021. Paper

• Complementing Lexical Retrieval with Semantic Residual Embedding
  Luyu Gao, Zhuyun Dai, Tongfei Chen, Zhen Fan, Benjamin Van Durme and Jamie Callan
  In proceedings of the 42nd European Conference in Information Retrieval (ECIR). 2021. Paper Slides

• Rethink Training of BERT Rerankers in Multi-Stage Retrieval Pipeline
  Luyu Gao, Zhuyun Dai, Jamie Callan
  In proceedings of the 42nd European Conference in Information Retrieval (ECIR). 2021. Paper

• Modularized transfomer-based ranking framework
  Luyu Gao, Zhuyun Dai, and Jamie Callan
  In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Paper

• Improving Target-side Lexical Transfer in Multilingual Neural Machine Translation
  Luyu Gao, Xinyi Wang, Graham Neubig
  Findings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Paper

• Understanding BERT rankers under distillation
  Luyu Gao, Zhuyun Dai, and Jamie Callan
  Best Short Paper
  In Proceedings of the 2020 ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR) Paper

• EARL: Speedup transformer-based rankers with pre-computed representation
  Luyu Gao, Zhuyun Dai, and Jamie Callan
  arXiv:2004.13313. 2020. Paper