Publications

• Precise Zero-Shot Dense Retrieval without Relevance Labels
  Luyu Gao*, Xueguang Ma*, Jimmy Lin, Jamie Callan
  Pre-print paper (* Equal Contribution)

• PAL: Program-aided Language Models
  Luyu Gao*, Aman Madaan*, Shuyan Zhou*, Uri Alon, Pengfei Liu, Yiming Yang, Jamie Callan, Graham Neubig
  Pre-print paper, website, code (* Equal Contribution)

• Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer
  Zhengbao Jiang*, Luyu Gao*, Jun Araki, Haibo Ding, Zhiruo Wang, Jamie Callan, Graham Neubig
  In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2022. (* Equal Contribution)

• Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval
  Luyu Gao and Jamie Callan
  The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022) Paper

• Condenser: a Pre-training Architecture for Dense Retrieval
  Luyu Gao and Jamie Callan
  In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2021. Paper

• Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup
  Luyu Gao, Yunyi Zhang, Jiawei Han and Jamie Callan
  The 6th Workshop on Representation Learning for NLP (RepL4NLP). 2021. Paper

• COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List
  Luyu Gao, Zhuyun Dai, and Jamie Callan
  Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL). 2021. Paper

• Complementing Lexical Retrieval with Semantic Residual Embedding
  Luyu Gao, Zhuyun Dai, Tongfei Chen, Zhen Fan, Benjamin Van Durme and Jamie Callan
  In proceedings of the 42nd European Conference in Information Retrieval (ECIR). 2021. Paper Slides

• Rethink Training of BERT Rerankers in Multi-Stage Retrieval Pipeline
  Luyu Gao, Zhuyun Dai, Jamie Callan
  In proceedings of the 42nd European Conference in Information Retrieval (ECIR). 2021. Paper

• Modularized transfomer-based ranking framework
  Luyu Gao, Zhuyun Dai, and Jamie Callan
  In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Paper

• Improving Target-side Lexical Transfer in Multilingual Neural Machine Translation
  Luyu Gao, Xinyi Wang, Graham Neubig
  Findings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Paper

• Understanding BERT rankers under distillation
  Luyu Gao, Zhuyun Dai, and Jamie Callan
  Best Short Paper
  In Proceedings of the 2020 ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR) Paper

• EARL: Speedup transformer-based rankers with pre-computed representation
  Luyu Gao, Zhuyun Dai, and Jamie Callan
  arXiv:2004.13313. 2020. Paper