Hi~ I am Tianyu Gao, a first-year PhD student at Princeton University, advised by Prof. Danqi Chen. Before joining Princeton, I received my bachelor degree at Tsinghua University. During my time at Tsinghua, I was a member of THUNLP and was advised by Prof. Zhiyuan Liu.

Find me at twitter, google scholar, and github!

Email: tianyug@cs.princeton.edu

Research


My research interests lie within the intersection of natural language processing and machine learning. At the current stage, I am specifically interested in pre-trained language models, few-shot learning, contrastive learning, information extraction, etc.

Highlighted Publications


Please refer to my publications for the full list.

Tianyu Gao*, Xingcheng Yao*, Danqi Chen (* indicates equal contribution)
SimCSE: Simple Contrastive Learning of Sentence Embeddings
Arxiv preprint, 2021 pdf code

Tianyu Gao*, Adam Fisch*, Danqi Chen (* indicates equal contribution)
Making Pre-trained Language Models Better Few-shot Learners
Proceedings of ACL, 2021 pdf code

Hao Peng*, Tianyu Gao*, Xu Han, Yankai Lin, Peng Li, Zhiyuan Liu, Maosong Sun, Jie Zhou (* indicates equal contribution)
Learning from Context or Names? An Empirical Study on Neural Relation Extraction
Proceedings of EMNLP, 2020 pdf code

Xu Han*, Tianyu Gao*, Yankai Lin*, Hao Peng, Yaoliang Yang, Chaojun Xiao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou (* indicates equal contribution)
More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction
Proceedings of AACL, 2020 pdf

Tianyu Gao, Xu Han, Hao Zhu, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
FewRel 2.0: Towards More Challenging Few-Shot Relation Classification
Proceedings of EMNLP (Short Paper), 2019 pdf code

Experiences


Princeton NLP group. As PhD student. Aug. 2020 - Present

  • Advised by Prof. Danqi Chen.
  • Research on natural language processing.

Tsinghua NLP Lab. As research assistant. Nov. 2017 - May 2020

  • Advised by Prof. Zhiyuan Liu.
  • Research on natural language processing and machine learning.

Mila-Quebec AI Institute. As Research Intern. July 2019 - Sept. 2019

  • Mentor: Prof. Jian Tang.
  • Research on knowledge graph embedding and pre-training language models.

WeChat AI, Tencent. Tencent Rhino-Bird Elite Training Program. May 2019 - May 2020

  • Mentor: Dr. Peng Li.
  • Research on natural language processing and machine learning.

Momenta. As intern. May 2017 - May 2018

  • Mentor: Dr. Ji Liang.
  • Research on semantic segmentation.