About Me

I’m a research scientist working at META. I work in the reality lab and build assistant AI.

In 2021, I got my PhD from University of California, Los Angeles (UCLA), advised by Prof. Song-Chun Zhu in Center for Vision, Cognition, Learning, and Autonomy (VCLA). My research interests focused on communicative learning, multiagent collaboration and human-machine interaction.

Previously, in 2017, I received a Bachelor of Science in Computer Science with the Highest Distinction at University of Michigan. In 2014, I graduated from Beijing High School No. 4.

Work Experience

• Machine Learning Engineer Intern (Jun. 2021 - Sept. 2021)
  • Instagram Keyword Interest Search

• Research Scientist (Apr. 2022 - )
  • Reality Lab & Assistant AI

Publications

Journal

• In situ bidirectional human-robot value alignment[pdf][web]
  • Science Robotics, July, 2022
  • Luyao Yuan*†, Xiaofeng Gao*, Zilong Zheng*, Mark Edmonds†, Ying Nian Wu, Federico Rossano, Hongjing Lu†, Yixin Zhu†, Song-Chun Zhu†
  • (* equal contribution, † corresponding author)
• Show Me What You Can Do: Capability Calibration on Reachable Workspace for Human-Robot Collaboration [pdf]
  • ICRA 2021 Workshop on Social Intelligence in Humans and Robots (Spotlight)
  • IEEE Robotics and Automation Letters (RA-L)
  • Xiaofeng Gao, Luyao Yuan, Tianmin Shu, Hongjing Lu, Song-Chun Zhu

Conference

• Iterative Teacher-Aware Learning [pdf][code]
  • Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS), 2021
  • Luyao Yuan, Dongruo Zhou, Junhong Shen, Jingdong Gao, Jeffrey L. Chen, Quanquan Gu, Ying Nian Wu, Song-Chun Zhu
• Emergence of Recursive Teaching Protocol between Theory of Mind Agents [pdf] [web]
  • NeurIPS 2019 Workshop on Emergent Communication
  • Luyao Yuan, Zipeng Fu, Jingyue Shen, Lu Xu, Junhong Shen, Song-Chun Zhu
• Emergence of Theory of Mind Collaboration in Multiagent Systems [pdf]
  • NeurIPS 2019 Workshop on Emergent Communication
  • Luyao Yuan, Zipeng Fu, Linqi Zhou, Kexin Yang, Song-Chun Zhu

• Discriminative Bimodal Networks for Visual Localization and Detection with Natural Language Queries [pdf]
  • IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, (Oral)
  • Yuting Zhang, Luyao Yuan, Yijie Guo, Zhiyuan He, I-An Huang, Honglak Lee