Yoichi MATSUYAMA Ph.D

School of Computer Science, Carnegie Mellon University
Newell-Simon Hall 4604
5000 Forbes Ave, Pittsburgh, PA 15213, USA
CV (June 2018)
Conversational AI Media Design Portfolio

 

Yoichi Matsuyama (松山 洋一) is a Post Doctoral Fellow (Special Faculty) in the School of Computer Science, Carnegie Mellon University. He has designed and developed a number of conversational robot systems. His research interest lies in computational models of human conversations, which combine artificial intelligence, cognitive science and human-computer/robot interaction. At the ArticuLab, he is leading the SARA (Socially Aware Robot Assistant) project. His Ph.D dissertation project was the SCHEMA, a multiparty conversation facilitation robot, specifically its computational models of facilitation strategies and language generation, as well as its robotic platform development. Prior to CMU, he was a researcher at the Perceptual Computing Group, Waseda University in Tokyo. He received B.A. in cognitive psychology and media studies, M.E. and Ph.D in computer science from Waseda University in 2005, 2008 and 2015 respectively. He was a visiting researcher at the iCub Facility, Italian Institute of Technology, also a committee member of ACM SIGGRAPH Asia.

 

Mission

Inventing the Design Principle of Socially Expressive Conversational AI Media to Assist and Entertain Human Lives.

 

 

Experiences

  • Post Doctoral Research Fellow, ArticuLab, Language Technologies Institute and Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, United States, 2014 – present (Advisor: Justine Cassell)
  • Visiting Research Fellow, iCub Facility, Italian Institute of Technology, Genova, Italy, 2013 (Advisor: Giorgio Metta)
  • Director, WIZDOM (Waseda University Integrated Space of Wizards, Digital Oriented Manufacturers), 2012 – 2014
  • Research Associate, Waseda University, 2010 – 2013
  • Research Assistant, International Research and Education Center for Ambient Soc, Waseda University Global COE Program, 2008 – 2010
  • Program Committee (Student Volunteer Program Chair), ACM SIGGRAPH Asia, 2008 – 2009
  • Virtual Reality Content Designer, CAD CENTER Inc., Tokyo, 2004 – 2005

Educations

  • Ph.D, Computer Science, 2015 (Advisor: Tetsunori Kobayashi, Perceptual Computing Group)
  • M.E., Computer Science, 2008 (Advisor: Tetsunori Kobayashi, Perceptual Computing Group)
  • B.A., Human and Social Sciences, 2005 (Advisor: Machiko Kusahara)

* All degrees from Waseda University, Tokyo, Japan

Awards

Research Awards

  • Outstanding Research Award, Human Agent Interaction 2012, December 2012
    (Yoichi Matsuyama, Akihiro Saito, Iwao Akiba, Moemi Watanabe and Tetsunori Kobayashi, Facilitation Robot Promoting the Greatest Participation of the Greatest Number in Multiparty Conversation, Human-Agent Interaction Symposium 2012, 2B-3, December 2012.)
  • Best presentation, The Japanese Society for Artificial Intelligence SIG-SLUD (Special Interest Group of Speech, Language Understanding and Discourse Processing), February 2012
    (Yoichi Matsuyama, Akihiro Saito, Atsushi Ito, Iwao Akiba, Moemi Watanabe and Tetsunori Kobayashi, Active Timing Detection and Strategies for Multiparty Conversation Facilitation Systems, The Japanese Society for Artificial Intelligence (JSAI), SIG-SLUD-B203-05, pp.17-24, February 2013.)
  • Best presentation, The Japanese Society for Artificial Intelligence SIG-SLUD (Special Interest Group of Speech, Language Understanding and Discourse Processing), July 2008
    (Yoichi Matsuyama, Shinya Fujie, Hikaru Taniyama and Tetsunori Kobayashi, Communication Activation System in Group Communication, The Japanese Society for Artificial Intelligence (JSAI), SIG-SLUD-A801, pp.15-22, July 2008.)
  • Microsoft Scholarship, April 2009

Photography Awards

  • The Cat Show photography exhibition at PH21 Gallery, Budapest, Hungary (April, 2016)
  • I SHOT IT Mark of Excellence (2016)

Grants

  • Microsoft Grant “Towards Socially-Aware Conversational Agents that Keep up their End of the Conversation” (2017): co-PI… $75,000
  • Microsoft Pro HUB Award (2017): co-PI … Microsoft Pro HUB 84″
  • Google Cloud Credits (2015, 2017): PI … $50,000
  • Google Faculty Award Grant “Grounding Task Behavior in the Social World: Deep Reinforcement Learning for Social Dialogue to Improve Task Performance”, 2017: co-PI … $76,109
  • CMU President Donation for SARA: co-PI … $100,000
  • Yahoo!-CMU InMind Project (2015-2017) co-PI … $300,000
  • Development and Evaluations of Multiparty Conversation Activation Systems (2010-2012)
    Grant-in-Aid for scientific research WAKATE-B (23700239): PI
  • Facilitation Strategy for Multiparty Conversation Robots (2010) (2013-2015)
    Grant-in-Aid for scientific research WAKATE-B (25870824): PI

Professional Services

Committee

  • NAACL-HLT 2018 (North American Chapter of the Association for Computational Linguistics: Human Language Technologies), Program Committee
  • IWSDS 2018 (International Workshop on Spoken Dialogue Systems Technologies), Program Committee
  • ACL 2018 (Annual Meeting of the Association for Computational Linguistics), Program Committee
  • Journal of Human Interface Society Japan “Human Collaboration” 2018, Associate Editor
  • RO-MAN 2016 (IEEE International Symposium on Robot and Human Interactive Communication ), Associate Editor
  • ACM SIGGRAPH Asia Commitee Member (2008-2009)

Conference/Session Organizer

 Reviewer

  • International Workshop on Spoken Dialogue System Technologies (IWSDS) 2017
  • Journal of Behavioral Research Methods, 2015
  • International Journal of Affective Engineering, 2015
  • Advanced Robotics, 2015
  • IEEE-RAS International Conference on Humanoid Robots (Humanoids), 2014
  • IEEE/ACM Transactions on Acoustic, Speech and Language (TASLP), 2014
  • International Conference on Virtual Agents (IVA), 2014
  • Journal of Japanese Society for Artificial Intelligent (JSAI), 2012, 2013
  • International Conference on Social Robotics (ICSR), 2011

Patents

  • Conversational Robot (Japan 2010-221556)
  • Conversational Facilitation System and Robot (Japan 2008-304140)

Demos and Exhibitions

SARA Project (Carnegie Mellon University): Project Lead

SCHEMA Project (Waseda University): Project Lead

 

Media Coverage

SARA Project (Carnegie Mellon University): Project Lead

“Speaking with SARA certainly felt less jarring than talking to a regular chatbot. The system studies the words a person says during a conversation as well as the tone of his or her voice, also using several cameras to study the speaker’s facial expressions and head movements.”

MIT Technology Review

SCHEMA Project (Waseda University)