Projects

Intelligent Language Learning Assistant (InteLLA) employs dialogue system technology to adaptively change conversational strategies according to the language learner’s abilities and understanding, eliciting appropriate speech samples and effectively assessing the learner’s language proficiency. Adaptive Interview Strategy InteLLA was developed to maximize language competency and the effective assessment of language proficiency by tailoring conversations to the language learner’s skills and comprehension. Users can begin a conversation with InteLLA through simple means […]

With the upcoming arrival of Society 5.0, a vast quantity of data will be accumulated in cyberspace through ubiquitous IoT devices and high-speed networks. A smart space guide is the key to organizing and effectively communicating the results of this raw data to humans. Such AI must have collaborative and relationship-building strategies to properly pick up on a visitor’s interests, curiosities and objectives, and realize personalized guidance through conversational interactions. […]

Needs of Mixing Voice and Touch Inputs Voice user interface is now common, however, it’s not always the best way to achieve certain tasks. Users sometimes may want to take their initiative to explore information themselves through their preferable moderates. In this project, we explore mixed-initiative user experiences where a user collaborates with a conversational AI agent on a large touchscreen. In this project, we design a conversational user interface […]

In collaboration with Zhen Bai (Assistant Professor, University of Rochester) and John Choi (CEO, Choitek) Holographic Archive of Research Projects @ Carnegie Mellon University (HARP@CMU) is a digital library of several hundred past research projects from all schools and disciplines, guided by a socially-aware humanoid virtual agent, displayed on a large custom 360 holographic display, where students, faculty, and guests can explore the rich history of interdisciplinary academic research conducted […]

Socially Aware Robot Assistant SARA is a Socially-Aware Robot Assistant that interacts with people in a whole new way, personalizing the interaction and improving task performance by relying on information about the relationship between the human user and virtual assistant. Rather than taking the place of people, Sara is programmed to collaborate with her human users. Rather than ignoring the socio-emotional bonds that form the fabric of society, SARA depends […]

Intelligent assistants of 2025 In 2014, Yahoo! and Carnegie Mellon University (CMU) have announced a five-year, $10 million partnership, called the InMind project. The goal of the InMind is to invent, implement, experiment, and iterate with an intelligent assistant for mobile devices. Major companies are already exploring intelligent assistants such as Siri, and Google Now, M, and Cortana, and we expect they will continue to develop these. To make an […]

Beyond the Cooperative Conversation Principle Let us begin by looking at an example of a question asked by one person and answered by another: A : “Do you have any favorite actor or actress?” B : “Yes, my favorite actress is Audrey Hepburn. Audrey is, just as one would expect, a charming and beautiful woman even in her private life!“ In this example, person A asked about person B’s favorite […]

Regulating A Four-Participant Conversation We present a framework for facilitation robots that regulates imbalanced engagement density in four-participant conversation as the forth participant with proper procedures for obtaining initiatives. Four is the special number in multiparty conversations. The three-participant conversation is the minimum unit where the participants autonomously organize a multiparty conversational situation. The fourth participant is the first person who can objectively observe the conversational situation. In three-participant conversations, […]

We proposed a robot that promotes an enjoyable party game as a facilitation robot system. In this task, a robot participates in a quiz game as one of participants and tries to promote the other participants’ enjoyment of the game. The functions implemented in the robot are: (1) The robot participates in the group’s communication using its basic group conversation functions; (2) The robot performs the game according to the […]