Projects

Projects

InteLLA – Intelligent Language Learning Assistant

Intelligent Language Learning Assistant (InteLLA) employs dialogue system technology to adaptively change conversational strategies according to the language learner’s abilities and understanding, eliciting appropriate speech samples and effectively assessing the learner’s language proficiency. Adaptive Interview Strategy InteLLA was developed to maximize language competency and the effective assessment of language proficiency by tailoring conversations to the language learner’s skills and comprehension. Users can begin a conversation with InteLLA through simple means […]

Projects

BLENDi – Blended Dialog for XR Museum Guide

With the upcoming arrival of Society 5.0, a vast quantity of data will be accumulated in cyberspace through ubiquitous IoT devices and high-speed networks. A smart space guide is the key to organizing and effectively communicating the results of this raw data to humans. Such AI must have collaborative and relationship-building strategies to properly pick up on a visitor’s interests, curiosities and objectives, and realize personalized guidance through conversational interactions. […]

Projects

ASTRO – Artificial Socio-Task Assistant Robot

Needs of Mixing Voice and Touch Inputs Voice user interface is now common, however, it’s not always the best way to achieve certain tasks. Users sometimes may want to take their initiative to explore information themselves through their preferable moderates. In this project, we explore mixed-initiative user experiences where a user collaborates with a conversational AI agent on a large touchscreen. In this project, we design a conversational user interface […]

Projects

HARP – Holographic Archive of Research Projects

In collaboration with Zhen Bai (Assistant Professor, University of Rochester) and John Choi (CEO, Choitek) Holographic Archive of Research Projects @ Carnegie Mellon University (HARP@CMU) is a digital library of several hundred past research projects from all schools and disciplines, guided by a socially-aware humanoid virtual agent, displayed on a large custom 360 holographic display, where students, faculty, and guests can explore the rich history of interdisciplinary academic research conducted […]

Projects

SARA – Socially Aware Robot Assistant

Socially Aware Robot Assistant SARA is a Socially-Aware Robot Assistant that interacts with people in a whole new way, personalizing the interaction and improving task performance by relying on information about the relationship between the human user and virtual assistant. Rather than taking the place of people, Sara is programmed to collaborate with her human users. Rather than ignoring the socio-emotional bonds that form the fabric of society, SARA depends […]