Grounding is an important process that underlies all human interaction. Hence, it is crucial for building social robots that are expected to collaborate effectively with humans. Gaze behavior plays versatile roles in establishing, maintaining and repairing the common ground. Integrating all these roles in a computational dialog model is a complex task since gaze is generally combined with multiple parallel information modalities and involved in multiple processes for the generation and recognition of behavior. Going beyond related work, we present a modeling approach focusing on these multi-modal, parallel and bi-directional aspects of gaze that need to be considered for grounding and their interleaving with the dialog and task management. We illustrate and discuss the different roles of gaze as well as advantages and drawbacks of our modeling approach based on a first user study with a technically sophisticated shared workspace application with a social humanoid robot.
Zusammenfassung: In naher Zukunft werden Roboter immer häufiger in den Lebensbereichen von Alltagsnutzerinnen und -nutzern anzutreffen sein. Sehr deutlich wird dies am Beispiel von Haushalts- und Pflegerobotern, denen im Hinblick auf eine alternde Gesellschaft verstärkt die Rolle des Mitbewohners und Weggefährten zukommen wird. Damit einher geht der Wunsch, die Mensch-Roboter-Kommunikation menschzentrierter zu gestalten. Es geht nicht mehr lediglich um die effiziente Durchführung von Aufgaben, sondern auch darum, für den Menschen ein angenehmes Interaktionserlebnis zu schaffen und ein Vertrauensverhältnis zu dem Roboter herzustellen. Der nachfolgende Artikel diskutiert den aktuellen Stand in Forschung und Entwicklung im Bereich sozial interagierender Roboter, die über multimodale soziale Hinweisreize mit pflegebedürftigen Menschen kommunizieren.
Speech is a natural interface for humans to interact with robots. Yet, aligning a robot’s voice to its appearance is challenging due to the rich vocabulary of both modalities. Previous research has explored a few labels to describe robots and tested them on a limited number of robots and existing voices. Here, we develop a robot-voice creation tool followed by large-scale behavioral human experiments (N=2,505). First, participants collectively tune robotic voices to match 175 robot images using an adaptive human-in-the-loop pipeline. Then, participants describe their impression of the robot or their matched voice using another human-in-the-loop paradigm for open-ended labeling. The elicited taxonomy is then used to rate robot attributes and to predict the best voice for an unseen robot. We offer a web interface to aid engineers in customizing robot voices, demonstrating the synergy between cognitive science and machine learning for engineering tools.