Conversational spoken dialogue systems that interact with the user rather than merely reading the text can be equipped with hesitations to manage dialogue flow and user attention. Based on a series of empirical studies, we elaborated a hesitation synthesis strategy for dialogue systems, which inserts hesitations of a scalable extent wherever needed in the ongoing utterance. Previously, evaluations of hesitation systems have shown that synthesis quality is affected negatively by hesitations, but that they result in improvements of interaction quality. We argue that due to its conversational nature, hesitation synthesis needs interactive evaluation rather than traditional mean opinion score (MOS)-based questionnaires. To validate this claim, we dually evaluate our system’s speech synthesis component, on the one hand, linked to the dialogue system evaluation, and on the other hand, in a traditional MOS way. We are thus able to analyze and discuss differences that arise due to the evaluation methodology. Our results suggest that MOS scales are not sufficient to assess speech synthesis quality, leading to implications for future research that are discussed in this paper. Furthermore, our results indicate that synthetic hesitations are able to increase task performance and that an elaborated hesitation strategy is necessary to avoid likability issues.
In this paper, we present our humanoid robot "Meka", participating in a multi party human robot dialogue scenario. Active arbitration of the robot's attention based on multi-modal stimuli is utilised to observe persons which are outside of the robots field of view. We investigate the impact of this attention management and addressee recognition on the robot's capability to distinguish utterances directed at it from communication between humans. Based on the results of a user study, we show that mutual gaze at the end of an utterance, as a means of yielding a turn, is a substantial cue for addressee recognition. Verification of a speaker through the detection of lip movements can be used to further increase precision. Furthermore, we show that even a rather simplistic fusion of gaze and lip movement cues allows a considerable enhancement in addressee estimation, and can be altered to adapt to the requirements of a particular scenario.
Zusammenfassung: Ziel der Studie Ziel der Studie war die Bereitstellung von Ergebnissen zur Nutzung von Teletherapie während der Corona-Pandemie durch Vertreter*innen von drei Gesundheitsfachberufen. Methoden Im Rahmen einer fragebogengestützten Online-Erhebung wurden 282 Beschäftigte der Ergotherapie, Physiotherapie und Sprachtherapie/Logopädie zu Nutzungsverhalten, Herausforderungen, Potentialen und Rahmenbedingungen von Teletherapie befragt. Ergebnisse Insbesondere Ergotherapeut*innen und Logopäd*innen nutzen die Therapieform. Teletherapie bietet aus Sicht der Befragten auch unabhängig von der Corona-Pandemie Potenzial als alternative Therapieform. Allerdings ist der Bedarf an Unterstützungsangeboten und Schulungen im Bereich der Teletherapie groß. Schlussfolgerung Für eine langfristige Etablierung der Therapieform sind neben technischen Anforderungen und Schulungsangeboten insbesondere Klärungen zu zukünftigen Abrechnungsformalitäten nötig.