Dominik Schiller

Dominik Schiller

Auto-generated profile, based on publicly available information

Dominik Schiller

University of Augsburg, Augsburg, Germany

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 July 2020 in Journal on Multimodal User Interfaces
Verified
Journal Article
Open access
PDF file
KWKatharina Weitz
Katharina Weitz
DSDominik Schiller
Dominik Schiller
RSRuben Schlagowski
Ruben Schlagowski
THTobias Huber
Tobias Huber
EAElisabeth André
Elisabeth André
While the research area of artificial intelligence benefited from increasingly sophisticated machine learning techniques in recent years, the resulting systems suffer from a loss of transparency and comprehensibility, especially for end-users. In this paper, we explore the effects of incorporating virtual agents into explainable artificial intelligence (XAI) designs on the perceived trust of end-users. For this purpose, we conducted a user study based on a simple speech recognition system for keyword classification. As a result of this experiment, we found that the integration of virtual agents leads to increased user trust in the XAI system. Furthermore, we found that the user’s trust significantly depends on the modalities that are used within the user-agent interface design. The results of our study show a linear trend where the visual presence of an agent combined with a voice output resulted in greater trust than the output of text or the voice output alone. Additionally, we analysed the participants’ feedback regarding the presented XAI visualisations. We found that increased human-likeness of and interaction with the virtual agent are the two most common mention points on how to improve the proposed XAI interaction design. Based on these results, we discuss current limitations and interesting topics for further research in the field of XAI. Moreover, we present design recommendations for virtual agents in XAI systems for future projects.

26 October 2023
Verified
Conference Paper
Open access
PMPhilipp Müller
Philipp Müller
MBMichal Balazia
Michal Balazia
TBTobias Baur
Tobias Baur
MDMichael Dietz
Michael Dietz
AHAlexander Heimerl
Alexander Heimerl
ABAndreas Bulling
Andreas Bulling
Automatic analysis of human behaviour is a fundamental prerequisite for the creation of machines that can effectively interact with- and support humans in social interactions. In MultiMediate'23, we address two key human social behaviour analysis tasks for the first time in a controlled challenge: engagement estimation and bodily behaviour recognition in social interactions. This paper describes the MultiMediate'23 challenge and presents novel sets of annotations for both tasks. For engagement estimation we collected novel annotations on the NOvice eXpert Interaction (NOXI) database. For bodily behaviour recognition, we annotated test recordings of the MPIIGroupInteraction corpus with the BBSI annotation scheme. In addition, we present baseline results for both challenge tasks.


12 August 2025 in Scientific Reports
Verified
Journal Article
Open access
PDF file
SESteffen T. Eberhardt
Steffen T. Eberhardt
AVAntonia Vehlen
Antonia Vehlen
JSJana Schaffrath
Jana Schaffrath
BSBrian Schwartz
Brian Schwartz
TBTobias Baur
Tobias Baur
WLWolfgang Lutz
Wolfgang Lutz
Rating scales have shaped psychological research, but are resource-intensive and can burden participants. Large Language Models (LLMs) offer a tool to assess latent constructs in text. This study introduces LLM rating scales, which use LLM responses instead of human ratings. We demonstrate this approach with an LLM rating scale measuring patient engagement in therapy transcripts. Automatically transcribed videos of 1,131 sessions from 155 patients were analyzed using DISCOVER, a software framework for local multimodal human behavior analysis. Llama 3.1 8B LLM rated 120 engagement items, averaging the top eight into a total score. Psychometric evaluation showed a normal distribution, strong reliability (ω = 0.953), and acceptable fit (CFI = 0.968, SRMR = 0.022), except RMSEA = 0.108. Validity was supported by significant correlations with engagement determinants (e.g., motivation, r = .413), processes (e.g., between-session efforts, r = .390), and outcomes (e.g., symptoms, r = − .304). Results remained robust across bootstrap resampling and cross-validation, accounting for nested data. The LLM rating scale exhibited strong psychometric properties, demonstrating the potential of the approach as an assessment tool. Importantly, this automated approach uses interpretable items, ensuring clear understanding of measured constructs, while supporting local implementation and protecting confidential data.

28 October 2024
Verified
Conference Paper
Open access
PMPhilipp Müller
Philipp Müller
MBMichal Balazia
Michal Balazia
TBTobias Baur
Tobias Baur
MDMichael Dietz
Michael Dietz
AHAlexander Heimerl
Alexander Heimerl
ABAndreas Bulling
Andreas Bulling
Estimating the momentary level of participant's engagement is an important prerequisite for assistive systems that support human interactions. Previous work has addressed this task in within-domain evaluation scenarios, i.e. training and testing on the same dataset. This is in contrast to real-life scenarios where domain shifts between training and testing data frequently occur. With MultiMediate'24, we present the first challenge addressing multi-domain engagement estimation. As training data, we utilise the NOXI database of dyadic novice-expert interactions. In addition to within-domain test data, we add two new test domains. First, we introduce recordings following the NOXI protocol but covering languages that are not present in the NOXI training data. Second, we collected novel engagement annotations on the MPIIGroupInteraction dataset which consists of group discussions between three to four people. In this way, MultiMediate'24 evaluates the ability of approaches to generalise across factors such as language and cultural background, group size, task, and screen-mediated vs. face-to-face interaction. This paper describes the MultiMediate'24 challenge and presents baseline results. In addition, we discuss selected challenge solutions.

20 August 2017
Verified
Conference Paper
Open access
JWJohannes Wagner
Johannes Wagner
TFThiago Fraga-Silva
Thiago Fraga-Silva
YJYvan Josse
Yvan Josse
DSDominik Schiller
Dominik Schiller
ASAndreas Seiderer
Andreas Seiderer
EAElisabeth André
Elisabeth André