Automated systems based on artificial intelligence (AI) increasingly support decisions with ethical implications where decision makers need to trust these systems. However, insights regarding trust in automated systems predominantly stem from contexts where the main driver of trust is that systems produce accurate outputs (e.g., alarm systems for monitoring tasks). It remains unclear whether what we know about trust in automated systems translates to application contexts where ethical considerations (e.g., fairness) are crucial in trust development. In personnel selection, as a sample context where ethical considerations are important, we investigate trust processes in light of a trust violation relating to unfair bias and a trust repair intervention. Specifically, participants evaluated preselection outcomes (i.e., sets of preselected applicants) by either a human or an automated system across twelve selection tasks. We additionally varied information regarding imperfection of the human and automated system. In task rounds five through eight, the preselected applicants were predominantly male, thus constituting a trust violation due to potential unfair bias. Before task round nine, participants received an excuse for the biased preselection (i.e., a trust repair intervention). The results of the online study showed that participants have initially less trust in automated systems. Furthermore, the trust violation and the trust repair intervention had weaker effects for the automated system. Those effects were partly stronger when highlighting system imperfection. We conclude that insights from classical areas of automation only partially translate to the many emerging application contexts of such systems where ethical considerations are central to trust processes.
11 August 2022 in Computers in Human Behavior Reports
Purpose: Automatic evaluation of job interviews has become an alternative for assessing interviewees. Therefore, questions arise regarding applicant reactions and behavior when algorithms automatically evaluate applicants' interview responses. This study tests arguments from previous research suggesting that applicants whose interviews will be automatically evaluated may use less impression management (IM), but could react more negatively to the interview.Design/methodology/approach: Participants (N = 124; primarily German students) took part in an online mock interview where they responded to interview questions via voice recordings (i.e. an asynchronous interview). Prior to the interview, half of them were informed that their answers would be evaluated automatically (vs by a human rater). After the interviews, participants reported their honest and deceptive IM behavior as well as their reactions to the interview.Findings: Participants in the automatic evaluation condition engaged in less deceptive IM, felt they had fewer opportunities to perform during the interview, and provided shorter interview answers.Research limitations/implications: The findings of this study suggest a trade-off between IM behavior and applicant reactions in technologically advanced interviews. Furthermore, the results indicate that automatically evaluated interviews might affect interview validity (e.g. because of less deceptive IM) and influence interviewees' response behavior.Practical implications: Hiring managers might hope that automatically evaluated interviews decrease applicants' use of deceptive IM. However, the results also challenge organizations to pay attention to negative effects of automatic evaluation on applicant reactions.Originality/value: This study is the first empirical study investigating the impact of automatically evaluated interviews on applicant behavior and reactions.