With the development of artificial intelligence (AI), the automatic analysis of video interviews to recognize individual personality traits has become an active area of research and has applications in personality computing, human-computer interaction, and psychological assessment. Advances in computer vision and pattern recognition based on deep learning (DL) techniques have led to the establishment of convolutional neural network (CNN) models that can successfully recognize human nonverbal cues and attribute their personality traits with the use of a camera. In this study, an end-to-end AI interviewing system was developed using asynchronous video interview (AVI) processing and a TensorFlow AI engine to perform automatic personality recognition (APR) based on the features extracted from the AVIs and the true personality scores from the facial expressions and self-reported questionnaires of 120 real job applicants. The experimental results show that our AI-based interview agent can successfully recognize the "big five" traits of an interviewee at an accuracy between 90.9% and 97.4%. Our experiment also indicates that although the machine learning was conducted without large-scale data, the semisupervised DL approach performed surprisingly well with regard to automatic personality recognition despite the lack of labor-intensive manual annotation and labeling. The AI-based interview agent can supplement or replace existing self-reported personality assessment methods that job applicants may distort to achieve socially desirable effects.
8 January 2020 in Human-centric Computing and Information Sciences
The prediction of individual interpersonal communication skills and personality traits is a critical issue in both industrial and organizational psychology and affective computing. In this study, we invited 114 participants, including 57 interviewers and 57 interviewees, to collect the ground truth of interviewees’ communication skills and personality traits as perceived by real human interviewers in a structured behavioral interview setting. We develop an asynchronous video interview (AVI) platform with an artificial intelligence (AI) decision agent based on a TensorFlow convolutional neural network (CNN), called AVI-AI, that can be used to partially displace human raters’ work in the initial stage of employment screening and to successfully predict a job candidate’s communication skills and personality traits. The experimental results show that AVI-AI can predict not only a candidate’s interpersonal communication skills but also his or her openness, agreeableness, and neuroticism, as perceived by experienced human resource professionals. The interrater reliability values were all acceptable to support the ground truth assumption. However, our AVI-AI could not predict the conscientiousness and extraversion as perceived by the real human raters in this study.
27 January 2021 in Journal of Real-Time Image Processing
Purpose: Asynchronous Video Interviews (AVIs) incorporating Artificial Intelligence (AI)-assisted assessment has become popular as a pre-employment screening method. The extent to which applicants engage in deceptive impression management (IM) behaviors during these interviews remains uncertain. Furthermore, the accuracy of human detection in identifying such deceptive IM behaviors is limited. This study seeks to explore differences in deceptive IM behaviors by applicants across video interview modes (AVIs vs Synchronous Video Interviews (SVIs)) and the use of AI-assisted assessment (AI vs non-AI). The study also investigates if video interview modes affect human interviewers' ability to detect deceptive IM behaviors.Design/methodology/approach: The authors conducted a field study with four conditions based on two critical factors: the synchrony of video interviews (AVI vs SVI) and the presence of AI-assisted assessment (AI vs Non-AI): Non-AI-assisted AVIs, AI-assisted AVIs, Non-AI-assisted SVIs and AI-assisted SVIs. The study involved 144 pairs of interviewees and interviewers/assessors. To assess applicants' deceptive IM behaviors, the authors employed a combination of interviewee self-reports and interviewer perceptions.Findings: The results indicate that AVIs elicited fewer instances of deceptive IM behaviors across all dimensions when compared to SVIs. Furthermore, using AI-assisted assessment in both video interview modes resulted in less extensive image creation than non-AI settings. However, the study revealed that human interviewers had difficulties detecting deceptive IM behaviors regardless of the mode used, except for extensive faking in AVIs.Originality/value: The study is the first to address the call for research on the impact of video interview modes and AI on interviewee faking and interviewer accuracy. This research enhances the authors’ understanding of the practical implications associated with the use of different video interview modes and AI algorithms in the pre-employment screening process. The study contributes to the existing literature by refining the theoretical model of faking likelihood in employment interviews according to media richness theory and the model of volitional rating behavior based on expectancy theory in the context of AVIs and AI-assisted assessment.
The aims of this study are to examine the effect of crowdsourced employer ratings and employee recommendations of an employer as an employer of choice, to examine which employer ratings that represent different employee value propositions can predict the overall employer rating through crowdsourcing, to examine whether the Fortune 500 ranking can also influence overall employer ratings, and to mine which keywords are popularly used when employees post a comment about the pros and cons of their employers on a crowdsourced employer branding platform. The study collected crowdsourced employer review data from Glassdoor based on 2019 Fortune 500 companies, and the results found that crowdsourced employer ratings are positively associated with “recommend to a friend,” while culture and values predominantly influence overall employer ratings. The rank of Fortune 500 has less predictive power for overall employer ratings than for other specific employer ratings, except for business outlook. The most popular keywords of Pros on Glassdoor are work–life balance and pay and benefits, whereas the most popular keywords of Cons on Glassdoor are work–life balance and upper management.
8 April 2024 in IEEE Transactions on Computational Social Systems
Whether an interviewee’s honest and deceptive responses can be detected by the signals of facial expressions in videos has been debated and called to be researched. We developed deep learningmodels enabled by computer vision to extract the temporal patterns of job applicants’ facial expressions and head movements to identify self-reported honest and deceptive impression management (IM) tactics from video frames in real asynchronous video interviews. A 12- to 15-min video was recorded for each of the N = 121 job applicants as they answered five structured behavioral interview questions. Each applicant completed a survey to self-evaluate their trustworthiness on four IM measures. Additionally, a field experiment was conducted to compare the concurrent validity associated with self-reported IMs between our modeling and human interviewers. Human interviewers’ performance in predicting these IMmeasures from another subset of 30 videos was obtained by having N = 30 human interviewers evaluate three recordings. Our models explained 91% and 84% of the variance in honest and deceptive IMs, respectively, and showed a stronger correlation with self-reported IMscores compared to human interviewers.