Video data offer important insights into social processes because they enable direct observation of real-life social interaction. Though such data have become abundant and increasingly accessible, they pose challenges to scalability and measurement. Computer vision (CV), i.e., software-based automated analysis of visual material, can help address these challenges, but existing CV tools are not sufficiently tailored to analyze social interactions. We describe our novel approach, “3D social research” (3DSR), which uses CV and 3D camera footage to study kinesics and proxemics, two core elements of social interaction. Using eight videos of a scripted interaction and five real-life street scene videos, we demonstrate how 3DSR expands sociologists’ analytical toolkit by facilitating a range of scalable and precise measurements. We specifically emphasize 3DSR's potential for analyzing physical distance, movement in space, and movement rate – important aspects of kinesics and proxemics in interactions. We also assess data reliability when using 3DSR.
30 May 2022 in Medical & Biological Engineering & Computing
Previous studies exploring human sweat ducts as biological antennas in the sub-THz range have shown that the electromagnetic (EM) response of the skin is modulated by the person’s mental and physical stress. These findings naturally raised hopes of a new remote avenue for detecting human stress. However, as those studies unmasked stress using correlations with well-established markers such as the Galvanic Skin Response (GSR), the question of whether the EM response could serve as an independent marker of stress remained unanswered. Here, we provide a positive answer to this question by showing that machine learning models trained on EM reflections from 21 participants, subjected to physical and mental stress, were able to estimate the presence of stress in a signal from a new participant, in a matter of seconds, with above 90% accuracy.