This article reports on the development of an instrument to measure the perceived stress that results from the use and ubiquity of digital technology in the workplace. Based upon a contemporary understanding of stress and a set of stressors that is a substantial update to existing scales, the Digital Stressors Scale (DSS) advances the measurement of digital stress. Initially, 138 items were constructed for the instrument and grouped into a set of 15 digital stressors. Based on a sample ofN= 1,998 online questionnaires completed by individuals representative of the US employed population, the scale was refined using exploratory factor analyses (EFA) and PLS-SEM. The resulting and final scale consists of ten stressor categories reflective of one higher-order construct and a total of 50 items. Through a nomological network that includes important outcome variables of digital stress (emotional exhaustion, innovation climate, job satisfaction, user satisfaction) it was then demonstrated that the DSS provides substantial explanatory power, particularly related to emotional exhaustion and user satisfaction. Thus, the DSS constitutes a state-of-the-art self-report instrument to measure the extent of distress appraisal related to digital technologies in the workplace and helps to explain further how and why information and communication technologies can lead to adverse outcomes in individuals, thereby providing the starting point for job related organizational interventions.
10 November 2020 in Behaviour & Information Technology
Technological innovation has become critical for market survival for many companies in the era of digital transformation. However, the organisational perspective to constantly stay up-to-date with technological innovations can become strenuous on an individual level due to the need to constantly adapt to the demands of a permanently changing technological environment. Based on a large-scale online survey of employees in Germany (N = 1,115), we investigated the positive and negative effects of an organisational climate of innovation from a digital stress perspective. Our results indicate that an organisational climate of innovation creates uncertainty in individuals as it supports technological change but can also help to reduce the perception of technological unreliability as it fosters an environment of mutual support. This research, therefore, adds to the idea of a pronounced innovation climate as a double-edged sword and shows that permanently pushing technological innovation should also be viewed in the light of its potential side effects. It follows that innovation initiatives should balance organisational and individual requirements to stay, or become, more competitive, thereby explicitly considering the side effects that too much and/or too fast innovation may have on users.
Adopting Large Language Models (LLMs) creates opportunities for organizations to increase efficiency, particularly in sentiment analysis and information extraction tasks. This study explores the efficiency of LLMs in real-world applications, focusing on sentiment analysis and service quality dimension extraction from user-generated content (UGC). For this purpose, we compare the performance of two LLMs (ChatGPT 3.5 and Claude 3) and three traditional NLP methods using two datasets of customer reviews (one in English and one in Persian). The results indicate that LLMs can achieve notable accuracy in information extraction (76% accuracy for ChatGPT and 68% for Claude 3) and sentiment analysis (substantial agreement with human raters for ChatGPT and moderate agreement with human raters for Claude 3), demonstrating an improvement compared to other AI models. However, challenges persist, including discrepancies between model predictions and human judgments and limitations in extracting specific dimensions from unstructured text. Whereas LLMs can streamline the SQ assessment process, human supervision remains essential to ensure reliability.