Content moderation generally refers to the practice of monitoring user generated content and applying a set of rules defining what is acceptable. As a result, Content Moderators (CMs) are responsible for reviewing and removing harmful online material, which has the potential to cause psychological harm. However, little is known about the perceived impacts of the job. Semi-structured interviews were conducted with 11 commercial CMs who were exposed to child sexual abuse material (CSAM) as part of their job. Interviews were analysed using framework analysis to investigate any psychological impacts. Results demonstrated that CMs manifested with a range of symptoms consistent with experiencing repeated trauma. This included experiencing intrusive thoughts of CSAM, triggered by situations with similar contexts to those encountered at work, avoidance of children and negative cognitive and emotional effects such as cynicism, anxiety and detachment. These symptoms fit into a framework of post traumatic and secondary traumatic stress and suggest CMs wellbeing and exposure to stressful stimuli may be comparable to professionals working in the emergency services or caring professions, such as social workers. These personnel are at heightened risk of various problems including compassion fatigue, vicarious trauma and burnout. Companies which employ moderators should learn from these comparable professions and provide psychoeducation and trauma-informed care to CMs which have been demonstrated to help mitigate these challenges.
There is an increasing evidence base that demonstrates the psychological toll of content moderation on the employees that perform this crucial task. Nevertheless, content moderators (CMs) can be based worldwide and have varying working conditions. Therefore, there is a need for studies to be replicated to ensure that the results are robust. The current study used a large sample of commercial CMs employed by an international company to replicate the results from two previous studies that relied on an anonymous online survey. The results pertaining to mental health, wellbeing, and the effectiveness of wellbeing services for this population were mostly replicated. Over a quarter of CMs demonstrated moderate to severe psychological distress, and a quarter were experiencing low wellbeing. Further, the results suggest the potential utility for interventions that increase problem-focussed problem solving, as well as a need for the efficacy of wellbeing services to be evaluated more broadly.
19 September 2016 in Journal of Public Mental Health
Purpose: Current government policy aims to tackle youth anti-social behaviour and its psychological and social impacts. Given an increased likelihood that young victims of crime are also likely to engage in aggressive or deviant behaviour and to have psychological and social difficulties, interventions are needed which access vulnerable youth with adverse lifestyles to increase well-being and reduce offending. The current project utilised a hospital emergency department (ED) as an appropriate location to identify and interact with youth victims of violent crime; to support key lifestyle risk and mental health difficulties; and build resilience. The purpose of this paper is to use a youth work paradigm, to target vulnerable youth in a health setting at a crisis point where intervention may have a higher chance of uptake.Design/methodology/approach: The study applied a quasi-experimental, longitudinal design. Using the strengths and difficulties questionnaire and the “What Do You Think” component of the ASSET risk assessment, data were collected from 120 youth aged 12-20, at baseline with 66 youth who successfully completed the programme with assessments at baseline and follow-up, at an average of 14 weeks.Findings: There was significant reduction in both psychological problems and lifestyle risk at follow-up.Research limitations/implications: These findings support the government initiative to intervene in youth violence in healthcare settings. Challenges revolve around increasing participation and greater formalisation of the intervention.Originality/value: The youth work led violence intervention in the ED is successfully tackling psychological problems and lifestyle risk following injury.
5 September 2020 in Crime Prevention and Community Safety