Recent work has demonstrated how content moderation practices on social media may unfairly affect marginalized individuals, for example by censoring women's bodies and misidentifying reclaimed terms as hate speech. This study documents and explores the direct experiences of marginalized creators who have been impacted by discriminatory content moderation on Instagram. Collaborating with our participants for over a year, we contribute five co-constructed narratives of discriminatory content moderation from advocates in trauma-informed care, LGBTQ+ sex education, anti-racism education, and beauty and body politics. In sharing these detailed personal accounts, not only do we shed light on their experiences with being blocked, banned, or deleted unfairly, but we delve deeper into the lasting impacts of these experiences to their livelihoods and mental health. Reflecting on their stories, we observe that content moderation on social media is deeply entangled with the situated experiences of offline discrimination. As such, we document how each participant experiences moderation through the lens of their often intersectional identities. Using participatory research methods, we collectively strategize ways to learn from these individual accounts and resist discriminatory content moderation, as well as imagine possibilities for repair and accountability.
14 April 2023 in Proceedings of the ACM on Human-Computer Interaction
Individuals seeking out information about human-trafficking and anti-trafficking efforts are increasingly turning to social media as an informational source. However, a lack of traditional informational gatekeeping online has allowed for the rapid proliferation of misinformation via social media. This has been clearly evidenced within the realm of human trafficking by the spread of conspiracy theories instigated by the QAnon-led campaign #SaveTheChildren. Through in-depth interviews with members of the public and professionals involved in anti-trafficking activism we explore how individuals find trustworthy information about human trafficking in light of the public spread of misinformation. Our findings highlight the centrality of distrust as a driving force behind information-seeking on social media. Further, we highlight the tensions that arise from using social media as a primary resource within anti-trafficking education and the limitations of interventions to slow the spread of trafficking-related misinformation. This work provides contextual knowledge for researchers looking to better understand the real-world impacts of misinformation and looking to design better interventions into digital information disorder.