Mental health stigma is prevalent and detrimental to the outcomes of people living with psychiatric diagnoses. These negative views may be at their most severe when it comes to people with schizophrenia (PSZ).
1,2 One new avenue where stigmatization towards PSZ might be present is the burgeoning field of generative artificial intelligence (GAI). GAI is trained to the point of being capable of producing content, usually in response to prompts, based on the patterns present in the training material. GAI has been widely adopted in the past years and has become increasingly influential in clinical and academic psychaitry
3 and lay users. Chatbot GAIs allow users to give written prompts, which lead models to generate answers that users can then build on as if having a conversation. The way chatbots can do this is by learning statistical relationships present in language,
4 which they can do through training with an extensive corpus of written material. Proprietary chatbots, usually do not disclose the source or nature of these training materials, which makes it hard to assess the level of built-in stigma towards PSZ that could be present at this stage. Intentional checks and balances can be added in addition to the unsupervised training process to do things like ensure accuracy or restrict or qualify answers so that they meet what the model’s owners determine to be proper use. The manner in which proprietary models are modified after unsupervised training is also opaque. It is also ever-changing considering new assessments of risks, hazards, benefits, and user feedback.
5