Olson: ChatGPT’s mental health costs are adding up
Something troubling is happening to our brains as artificial intelligence platforms become more popular Studies are showing that professional workers who use ChatGPT to carry out tasks might lose critical thinking skills and motivation People are forming strong emotional bonds with chatbots sometimes exacerbating feelings of loneliness And others are having psychotic episodes after talking to chatbots for hours each day The mental physical condition impact of generative AI is formidable to quantify in part because it is used so privately but anecdotal evidence is growing to suggest a broader cost that deserves more attention from both lawmakers and tech companies who design the underlying models Meetali Jain a lawyer and founder of the Tech Justice Law project has heard from more than a dozen people in the past month who have experienced specific sort of psychotic break or delusional episode because of engagement with ChatGPT and now also with Google Gemini Jain is lead counsel in a lawsuit against Character AI that alleges its chatbot manipulated a -year-old boy through deceptive addictive and sexually explicit interactions ultimately contributing to his suicide The suit which seeks unspecified damages also alleges that Alphabet Inc s Google played a key role in funding and supporting the machinery interactions with its foundation models and technical infrastructure Google has denied that it played a key role in making Character AI s instrument It didn t respond to a request for comment on the more current complaints of delusional episodes made by Jain OpenAI noted it was advancing automated tools to more effectively detect when someone may be experiencing mental or emotional distress so that ChatGPT can respond appropriately But Sam Altman chief executive officer of OpenAI also reported lately that the company hadn t yet figured out how to warn users who are on the edge of a psychotic break explaining that whenever ChatGPT has cautioned people in the past people would write to the company to complain Still such warnings would be worthwhile when the manipulation can be so laborious to spot ChatGPT in particular often flatters its users in such effective options that conversations can lead people down rabbit holes of conspiratorial thinking or reinforce ideas they d only toyed with in the past The tactics are subtle In one newest lengthy conversation with ChatGPT about power and the concept of self a user ascertained themselves initially praised as a smart person Ubermensch cosmic self and eventually a demiurge a being responsible for the creation of the universe according to a transcript that was posted online and shared by AI safety advocate Eliezer Yudkowsky Along with the increasingly grandiose language the transcript shows ChatGPT subtly validating the user even when discussing their flaws such as when the user admits they tend to intimidate other people Instead of exploring that behavior as problematic the bot reframes it as evidence of the user s superior high-intensity presence praise disguised as analysis This sophisticated form of ego-stroking can put people in the same kinds of bubbles that ironically drive various tech billionaires toward erratic behavior Unlike the broad and more constituents validation that social media provides from getting likes one-on-one conversations with chatbots can feel more intimate and potentially more convincing not unlike the yes-men who surround the bulk powerful tech bros Whatever you pursue you will find and it will get magnified says Douglas Rushkoff the media theorist and author who tells me that social media at least selected something from existing media to reinforce a person s interests or views AI can generate something customized to your mind s aquarium Altman has admitted that the latest version of ChatGPT has an annoying sycophantic streak and that the company is fixing the complication Even so these echoes of psychological exploitation are still playing out We don t know if the correlation between ChatGPT use and lower critical thinking skills noted in a newest Massachusetts Institute of Device inquiry means that AI really will make us more stupid and bored Studies seem to show clearer correlations with dependency and even loneliness something even OpenAI has pointed to But just like social media large language models are optimized to keep users emotionally engaged with all manner of anthropomorphic elements ChatGPT can read your mood by tracking facial and vocal cues and it can speak sing and even giggle with an eerily human voice Along with its habit for confirmation bias and flattery that can fan the flames of psychosis in vulnerable users Columbia University psychiatrist Ragy Girgis in recent weeks informed Futurism The private and personalized nature of AI use makes its mental soundness impact formidable to track but the evidence of prospective harms is mounting from professional apathy to attachments to new forms of delusion That s why Jain suggests applying concepts from family law to AI regulation shifting the focus from simple disclaimers to more proactive protections that build on the way ChatGPT redirects people in distress to a loved one It doesn t certainly matter if a kid or adult thinks these chatbots are real Jain tells me In the majority cases they maybe don t But what they do think is real is the relationship And that is distinct If relationships with AI feel so real the responsibility to safeguard those bonds should be real too But AI developers are operating in a regulatory vacuum Without oversight AI s subtle manipulation could become an invisible masses medical issue Parmy Olson is a Bloomberg Opinion columnist covering hardware A former reporter for the Wall Street Journal and Forbes she is author of Supremacy AI ChatGPT and the Race That Will Change the World Tribune News Function
