This year alone, there have been numerous known instances—often via lawsuits—of AI chatbots (most often, OpenAI’s ChatGPT) that have gone horrifically wrong. A January lawsuit described the story of a man who took his own life after being allegedly “coached” into suicide. A college student in Georgia sued OpenAI, claiming that ChatGPT “pushed him into psychosis.” So what should OpenAI—and other AI companies generally—do differently to reduce harm among people who use their products? AI is not a mental health professionalIt’s no secret that many people are using chatbots to make emotional or interpersonal decisions, even when companies tell them not to.