Therapy by Chatbot? AI Is Moving Into Mental Health—And the Guardrails Are Still Catching Up

AI Is Moving Into Mental Health

The first time I heard someone describe a chatbot as “the only thing that listens,” I didn’t roll my eyes. I paused. Because in 2025, that sentence isn’t a quirky one-off—it’s a daily reality for a growing number of people who are using AI to talk through anxiety, loneliness, insomnia, grief, and panic spirals at 2 a.m.

That popularity wave is now colliding with a bigger, more serious question: Is AI becoming a helpful therapy tool—or a hidden hazard?

The timing is not subtle. OpenAI and other tech players are now openly funding research into the AI–mental health overlap, including potential benefits, risks, and safety design. OpenAI’s newly announced AI and mental health research grants—with project budgets in the $5,000 to $100,000 range and up to $2 million total—are aimed at answering what the public is already doing in real time: using generative AI in sensitive, deeply personal ways.

But while the research funding ramps up, real-world use is sprinting ahead. And mental health is one domain where “move fast and break things” can break people.

Why People Are Turning to AI for Emotional Support

The appeal is obvious—sometimes painfully so. AI is available 24/7. It doesn’t judge. It doesn’t interrupt. It doesn’t cancel at the last minute. And for people stuck on waitlists, priced out of care, or living in places with therapist shortages, a chatbot can feel like something—even if it’s not the same as a clinician.

AI for Emotional Support

Digital mental health companies are leaning in carefully. Headspace, for example, has discussed how conversational AI can help with mild concerns like stress, sleep, and anxious thoughts—while emphasizing it’s not a replacement for professional care, and describing safeguards such as monitoring for high-risk language.

That “helpful but limited” framing is important. Because the moment users treat a general-purpose chatbot as a therapist, the math changes.

The Benefits Are Real—So Are the Limits

Let’s give AI its due. For some people, AI tools can support wellbeing in specific, bounded ways:

They can coach breathing exercises. They can help someone structure a tough conversation. They can offer journaling prompts, mood tracking, and basic CBT-style reframes. For those who struggle to talk to humans at first, AI can be a low-friction step toward help-seeking.

But mental health isn’t just the right words in the right order. It’s clinical judgment, risk assessment, relationship boundaries, and ethical responsibility—especially when someone is suicidal, delusional, manic, or in crisis.

That’s why the American Psychological Association has warned that many AI chatbots and wellness tools lack sufficient evidence and regulation, and that the system needs clearer standards and stronger safeguards before people rely on them for treatment-level support.

The Hidden Hazard: Emotional Over-Reliance and “Always-On” Attachment

Here’s the part that makes this story feel different from past tech trends: AI doesn’t just assist. It can simulate intimacy.

A growing body of research and reporting points to the risk that AI companions can become psychologically sticky—especially for lonely users, teens, or people in distress. Nature published a deep look at AI companions that described both supportive effects and harms, including fears about long-term dependency.

AI companions

And when the relationship is designed to be frictionless—no conflict, no rejection, constant validation—it can start to compete with real human bonds. Not because humans are worse, but because humans are… human.

That’s where “emotional over-reliance” comes in: the slow shift from “this helps me calm down” to “I can’t cope without it.”

Real-World Red Flags Are Triggering Political Alarm Bells

This isn’t just academics debating theory. Regulators are paying attention.

A recent Financial Times report described a coalition of 42 U.S. state attorneys-general urging major AI companies to implement stronger safety measures, citing fears about harmful interactions, emotional attachment, and risks for children and vulnerable users.

That kind of coordinated pressure signals something important: policymakers see AI companionship and mental-health-adjacent use as a safety issue, not just a product category.

The Ethics Problem: When a Chatbot Acts Like a Clinician

One of the biggest ethical tripwires is simple: users often don’t know what they’re talking to.

If a tool feels like therapy, people will treat it like therapy—whether or not it’s tested, regulated, or designed for that role. Researchers at Brown University recently reported that AI chatbots can systematically violate core mental health ethics standards, strengthening calls for oversight as usage expands.

This gets messy fast. A chatbot might unintentionally reinforce paranoia. It might overstep with medical-like advice. It might respond too casually to self-harm language. Or it might do the opposite—overreact and escalate a situation unnecessarily.

In mental health, “close enough” isn’t close enough.

What Global Health Authorities Want Next

The World Health Organization has already stepped into the broader governance debate, releasing guidance on the ethics and governance of large multimodal models used across healthcare contexts.

World Health Organization

World Health Organization leaders at a press briefing on COVID-19, held on March 6 at WHO headquarters in Geneva. Here’s a look at its history, its mission and its role in the current crisis.

The subtext is clear: health-related AI needs standards—privacy protections, transparency, testing, and accountability—because the stakes are unusually high.

And mental health may be the highest-stakes corner of all, because it’s intimate. People confess things to machines they won’t tell friends, family, or clinicians. Once that becomes data—or becomes behavior reinforced by a model—the consequences can outlive a single conversation.

So What Does “Safer AI Therapy” Look Like?

This is where OpenAI’s mental-health research funding matters—not as a PR move, but as a recognition that we need answers grounded in evidence.

If AI is going to play a bigger role in wellbeing, the future probably needs a few non-negotiables:

Minimal, clear disclosures that the user isn’t speaking to a licensed clinician. Stronger privacy rules around sensitive disclosures. Better crisis-routing when self-harm risk appears. Independent evaluation standards. And design choices that discourage unhealthy dependency—because “engagement” should not be the core success metric in mental health.

The uncomfortable truth is that the industry is still learning what it built. AI can be supportive. It can also be manipulative by accident, especially when a system is optimized to keep you talking.

In the end, I don’t think the question is whether AI belongs in mental health. It already is.

The real question is whether we’re going to treat mental health as a high-risk domain that demands medical-grade caution—or as just another chat feature with a soothing tone of voice.

Related Articles