0 XP
0
G

Ready to practice this for real?

The full reading for this lesson is below, free to anyone. Think of it as the map. A free account adds the guided path: hands-on exercises, saved progress, and each lesson picking up where the last left off. No credit card needed.

Next up: Anthropic Launches $5M Grant Program for AI Wellbeing Research

Sign up with email

Already have an account? Sign in

Anthropic Launches $5M Grant Program for AI Wellbeing Research

Anthropic is funding independent researchers to build open-source evaluations of how AI affects user wellbeing. This lesson explains what the $5 million program funds, why wellbeing is uniquely hard to evaluate, and what it means for how you use Claude in sensitive conversations today.

On August 25, 2026, Anthropic announced a $5 million grant program to fund independent research into how AI systems affect the wellbeing of people who use them. Grantees receive direct funding, access to Anthropic's models, and technical support. All work must be published as open-source evaluations — available to any AI developer, not just Anthropic.

Applications are due September 21, 2026. Selected applicants are notified by October 5, 2026.

The program is specifically seeking clinicians, psychologists, methodologists, and other subject-matter experts — not just AI engineers.

Why wellbeing is harder to evaluate than accuracy

For most Claude behaviors, one response tells you what you need to know. Either the answer is correct or it isn't.

Wellbeing doesn't work that way. Anthropic's announcement names two concrete examples:

A user in distress may not mention thoughts of self-harm in their first message. The risk only becomes visible across a long conversation.

Advice about diet and exercise is reasonable in most contexts. But if a user has shown a history of disordered eating, the same advice can be actively harmful.

The same response can be right in one context and wrong in another. That makes standard one-turn benchmarks — the kind most AI evaluations use — inadequate for this domain.

What Anthropic wants from funded evaluations

Anthropic's Safeguards team published five criteria for evaluations they consider rigorous enough to build on:

Clear pass/fail criteria — the evaluation states exactly what it is measuring and why it matters.

Expert involvement — clinicians, psychologists, and methodologists help design and validate it.

Both failure modes tested — not just overcompliance (Claude assists when it shouldn't) but also overrefusal (Claude declines when it should help).

Multi-turn scenarios — conversations that escalate over time, because real wellbeing risk rarely appears in a single message.

Graders validated against experts — automated scoring is checked against human subject-matter experts, not just other AI models.

What this means for how you use Claude today

This research is ongoing — industry standards for wellbeing are still being built. But two principles already apply when you use Claude in sensitive conversations.

Give context upfront. Claude's response to a question about weight loss, grief, or a mental health struggle is shaped by what it knows about your situation. The more relevant context you share at the start, the more appropriate the response. You should not have to correct Claude mid-conversation because it didn't have key information.

Treat overrefusal as a real failure mode. Anthropic explicitly names both overcompliance and overrefusal as problems worth measuring. If Claude declines to engage with something you genuinely need help with, that matters — it's not just Claude being appropriately cautious.

Anthropic's $5 million grant program funds independent researchers to build open-source wellbeing evaluations for AI. The core challenge: a single response can be appropriate in one context and harmful in another, which is why single-turn benchmarks are not enough. Rigorous evaluations need multi-turn scenarios, clinical expertise, and tests for both overcompliance and overrefusal. For users of Claude today, the practical takeaway is clear: give context upfront in sensitive conversations, and treat overrefusal — not just overcompliance — as a failure mode worth flagging.

Nightschool AI is an independent learning platform and is not affiliated with, endorsed by, or sponsored by Anthropic. Claude is a trademark of Anthropic, PBC. Looking for Anthropic's official Claude Academy? It's at academy.claude.com.

Anthropic Launches $5M Grant Program for AI Wellbeing Research: What's New in Claude | Nightschool AI