OpenAI on October 30, 2026 announced a Community Safety Report on violence prevention that it will update every six months, alongside new protections that restrict weapons-related information for teens and tighten how ChatGPT handles questions about past mass attacks. The company said it made more than 200 law enforcement referrals in the third quarter of 2026.
Community Safety Report Planned for Early 2027
OpenAI committed to launching the Community Safety Report covering violence prevention and other community safety issues, as well as the effectiveness of its safeguards. The company said the report will explain how it trains its systems to detect, investigate, and respond to community safety issues, share anonymized examples of how violence-related harm manifests, highlight new mitigations and policy changes, and include supporting data. The first report is planned for early 2027 and will cover the second half of 2026, with updates every six months afterward.
OpenAI said the report is meant to give people a clear picture of how its models identify and respond to harmful behavior, the risks it sees in practice, and the steps it takes to address them.
OpenAI said its safety work includes bringing imminent threats of violence to the attention of law enforcement and that these referrals are making a positive difference in disrupting violent plots. The company said it continues to rely on mental health and behavioral experts to assess difficult cases, and it described AI companies as having a distinct role to play alongside law enforcement, family members, mental-health professionals, and policymakers.
Tighter Limits on Mass-Attack Content
OpenAI said its models are trained not to give instructions that would help someone plan or carry out violence. The company is placing additional restrictions on how ChatGPT responds to questions about past mass attacks and the people who carried them out, directing the model to provide less detailed information even when it is available from other online sources. The tightened policies restrict reconstructions of past mass attacks, including details about the weapons and equipment used and how they were obtained, as well as detailed comparisons on scale of harm that OpenAI said could amplify an attacker’s notoriety. The limits apply regardless of a user’s age or reason for asking.
People can still ask ChatGPT to help them understand these events, how victims and communities were impacted, and how to recognize warning signs and prevent future violence.
In May 2026, the company shared how ChatGPT can use short, factual summaries of earlier warning signs to respond more carefully in a later chat. OpenAI said it is building on that work so that when recent chats show warning signs of possible violence, ChatGPT will respond more conservatively when sharing information that could be misused, and it is working to apply those stricter limits when it predicts someone is under 18, even if their chats show no signs of violent intent.
OpenAI bans accounts it determines have violated its policies on violent activity. The company said it is working with mental health and violence prevention experts on additional, automated ways to intervene earlier: when a conversation shows signs that someone is fixating on violence or the idea of seriously harming another person, ChatGPT will be able to automatically end the chat, and if ChatGPT ends multiple chats for that reason, OpenAI may temporarily pause the account.
Added Safeguards for Users Under 18
ChatGPT for Teens applies age-appropriate safeguards for users under 18, and OpenAI is placing further limits on the weapons-related information teens can receive, even when a question appears harmless. The company’s policies already prohibit helping anyone plan or carry out violence and restrict helping teens find or obtain weapons; the extension restricts practical information about weapons and security systems that could be misused to facilitate violence, even when there is no sign of violent intent. OpenAI said teens can still use ChatGPT to help prevent and de-escalate violence, seek support, and connect with a trusted adult.
OpenAI said it has strengthened its age prediction system, which analyzes signals such as behavior patterns to estimate whether a user may be under or over 18, to continually assess new signals as people use ChatGPT and move users into the under-18 experience when appropriate. Users incorrectly placed in the under-18 experience can confirm they are adults through Persona, OpenAI’s age verification partner, and have the additional teen protections removed.
Linked parental-control accounts include safety alerts that may be sent when specially trained reviewers identify a serious self-harm concern and behaviors that may be associated with disordered eating. In July 2026, OpenAI expanded those alerts to notify parents if a teen’s account has been deactivated for violating its usage policies on violence, and the company said it is working to introduce notifications for parents if it pauses a teen’s account for repeatedly discussing violence.
The measures build on teen-safety features OpenAI introduced earlier in 2026. The company launched ChatGPT for Teens on August 18, 2026, automatically placing users estimated to be under 18, or who state an age between 13 and 17, into an experience with default safeguards based on the Under-18 Principles in its Model Spec. OpenAI began rolling out age prediction on ChatGPT consumer plans on January 20, 2026, using behavioral and account-level signals to estimate whether an account likely belongs to someone under 18; an August 25, 2026 update notes the system had begun rolling out in the EU.
OpenAI said the safeguards detailed in the announcement will begin rolling out in the next few weeks and that it will continue to refine them.
Credit: Source link
