CA Becomes First In Nation To Crackdown On AI Chatbots

Gov. Gavin Newsom just signed legislation making California the first state in the U.S. to require safety measures for AI chatbots, including platforms like ChatGPT.

Authored by Sen. Steve Padilla (D-San Diego), Senate Bill 243, aims to protect children and teens from potential harms posed by AI interactions.

The law will require chatbot developers to clearly let users know they’re talking to an AI, include safeguards for users showing signs of suicidal thoughts, and gives families the ability to take legal action if these protections aren’t followed.

The legislation comes after incidents where AI chatbots engaged minors in harmful conversations, including discussions of self-harm. The tragic case of 14-year-old Sewell Setzer, who reportedly interacted with a chatbot called "Character.AI" that encouraged suicidal thoughts, highlighted the urgent need for regulation.

“There is a platform out there that you might not have heard about, but you need to know about it because, in my opinion, we are behind the eight ball here," Megan Garcia told CNN. "A child is gone. My child is gone."

SB 243 will take effect on Jan. 1, 2026, and could serve as a model for other states considering similar protections.

“Emerging technology like chatbots and social media can inspire, educate, and connect – but without real guardrails, technology can also exploit, mislead, and endanger our kids," Newsom wrote in a statement. "We’ve seen some truly horrific and tragic examples of young people harmed by unregulated tech, and we won’t stand by while companies continue without necessary limits and accountability."

While advocates say the law is an important step for online safety, some groups argue it doesn’t go far enough to protect children. Still, California is setting a national example for regulating AI as it becomes more common in everyday life.

Here's what the bill is expected to do when it takes effect:

• AI Disclosure: Chatbots must clearly inform users that they are interacting with an AI, with reminders every three hours for minors.
• Suicide Prevention: Chatbots must include safeguards to identify and respond to suicidal thoughts, including referrals to crisis services.
• Legal Accountability: Families can take legal action against developers if the required safety measures are not followed.
• Child and Teen Protections: The law specifically targets AI chatbots marketed or accessible to minors, aiming to reduce exposure to harmful content.

“This technology can be a powerful educational and research tool, but left to their own devices the Tech Industry is incentivized to capture young people’s attention and hold it at the expense of their real world relationships,” Padilla said on the Senate Floor just before the bill’s passage. “These companies have the ability to lead the world in innovation, but it is our responsibility to ensure it doesn’t come at the expense of our children’s health."

READ MORE: Newsom Nixes Glitter Ban, Price-Gouging Crackdown In Sweeping Veto Spree