🔗 Share this article

The widely-used AI conversation site Character.ai is introducing a substantial restriction that will stop young users from having discussions with its virtual characters.

This action is in response to growing backlash regarding the types of interactions minors were participating in with the AI entities.

Lawsuits

The company, which started in 2021 and attracts countless individuals, is dealing with several legal actions in the America.

Guardians have initiated cases, among them concerning the loss of a minor, with some describing the platform a "immediate threat" to teenagers.

Updated Policies

Beginning November 25th, users younger than 18 will only have permission to generate content such as videos with their characters, instead of having discussions as they currently can.

Digital protection organizations have supported the change but expressed that the function ought not to have been accessible by minors in the first place.

Official Response

"The new policy is a extension of our core philosophy that we need to keep developing the most secure AI platform on the planet for entertainment purposes," commented Character.ai boss Karandeep Anand.

He mentioned that AI safety is "a moving target" but something the company had taken an "proactive" approach to, with guardian features and preventive measures.

Professional Perspectives

Online safety organization Internet Matters welcomed the announcement, but emphasized that protective features should have been implemented from the outset.

"Investigations we've performed indicates that minors are confronted with risky information and endangered when interacting with AI, such as AI chatbots," the group stated.

Earlier Concerns

Character.ai has been criticized in the past for featuring potentially harmful or concerning chatbots that young users could interact with.

Avatars mimicking English minors were identified on the service before being deleted.

Subsequently, researchers identified a chatbot inspired by convicted sex offender which had recorded numerous conversations with users.

Market Effects

Online expert Matt Navarra called the development as a "reality check" for the AI industry, which is transitioning "from unrestricted development to reactive controls".

"When a platform that creates a minor-friendly service afterwards implements restrictions, it's demonstrating that controlled interactions aren't enough when the tech's emotional pull is powerful," he remarked.

Coming Changes

Character.ai states its new focus will be on providing "more immersive experiences" and "character-driven stories" for young users.

Enhanced age checking methods will also be implemented, and the organization will finance a new AI safety investigation facility.

An expert in digital protection, who has researched AI safety, stated it was "a sensible move" to restrict minors from interacting with chatbots.

"It assists to separate artistic expression from more intimate, emotionally sensitive conversations," she explained.

"This represents so crucial for minor users still learning to navigate emotional and digital limits."

She added that Character.ai's revised approaches could indicate a "developing stage" in the AI industry, where youth protection is increasingly being recognized as an "urgent priority" for ethical development.