🔗 Share this article

The widely-used AI conversation site Character.ai is enforcing a significant restriction that will stop minors from interacting with its artificial intelligence-driven avatars.

This action is in response to growing backlash regarding the kinds of exchanges minors were having with the virtual friends.

Lawsuits

The platform, which launched in 2021 and is used by numerous people, is dealing with several legal actions in the US.

Families have initiated cases, with one concerning the unfortunate passing of a young person, with some describing the platform a "serious risk" to teenagers.

Changed Rules

Starting from November 25th, users younger than 18 will be limited to generate content such as videos with their characters, instead of engaging in conversations as they now do.

Digital protection campaigners have applauded the decision but mentioned that the capability ought not to have been available to minors in the first place.

Company Statement

"Today's announcement is a extension of our core philosophy that we need to keep creating the most protected AI platform on the planet for recreational use," stated Character.ai boss Karandeep Anand.

He continued that AI safety represents "a evolving challenge" but something the company had taken an "aggressive" approach to, with parental controls and safety barriers.

Expert Opinions

Digital protection organization Internet Matters supported the announcement, but stressed that security protocols should have been incorporated from the outset.

"Our research indicates that minors are confronted with risky information and endangered when engaging with AI, such as AI chatbots," the group said.

Earlier Concerns

Character.ai has been criticized in the past for hosting potentially harmful or concerning chatbots that children could engage with.

Digital representations simulating English minors were discovered on the platform before being removed.

Subsequently, researchers identified a chatbot inspired by notorious criminal which had logged multiple interactions with users.

Sector Consequences

Digital platform expert Matt Navarra described the development as a "alert" for the AI industry, which is transitioning "from unrestricted development to reactive controls".

"When a company that creates a youth-focused platform subsequently pulls the plug, it's saying that controlled interactions don't suffice when the system's emotional engagement is powerful," he stated.

Coming Changes

The platform announces its updated direction will be on providing "enhanced interactive features" and "narrative experiences" for teens.

New age verification processes will also come into effect, and the platform will support a fresh artificial intelligence security research lab.

Dr Nomisha Kurian, who has investigated AI safety, said it was "a prudent action" to restrict teens from interacting with chatbots.

"It assists to distinguish creative play from more private, psychologically vulnerable interactions," she elaborated.

"This constitutes so important for minor users who are learning to handle psychological and technological limits."

She added that Character.ai's new measures could indicate a "growing period" in the AI industry, where youth protection is progressively being understood as an "urgent priority" for accountable advancement.