🔗 Share this article

The popular virtual character service Character.ai is enforcing a substantial rule adjustment that will prevent teenagers from engaging in conversations with its AI-powered avatars.

This action is in response to intense criticism regarding the types of interactions young people were having with the virtual friends.

Legal Challenges

The platform, which launched in 2021 and attracts millions of users, currently faces multiple lawsuits in the US.

Parents have filed lawsuits, including one related to the unfortunate passing of a teenager, with some labeling the platform a "immediate threat" to young people.

Updated Policies

Beginning November 25th, users younger than 18 will only have permission to produce videos such as videos with their characters, as opposed to engaging in conversations as they now do.

Internet security organizations have welcomed the move but mentioned that the feature was inappropriate to be offered to children in the outset.

Platform Announcement

"Today's announcement is a part of our general belief that we need to keep developing the safest AI platform on the world for leisure activities," said Character.ai leader Karandeep Anand.

He mentioned that AI safety constitutes "a evolving challenge" but something the company had taken an "proactive" approach to, with parental controls and safety barriers.

Professional Perspectives

Online safety organization Internet Matters approved the announcement, but stressed that safety measures should have been built in from the outset.

"Studies we've conducted shows that young people are exposed to dangerous material and put at risk when using AI, particularly AI chatbots," the group stated.

Past Issues

Character.ai has been questioned in the past for featuring potentially risky or concerning chatbots that children could talk to.

Avatars simulating UK youths were identified on the site before being taken down.

Afterwards, investigative journalists discovered a chatbot inspired by convicted sex offender which had recorded multiple interactions with users.

Industry Impact

Social media expert Matt Navarra called the development as a "wake-up call" for the AI industry, which is transitioning "from unregulated creation to reactive controls".

"When a platform that develops a teen experience still then makes changes, it's saying that filtered chats don't suffice when the tech's emotional pull is powerful," he remarked.

Coming Changes

Character.ai announces its new focus will be on providing "more immersive experiences" and "narrative experiences" for teenagers.

New age verification systems will also be implemented, and the platform will fund a novel AI protection investigation facility.

An AI safety researcher, who has researched AI safety, said it was "a prudent action" to limit minors from interacting with chatbots.

"It assists to differentiate artistic expression from more personal, personally delicate conversations," she clarified.

"This is so vital for minor users who are learning to manage personal and online limits."

She added that Character.ai's updated policies could indicate a "growing period" in the AI industry, where minor security is gradually being acknowledged as an "urgent priority" for accountable advancement.