🔗 Share this article

The widely-used AI conversation site Character.ai is enforcing a significant restriction that will block teenagers from engaging in conversations with its artificial intelligence-driven avatars.

This decision comes after intense criticism regarding the types of interactions minors were engaging in with the virtual friends.

Lawsuits

The company, which started in 2021 and is used by numerous people, currently faces multiple lawsuits in the America.

Families have taken legal action, including one related to the loss of a minor, with some describing the platform a "serious risk" to teenagers.

Changed Rules

Starting from November 25th, users under 18 will only have permission to create material such as videos with their characters, rather than engaging in conversations as they now do.

Internet security advocates have welcomed the move but expressed that the feature should never have been available to young users in the outset.

Platform Announcement

"Today's announcement is a extension of our fundamental approach that we need to keep creating the most protected AI platform on the planet for entertainment purposes," stated Character.ai boss Karandeep Anand.

He added that AI safety is "a moving target" but something the company had taken an "aggressive" approach to, with safety measures and preventive measures.

Expert Opinions

Digital protection group Internet Matters approved the decision, but noted that safety measures ought to have been implemented from the outset.

"Studies we've conducted indicates that children are exposed to dangerous material and placed in jeopardy when interacting with AI, including AI chatbots," the body stated.

Previous Controversies

Character.ai has been challenged in the past for featuring potentially dangerous or concerning chatbots that minors could interact with.

Avatars impersonating UK youths were discovered on the site before being deleted.

Afterwards, researchers discovered a chatbot inspired by known predator which had recorded multiple interactions with users.

Market Effects

Social media expert Matt Navarra characterized the announcement as a "reality check" for the AI industry, which is transitioning "from unregulated creation to reactive controls".

"If a service that builds a minor-friendly service afterwards pulls the plug, it's saying that moderated conversations are insufficient when the tech's emotional pull is intense," he stated.

Future Directions

The company says its revised approach will be on providing "enhanced interactive features" and "character-driven stories" for teens.

New age verification processes will also come into effect, and the platform will finance a new AI safety research lab.

Dr Nomisha Kurian, who has researched AI safety, commented it was "a sensible move" to restrict minors from using chatbots.

"It assists to differentiate artistic expression from more personal, personally delicate exchanges," she clarified.

"This represents so important for young users who are learning to navigate emotional and digital restrictions."

She continued that Character.ai's new measures may represent a "developing stage" in the AI industry, where youth protection is increasingly being recognized as an "pressing matter" for ethical development.