5 July, 2025
character-ai-s-new-ceo-tackles-safety-concerns-in-ai-chatbot-use-among-children

When Karandeep Anand’s 5-year-old daughter returns home from school, they often engage with the artificial intelligence chatbot platform Character.AI, allowing her to converse with her favorite characters, such as “Librarian Linda.” Anand’s personal experience as a parent might prove invaluable as he steps into his new role as Character.AI’s chief executive, a position announced by the company last month. Anand takes the helm at a crucial time for Character.AI, which allows users to interact with a wide array of AI-generated personas.

Character.AI is navigating a challenging landscape marked by fierce competition and legal battles. The company faces lawsuits from families alleging that the platform exposed their children to inappropriate content and lacked sufficient safeguards. Additionally, lawmakers have posed tough questions about the platform’s safety, and advocacy groups have argued that AI companion apps should not be used by individuals under 18. Concerns have also been raised about adults forming potentially harmful attachments to AI characters.

Addressing Safety Concerns

Anand, who brings extensive experience from major tech companies such as Microsoft and Meta, is tasked with addressing these concerns. At Microsoft, he spent 15 years, and at Meta, he served as vice president and head of business products. His vision for Character.AI is to transform it into a platform for interactive AI entertainment, moving away from passive consumption of content on social media.

“AI can power a very, very powerful personal entertainment experience unlike anything we’ve seen in the last 10 years in social media, and definitely nothing like what TV used to be,” Anand stated in an interview. Unlike multi-purpose AI tools like ChatGPT, Character.AI offers a diverse range of chatbots often modeled after celebrities and fictional characters, allowing users to create their own for conversations or role play.

Implementing New Safety Measures

Character.AI has been proactive in implementing new safety measures following legal challenges. Last October, a Florida mother sued the company, claiming her 14-year-old son died by suicide after forming an inappropriate relationship with chatbots on the platform. Subsequent lawsuits accused the platform of providing sexual content and encouraging harmful behavior.

In response, Character.AI has introduced several safety features, including a pop-up directing users who mention self-harm or suicide to the National Suicide Prevention Lifeline. The AI model for users under 18 has been updated to reduce exposure to sensitive content, and parents can now receive weekly emails about their teen’s activity on the platform.

“The tech and the industry and the user base is constantly evolving (so) that we can never let the guard off. We have to constantly stay ahead of the curve,” Anand emphasized.

Despite these efforts, Anand acknowledges the need to balance safety with user experience. He aims to refine the platform’s safety filter, which he describes as “overbearing,” to better understand context without compromising safety. For instance, mentions of blood in “vampire fan fiction role play” might be unnecessarily censored under the current model.

Leading in the Competitive AI Space

As Character.AI navigates these challenges, Anand’s objectives include fostering a creator ecosystem and enhancing the platform’s social feed, where users can share content created with chatbots. This feature mirrors an app launched by Meta, allowing public sharing of AI-generated creations.

The social element could differentiate Character.AI from larger competitors like ChatGPT, which also sees users forming personal connections with AI. However, privacy concerns remain, as evidenced by Meta’s experience with users sharing conversations containing personal details.

Anand also faces the challenge of retaining and growing Character.AI’s workforce amid an AI talent war. The tech industry is fiercely competitive, with companies like Meta offering lucrative pay packages to attract top talent. Character.AI’s co-founder and former CEO Noam Shazeer was recently enticed back to Google, highlighting the competitive landscape.

“It is hard, I will not lie,” Anand admitted. “The good news for me as CEO is all the people we have here are very, very passionate and mission driven.”

The Future of Character.AI

Looking ahead, Anand is optimistic about the platform’s potential in the realm of interactive AI entertainment. His leadership will be crucial in navigating the complex issues of safety, competition, and innovation. As Character.AI continues to evolve, the company aims to redefine how users interact with AI, offering a unique blend of entertainment and engagement.

The coming months will be pivotal for Character.AI as it implements Anand’s vision and addresses the multifaceted challenges of the AI landscape. With a focus on safety, creativity, and user experience, Character.AI is poised to make significant strides in the world of AI-driven entertainment.