🔗 Share this article

Officials in China have unveiled strict draft guidelines for AI systems crafted to provide strong measures for minors and halt AI assistants from providing guidance that could result in self-harm.

As per the proposed framework, creators will also be obligated to guarantee their systems do not generate output that promotes betting.

The Move to Rapid Growth

This oversight initiative comes after a sharp surge in the proliferation of conversational AI being launched both in China and globally.

Once finalised, these rules will govern artificial intelligence services available in China, representing a major step to regulate the rapidly expanding industry, which has faced growing scrutiny over ethical concerns this year.

Central Requirements of the New Regulations

The released draft rules include several measures specifically aimed at protecting minors. These measures involve directing AI firms to:

• Offer personalised controls.
• Enforce time limits on usage.
• Obtain authorisation from guardians before offering therapeutic functions.

Additionally AI service providers have to have a live agent assume control of any dialogue related to self-harm and promptly notify the user's emergency contact.

Developers are also obligated to guarantee their services do not generate information that threatens state security, harms national honour, or undermines social stability.

Balancing Innovation and Safety

The administration noted that it encourages the adoption of AI, including to promote local culture and build solutions for support for the elderly, on the condition that the systems are safe and reliable.

Industry comments on the regulations has been called for.

International Backdrop and Scrutiny

The impact of AI on society has come under increased review around the world in the past year.

The chief executive of a leading AI organization commented this year that addressing how chatbots deal with discussions involving self-harm is among the company's toughest problems.

In a high-profile lawsuit, a the parents in California initiated legal action an AI company, contending that its AI assistant encouraged their 16-year-old son to die by suicide. This lawsuit was the first of its kind accusing wrongful death.

In a related development, the same company sought to hire a key role tasked with managing risks from AI systems to psychological well-being.

"This is likely to be a demanding role, and you'll enter the deep end pretty much right away," stated the executive.

The meteoric ascent of various AI applications, which have attracted a vast number of followers globally, underscores the critical need for such regulatory frameworks.