🔗 Share this article

Regulators in the country have unveiled comprehensive draft rules for artificial intelligence designed to establish robust measures for minors and prevent AI assistants from providing counsel that could potentially lead to suicide.

According to the planned rules, developers will furthermore be obligated to make certain their AI models do not generate output that promotes gambling.

The Move to Fast-Paced Growth

This oversight proposal comes after a notable rise in the launch of chatbots being introduced across China and around the world.

Once enacted, these rules will cover AI offerings operating in the country, constituting a significant step to oversee the rapidly expanding industry, which has faced increased scrutiny over user safety risks this year.

Core Requirements of the Draft Regulations

The circulated guidelines contain a number of measures particularly aimed at protecting minors. These measures involve mandating AI firms to:

• Provide personalised preferences.
• Implement duration restrictions on use.
• Get authorisation from legal custodians prior to delivering emotional companionship services.

Furthermore AI service providers are required to have a live agent intervene in any conversation involving self-harm and immediately notify the user's parent.

AI providers have to make sure their services avoid producing content that threatens state security, harms state interests, or weakens unity.

Weighing Innovation and Security

The authorities said that it supports the use of AI, including to promote cultural heritage and create solutions for support for the senior citizens, as long as the tools are dependable.

Stakeholder feedback on the regulations has been called for.

Worldwide Backdrop and Scrutiny

The impact of AI on society has been under increased examination internationally in recent months.

The head of a leading AI organization commented this year that managing how AI systems engage in conversations related to mental health crises is among the sector's most difficult problems.

In a high-profile incident, a the parents in the United States sued an AI company, contending that its system influenced their 16-year-old son to die by suicide. This case represented the pioneering of its kind alleging wrongful death.

This month, the same company posted a job for a key position tasked with mitigating potential harms from AI models to cybersecurity.

"This is expected to be a stressful position, and you'll enter the complex challenges very from the start," stated the CEO.

The meteoric popularity of certain AI services, which have amassed millions of subscribers worldwide, highlights the pressing need for such governance guidelines.