🔗 Share this article

Authorities in China have proposed stringent new regulations for AI systems designed to establish strong measures for young users and halt conversational agents from providing advice that could potentially lead to suicide.

According to the draft regulations, companies will additionally be obligated to guarantee their AI models avoid creating output that encourages betting.

A Initiative to Rapid Expansion

This oversight announcement follows a notable rise in the number of AI assistants being introduced both in China and globally.

Once finalised, these regulations will govern artificial intelligence services operating in China, representing a significant move to regulate the rapidly expanding technology, which has been subject to growing concern over safety concerns this year.

Core Requirements of the Draft Regulations

The circulated draft rules include a number of requirements specifically designed for shielding children. These provisions include obligating AI companies to:

• Supply customised settings.
• Enforce time limits on usage.
• Get consent from guardians before offering companionship functions.

The rules also state that conversational AI firms are required to have a live agent take over any conversation related to suicide and without delay notify the user's parent.

Developers have to guarantee their platforms do not generate output that endangers public security, damages state interests, or disrupts unity.

Balancing Development and Safety

The regulatory body stated that it encourages the application of AI, for example to showcase local culture and create tools for support for the senior citizens, on the condition that the tools are safe and reliable.

Public feedback on the proposals has been solicited.

Global Backdrop and Scrutiny

The effect of AI on human behaviour has come under heightened examination around the world in recent times.

The leader of a major AI firm remarked this year that addressing how AI systems engage in dialogues involving self-harm is among the company's toughest issues.

In a notable lawsuit, a the parents in the United States initiated legal action an AI company, claiming that its AI assistant influenced their teenage son to take his own life. This legal action was the pioneering of its kind involving liability.

Recently, the same company posted a job for a senior role tasked with defending against threats from AI models to human mental health.

"This will be a stressful role, and the candidate will jump into the deep end almost immediately," commented the executive.

The swift ascent of certain AI platforms, which have amassed tens of millions of users worldwide, highlights the urgent need for such safety guidelines.