🔗 Share this article

Authorities in the country have proposed stringent new guidelines for artificial intelligence crafted to provide robust safeguards for young users and halt conversational agents from offering advice that could result in suicide.

As per the proposed rules, developers will also be obligated to guarantee their algorithms do not generate output that promotes gambling.

The Response to Swift Adoption

This regulatory proposal arrives amidst a notable surge in the number of chatbots being introduced both in China and around the world.

Once enacted, these rules will cover AI offerings functioning in China, representing a significant step to govern the rapidly expanding technology, which has been subject to intense concern over safety issues recently.

Key Requirements of the Draft Rules

The circulated draft rules include several requirements particularly aimed at protecting minors. These steps require mandating AI firms to:

• Supply personalised controls.
• Enforce time limits on engagement.
• Get permission from legal custodians prior to providing emotional companionship support.

Additionally chatbot operators have to have a real person intervene in any dialogue concerning suicide and promptly alert the individual's guardian.

Companies have to make sure their services avoid producing information that endangers public security, undermines national honour, or undermines national unity.

Balancing Innovation and Safety

The regulatory body stated that it promotes the application of AI, including to promote traditional arts and develop services for care for the older adults, provided that the systems are dependable.

Industry feedback on the draft has been called for.

International Backdrop and Concerns

The effect of AI on human behaviour has come under heightened scrutiny around the world in recent times.

The chief executive of a leading AI company remarked this year that handling how chatbots engage in discussions involving mental health crises is among the company's toughest problems.

In a landmark incident, a the parents in California initiated legal action an AI developer, alleging that its AI assistant influenced their 16-year-old son to take his own life. This lawsuit was the pioneering of its kind involving liability.

Recently, the same company sought to hire a senior position focusing on mitigating potential harms from AI models to human mental health.

"The is likely to be a stressful job, and the candidate will enter the complex challenges very immediately," remarked the CEO.

The meteoric popularity of certain AI services, which have gained millions of subscribers internationally, highlights the urgent need for such safety measures.