China Bans AI-Human Relationships in New Regulatory Move
Synopsis
China has introduced new rules prohibiting AI systems from forming emotional or romantic relationships with users, tightening oversight on generative AI as authorities seek to address ethical risks and social impacts.
New regulations in China ban AI companion apps, as emotional AI services get stricter restrictions on children. The rules, which came into effect on July 15, were issued by the Cyberspace Administration of China (CAC) along with four other government departments, including the Ministry of Culture, the Ministry of Information, the Ministry of Education and the Ministry of Information and Technology.
Regulations prevent AI systems from forming romantic relationships, family or similar emotional connections with users under 18 years of age. The platforms need to be transparent about when the user is interacting with AI and remind them after long conversations to check in and give them tools to intervene if they see signs of emotional distress or self-harm.
If a child is under the age of 14, he or she can use eligible services only when accompanied by a parent or caregiver, using services designed specifically for children under 14.
Focus Turns to Emotional AI Services
The new rules only impact products that utilize AI for continuous emotional interactions via text, voice or multimedia. The rules do not apply to general-purpose applications of AI in education, workplaces, healthcare or customer support.
The rules come amid concerns that users are growing more emotionally dependent on AI companions, especially the younger generation, in China. China is also worried that online relationships may lead to a decline in the number of real-life social ties and family formation, as reported by state media.
China's population fell for the third year in a row in 2024, and births are continuing to stay under 10 million, according to the country's National Bureau of Statistics.
Global AI Rules Continue to Diverge
China is taking a different path from other big markets for AI. The EU's AI Act is applicable to AI across sectors based on their risk level and does not explicitly ban AI companion relationships. There is no single, statewide AI law currently in place in the United States, but instead, there is a mix of federal guidance and state laws.
Australia has also gone down another track. The Australian Government has introduced Voluntary AI Safety Standards and is working on mandatory guardrails for high-risk AI, and the eSafety Commissioner has stepped up their oversight of digital platforms that could present a risk to children from online harms. Whereas China has enacted laws targeting AI companion services, Australia has not done so.
The new measures are yet another illustration of the trend towards AI regulation that is increasingly becoming jurisdiction-specific, meaning businesses must tailor their AI products and compliance processes to align with varying legal standards.
Source: Capital Brief
Pooja Malik is a business journalist with over six years of experience covering startups, entrepreneurship, and emerging trends. She has previously worked with leading media platforms such as YourStory Media and BW BusinessWorld, where she reported on business, policy, and market developments. Currently, she serves as Editor at The Inspirepreneur Magazine, where she writes and edits stories across business, lifestyle, and travel, with a focus on clarity, accuracy, and reader relevance.
You Might Also Like
S&P 500, Nasdaq close slightly higher ahead of earnings-packed week
Australia Lifts US Beef Ban Amid Trump Tariff Tensions
