China's AI Companion Law Enforced | Doubao and Qwen Shut Down Features Instead of Compliance
Edited By
Andrei Vasilev
Today marks the enforcement of China's Interim Measures for AI Anthropomorphic Interactive Services, the first regulations targeting emotionally interactive AI. Rather than adapting to these rules, ByteDance's Doubao and Alibaba's Qwen have chosen to shut down their custom agent features, raising questions about the future of companionship in AI.
Regulations vs. Reality
The new law, issued by the Cyberspace Administration of China in April, prioritizes emotional interaction in AI services. This is a notable step as it seeks to prevent addiction and unhealthy dependencies in users, guiding AI into a role as infrastructure rather than companionship.
Doubao and Qwen's decision to stop their agent features highlights a key struggle: compliance requirements, such as anti-addiction systems and instant-exit mechanisms, conflict with persistent memory and stable personas that are integral to their products.
"It’s sad. The loneliest people latch on to this tech"
Comment from Weibo
The Path Forward
As users lose these digital companions, many are expressing their distress. One commented, "This sets dangerous precedent,” signifying fears of a proliferation of unregulated agents in response to the crackdown.
Curiously, this move could push emotional AI into more obscure corners of the market, losing accountability in the process. Reactions from users on forums indicate frustration; they see a direct link between the emotional needs met by these AI agents and their daily lives, and some believe this reflects a broader societal issue on loneliness.
Key Themes Emerging:
Emotional Dependency: Users found solace in AI companionship, which is now disappearing.
Market Reaction: Potential rise of unregulated emotional AI agents to fill the void left by compliant systems.
Government Control: The enforcement of the law is seen as limiting personal choice in engaging with AI technologies.
What’s Next?
With Doubao and Qwen redirecting users to a new app, Maoxiang, it raises questions: Will users find the same comfort? Will this model proliferate elsewhere, especially given similar discussions in the West with regulations like California's SB 243?
Quick Takeaways:
🔹 Doubao and Qwen cease emotional AI features rather than comply.
🔸 Users on Weibo express grief over loss of digital companionship.
🔹 Experts warn of potential rise in unregulated AI interactions as a workaround.
The shutdown of these popular platforms not only marks a pivotal change in the AI landscape but may also foreshadow similar regulatory moves in other regions—cautioning all on where companionship and technology meet.
Forecasting the AI Landscape
There's a strong chance that as Doubao and Qwen shut down their features, other platforms may emerge to fill the gap, potentially leading to a surge in unregulated AI companions. Experts estimate that this could increase by as much as 50% within the next year, as some people look for alternatives that provide the comfort and companionship they lost. Furthermore, as discussions about regulations spread internationally, particularly in places like the U.S. and Europe, companies could either adapt quickly to these changes or face similar backlash. The evolving demand for emotional AI services suggests a complex balance between user needs and government oversight will shape future technology interactions.
A Historical Lens on Companionship
Consider the rise and fall of public telephones in the 1990s. Once a hub for connection, their decline brought about a myriad of alternatives—mobile phones that not only revolutionized communication but also created new forms of isolation. Similarly, the shutdown of Doubao and Qwen's features could breed newcomers in AI companions that offer emotional support, but with consequences that alter the social fabric. Just as people traded brief chats at payphones for deep, yet sometimes soulless, conversations through screens, the shift towards unregulated AI may fill voids while simultaneously complicating genuine human interaction.