OpenAI Bans Suspected China-Linked Accounts Over Surveillance Requests

San Francisco, October 7, 2025 — OpenAI has taken decisive action to uphold its commitment to ethical AI usage by banning several ChatGPT accounts suspected of being linked to Chinese government entities. These accounts reportedly violated OpenAI’s national security policies by seeking guidance on developing surveillance tools and engaging in activities that conflict with the company’s strict ethical guidelines.

Surveillance Proposals and Profiling Tools

OpenAI’s latest public threat report reveals that some banned accounts requested ChatGPT’s help in designing social media monitoring tools. Key examples include:

• Social Media Listening Tool: One request involved drafting promotional materials and project plans for a tool meant to scan platforms such as X (formerly Twitter), Facebook, Instagram, Reddit, TikTok, and YouTube. The tool aimed to detect content labeled as extremist or politically sensitive. While OpenAI found no evidence the tool was ever built, the very request raised significant concerns about potential AI misuse for mass surveillance.
• High-Risk Uyghur-Related Inflow Warning Model: Another user sought assistance to create a system that could analyze transport bookings and cross-reference them with police records, targeting individuals deemed “high-risk,” specifically in the Uyghur community. OpenAI confirmed no such model was implemented but flagged the request as a potential risk for profiling and monitoring ethnic groups.

Phishing and Malware Campaigns

In addition to surveillance requests, OpenAI identified several Chinese-language accounts attempting to use ChatGPT for malicious purposes, including:

• Automating phishing attacks
• Enhancing malware campaigns

In one instance, a user sought help drafting a proposal for a “High-Risk Uyghur-Related Inflow Warning Model,” which would track travel movements of the Uyghur community. Although no such system was implemented, this demonstrates the potential for AI misuse to infringe on individual rights and freedoms.

OpenAI’s Response and Global Implications

OpenAI’s actions come amid growing concerns about authoritarian regimes using AI to suppress dissent and monitor populations. By banning these accounts, OpenAI emphasizes its commitment to:

• Preventing misuse of its AI technology
• Ensuring responsible use of its models

The company confirmed that no new offensive capabilities were provided to threat actors, stating:

“We found no evidence of new tactics or that our models provided threat actors with novel offensive capabilities.”

Since starting public threat reporting in February 2024, OpenAI has disrupted and reported over 40 malicious networks. The company continues monitoring threats and safeguarding its platforms against misuse.

The Broader Context

This incident highlights the growing geopolitical tensions surrounding AI development and its misuse potential. Key points include:

• The increasing integration of AI into society raises the stakes for potential exploitation by state and non-state actors.
• Robust policies and international cooperation are essential to ensure AI promotes human rights and democratic values.
• OpenAI’s proactive stance serves as a reminder to tech companies and governments about the importance of ethical considerations in AI deployment.

The Chinese embassy in the U.S. has not commented on the matter. Nevertheless, the situation contributes to ongoing debates about AI governance and corporate responsibility.

As discussions on AI ethics intensify, OpenAI’s approach may set a precedent for other companies in balancing innovation, security, and human rights considerations.

Conclusion

OpenAI’s decision to ban suspected China-linked accounts for surveillance proposals underscores the urgent need for ethical oversight in AI development. As AI continues to shape our world, its use must align with principles of justice, transparency, and respect for individual freedoms.