OpenAI has taken action against a network of accounts linked to China that misused its AI models, including ChatGPT, to develop AI-powered social media surveillance tools.
According to OpenAI’s latest threat intelligence report, the banned accounts had been leveraging ChatGPT to debug and edit code for an AI system designed to monitor social media activity. The users also employed OpenAI’s technology to generate sales pitches and analyze political topics, indicating a potential connection to government-led information operations.
The report highlights how OpenAI is actively identifying and dismantling malicious use cases of its models. This move aligns with OpenAI’s strict policies against using AI for mass surveillance, political manipulation, and unauthorized monitoring of individuals.
This enforcement action is part of OpenAI’s broader efforts to prevent misuse of its technology by state-affiliated groups or threat actors. The company reiterated its commitment to responsible AI deployment and collaboration with cybersecurity experts to curb AI-driven threats.
Source: Micro News