The company said a Chinese operation had built the tool to identify anti-Chinese posts on social media services in Western countries.

OpenAI recently banned several accounts that had been using ChatGPT to write sales pitches and debug code for a suspected social media surveillance tool that likely originated in China, the company said — part of a broader effort by the AI startup to police malicious uses of its powerful AI models.

OpenAI released a report today detailing numerous examples of how the company has disrupted malicious uses of its AI models, including banning some accounts for how they’re using ChatGPT. In two of the case studies,

OpenAI said Feb. 21 that it had identified and removed several North Korean-linked accounts that misused ChatGPT to create fake resumes and online profiles. According to the company, the accounts used ChatGPT-generated materials to apply for jobs at Western companies.

OpenAI has banned several accounts from China using its AI to create sales pitches for a social media surveillance company. These accounts aimed to collect real-time data on anti-China protests for Chinese authorities,