{"id":10687,"date":"2023-08-23T11:25:21","date_gmt":"2023-08-23T11:25:21","guid":{"rendered":"https:\/\/mysourcefunding.com\/startups\/scammers-used-chatgpt-to-unleash-a-crypto-botnet-on-x\/"},"modified":"2023-08-23T11:25:22","modified_gmt":"2023-08-23T11:25:22","slug":"scammers-used-chatgpt-to-unleash-a-crypto-botnet-on-x","status":"publish","type":"post","link":"https:\/\/mysourcefunding.com\/?p=10687","title":{"rendered":"Scammers Used ChatGPT to Unleash a Crypto Botnet on X"},"content":{"rendered":"
\n

OpenAI had not responded to a request for comment about the botnet by time of posting. The usage policy for its AI models prohibits using them for scams or disinformation.<\/p>\n

ChatGPT, and other cutting-edge chatbots, use what are known as large language models to generate text in response to a prompt. With enough training data (much of it scraped from various sources on the web), enough computer power, and feedback from human testers, bots like ChatGPT can respond in surprisingly sophisticated ways to a wide range of inputs. At the same time, they can also blurt out hateful messages, exhibit social biases, and make things up.<\/p>\n

A correctly configured ChatGPT-based botnet would be difficult to spot, more capable of duping users, and more effective at gaming the algorithms used to prioritize content on social media.<\/p>\n

\u201cIt tricks both the platform and the users,\u201d Menczer says of the ChatGPT-powered botnet. And, if a social media algorithm spots that a post has a lot of engagement\u2014even if that engagement is from other bot accounts\u2014it will show the post to more people. \u201cThat’s exactly why these bots are behaving the way they do,\u201d Menczer says. And governments looking to wage disinformation campaigns are most likely already developing or deploying such tools, he adds.<\/p>\n

Researchers have long worried that the technology behind ChatGPT could pose a disinformation risk, and OpenAI even delayed the release of a predecessor to the system over such fears. But, to date, there are few concrete examples of large language models being misused at scale. Some political campaigns are already using AI though, with prominent politicians sharing deepfake videos<\/a> designed to disparage their opponents.<\/p>\n

William Wang, a professor at the University of California, Santa Barbara, says it is exciting to be able to study real criminal usage of ChatGPT. \u201cTheir findings are pretty cool,\u201d he says of the Fox8 work.<\/p>\n

Wang believes that many spam webpages are now generated automatically, and he says it is becoming more difficult for humans to spot this material. And, with AI improving all the time, it will only get harder. \u201cThe situation is pretty bad,\u201d he says.<\/p>\n

This May, Wang\u2019s lab developed a technique for automatically distinguishing ChatGPT-generated text from real human writing, but he says it is expensive to deploy because it uses OpenAI\u2019s API, and he notes that the underlying AI is constantly improving. \u201cIt\u2019s a kind of cat-and-mouse problem,\u201d Wang says.<\/p>\n

X could be a fertile testing ground for such tools. Menczer says that malicious bots appear to have become far more common since Elon Musk took over what was then known as Twitter, despite the tech mogul\u2019s promise to eradicate them. And it has become more difficult for researchers to study the problem because of the steep price hike imposed on usage of the API.<\/p>\n

Someone at X apparently took down the Fox8 botnet after Menczer and Yang published their paper in July. Menczer\u2019s group used to alert Twitter of new findings on the platform, but they no longer do that with X. \u201cThey are not really responsive,\u201d Menczer says. \u201cThey don\u2019t really have the staff.\u201d<\/p>\n<\/div>\n