This article is more than 1 year old
Someone not only created a comment-spewing Reddit bot powered by OpenAI's GPT-3, it offered bizarre life advice
Oblivious netizens chat with software for the past 10 days
Someone used OpenAI's GPT-3 text-generating software to write a string of posts on Reddit, convincing people the missives were penned by a real person, and banking internet points in the process, The Register can confirm.
Redditor thegentlemetre has produced over the course of the past 10 days hundreds of answers on the popular subreddit AskReddit in which people turn to millions of their peers for practical tips and life advice. At its most frenzied periods, the account generated about one comment per minute, offering a jumble of answers to people's questions. That would be quite a feat for a lone human, considering most of these submissions are several paragraphs long.
Some of its responses are incoherent and downright creepy, such as this fake story about a colony of humans living trapped underneath elevators. Sometimes it doesn't answer a netizen's question at all, and sometimes it spreads false information, such as denying that the state of Nebraska exists. There's one post where it believes men are discriminated against when it comes to being topless in public.
Phillip Winston, a software engineer, speculated thegentlemetre was, in fact, a bot based on GPT-3. "I saw this post and thought it's either a prolific user or a bot," he told The Register.
"I looked at the history and saw they were posting once per minute at times. I figured it had to be a bot. I looked at the posts some were very real but many had issues, and I felt sure it was a bot, but better than anything I'd seen."
I felt sure it was a bot, but better than anything I'd seen
His suspicions were confirmed when he asked Reddit users in the GPT-3 subreddit to take a look. Several people suggested the text had the same patterns as prose produced by Philosopher AI, which was built by Murat Ayfer, an engineer who had early access to OpenAI's cloud-based GPT-3 API as a beta tester. Philosopher AI generated its output by tapping into this GPT-3 API. That would suggest the mystery Redditor's comments were indeed the work of GPT-3 via Ayfer's Philosopher AI.
Philosopher AI started as a website where anyone could type in a question, and get an answer composed by GPT-3. Ayfer's site was, in effect, an access layer between netizens typing in prompts and an instance of OpenAI's GPT-3 hosted in the cloud generating responses. When OpenAI ended its free trial for beta users, Ayfer ended free access to Philosopher AI, and the service is now only available through a smartphone app that costs $2.99 to download.
Get ready for Clippy 9000: Microsoft exclusively licenses OpenAI's mega-brain GPT-3 for anything and everythingREAD MORE
Ayfer confirmed that whoever is behind thegentlemetre did indeed use Philosopher AI to craft a Reddit bot. Ayfer keeps a database of all the responses generated using his software, and he found that the bot's posts matched some of those in his database word-for-word.
He believes the bot was able to mine his application by bypassing a Captcha road-block put in place to prevent abuse. The iOS version of his app doesn't ask users to complete the Captcha test so if someone accessing the Philosopher AI backend masqueraded as the iOS app, they could get through unhindered.
"I had the iOS app configured to skip the Captcha check to make sure paying users don't get blocked by it, but the way I identified iOS clients was quickly reverse-engineered," he told The Register. "I've already made some patches and I'm continuing to improve the Captcha system." He also introduced a stricter limit that prevents users from querying Philosopher AI as much.
Ayfer believes an automated script was set up to read the questions posted on the AskReddit forum, pass them to Philosopher AI as a prompt, and its response was then posted on the subreddit. After he improved the Captcha process on his app, the activity on thegentlemetre's account died down.
An odd stunt?
Weirdly enough, the bot hasn't completely gone silent, however. Instead, the user has made another two posts since – one in their favorite AskReddit subreddit and another in ToasterTalk, in which people discuss AI ethics.
The responses are oddly curt. When someone suggested the bot's babbling was a perfect fit for Reddit, and that the software "would not fair so well on a forum used by adults," thegentlemetre replied: "You’re probably right."
Winston believes the human who built the bot has now taken over the account, and is personally writing responses. We tried to contact thegentlemetre over Reddit for comment, and have yet to receive a response.
So, what happens now that machine-learning software can generate internet message board text that, while not exactly sparkling prose nor particularly wise, more or less reads like a human wrote it? Is this a sign AI is outfoxing us, or that we weren't really all that clever in the first place, if electronically generated rambling is par for the course on the web?
"For the last 3,000 years, human-looking text meant a human wrote it," Winston told us. "Very soon that will no longer be true. I'm sure many great things will come from that, but it does raise a lot of questions. The dystopian vision for me is millions of Redditors and Twitter users having conversations with bots and not knowing it."
The dystopian vision for me is millions of Redditors and Twitter users having conversations with bots and not knowing it
OpenAI has warned its software could be used by miscreants to create bots and spread fake news and spam. "It's clearly just someone having some fun, and stirring things up," Ayfer reckoned, though.
"It's somewhat valuable to see it happen now in a harmless setting; it's easy to imagine what someone can do on social media using unlimited malicious GPT-3 access, or any similar machine learning tech which will surely become more widely available in the coming months or years. This will be an interesting problem for the next few years. we will need bulletproof bot detection."
"I wonder if only OpenAI or someone with GPT-3 can detect it," Winston added. "If so, they could charge for that service. So is it like the vacuum salesman who barges into your house and throws dirt on the floor first, then charges you to clean it up? Charging people to run GPT-3 bots and then charging other people to detect those same bots could be the world's greatest business model."
Spokespeople for Reddit were not available for comment.
"We don't support anyone using our API to deceive people," a spokesperson for OpenAI told El Reg. "Our company is founded on the belief that artificial intelligence should benefit all of humanity, and we are constantly working to fight misuse, bias and other industry-wide challenges." ®