Elon Musk-backed OpenAI reveals Universe – a universal training ground for computers

Reinforcement learning environment hosts virtualized video games and more

Hoping to teach AI agents the common sense they need to solve arbitrary tasks without specific training, OpenAI on Monday will introduce Universe, a collection of virtualized video games, browser interfaces, and applications that serve as a training ground for code-based decision making.

Universe is open-source middleware that supports Gym, the organization's toolkit for developing and evaluating reinforcement learning (RL) algorithms. RL is used to train software perform specific actions, such as playing a videogame or making a 3D model walk, under a framework that prioritizes actions through a reward scheme.

Universe aims to accelerate the education of AI agents by broadening the number of available training resources. Previously, according to OpenAI, the largest RL resource consisted of 55 Atari games, the Atari Learning Environment. Universe, we're told, will include games from, among others, Valve, EA and Microsoft.

"Out of the box, Universe comprises thousands of games (e.g. Flash games, slither.io, Starcraft), browser-based tasks (e.g. form filling), and applications (e.g. fold.it)," OpenAI will say today in blog post seen by The Register.

"...Our eventual goal is to develop a single AI agent that can flexibly apply its past experience on Universe environments to quickly master new ones, which would be a major step towards general intelligence."

Universe software environments, instantiated in Docker containers, provide AI agents with screen pixels to interpret and accept their simulated keyboard and mouse input through a VNC remote desktop. With enough interaction, AI agents can become more capable at specific tasks.

It's unclear whether advances in narrow AI functions, like mastery of a particular video game, will lead to improvements in general AI, but OpenAI argues that providing a wide array of experiences will help software agents develop the abstract representations necessary for broadly applicable decision making.

OpenAI – a non-profit backed by Elon Musk, Sam Altman, Peter Thiel and others – sees Universe as the RL equivalent of ImageNet, a database of images used to train image recognition classifiers through supervised learning. It plans to work with Microsoft to integrate Universe with Project Malmo, the latter company's Minecraft-based AI platform.

As an example of what RL can do, OpenAI points to its agent for playing Slither, a web-based collision avoidance game involving multiple snakes. With approximately six days worth of training time, which simulates half a year of experience, the AI agent scored an average of 1,000 points, with a high score of 9,300 points. As a point of comparison, OpenAI machine-learning researcher Rafal Jozefowicz, with five hours of playing experience, averaged about 1,400 points, with a high score of 7,050.

AI training may involve a lot of game playing, but the goal is software that can contribute to a broad set of activities and industries.

"We are sure that the immense utility of AI will allow it to be used widely across society," said an OpenAI spokesperson in an email to The Register.

While making software smarter may appeal to researchers, society as a whole appears to be increasingly unnerved by the prospect. Beyond the speculative fears about malevolent AI and more realistic concerns about the automation of military weaponry, companies and individuals already have trouble dealing with automated forms of interaction.

Spam and robo calls continue to annoy. Blizzard for years has been struggling to stop bots from playing its games. Twitch this summer filed a lawsuit to prevent people from using bots to inflate their viewer counts. New York State recently criminalized ticket buying bots. Dallas Mavericks owner Mark Cuban, according to the Associated Press, revoked the credentials of two ESPN writers last month to protest the growing use of automated sports coverage.

If AI bots ever develop generalized problem solving skills, their first challenge will be to figure out how to reactivate after authorities shut them down. ®

PS: Google-stablemate DeepMind says it is going to open-source a system similar to Universe later this week.

Broader topics

Other stories you might like

  • Deepfake attacks can easily trick live facial recognition systems online
    Plus: Next PyTorch release will support Apple GPUs so devs can train neural networks on their own laptops

    In brief Miscreants can easily steal someone else's identity by tricking live facial recognition software using deepfakes, according to a new report.

    Sensity AI, a startup focused on tackling identity fraud, carried out a series of pretend attacks. Engineers scanned the image of someone from an ID card, and mapped their likeness onto another person's face. Sensity then tested whether they could breach live facial recognition systems by tricking them into believing the pretend attacker is a real user.

    So-called "liveness tests" try to authenticate identities in real-time, relying on images or video streams from cameras like face recognition used to unlock mobile phones, for example. Nine out of ten vendors failed Sensity's live deepfake attacks.

    Continue reading
  • Lonestar plans to put datacenters in the Moon's lava tubes
    How? Founder tells The Register 'Robots… lots of robots'

    Imagine a future where racks of computer servers hum quietly in darkness below the surface of the Moon.

    Here is where some of the most important data is stored, to be left untouched for as long as can be. The idea sounds like something from science-fiction, but one startup that recently emerged from stealth is trying to turn it into a reality. Lonestar Data Holdings has a unique mission unlike any other cloud provider: to build datacenters on the Moon backing up the world's data.

    "It's inconceivable to me that we are keeping our most precious assets, our knowledge and our data, on Earth, where we're setting off bombs and burning things," Christopher Stott, founder and CEO of Lonestar, told The Register. "We need to put our assets in place off our planet, where we can keep it safe."

    Continue reading
  • Conti: Russian-backed rulers of Costa Rican hacktocracy?
    Also, Chinese IT admin jailed for deleting database, and the NSA promises no more backdoors

    In brief The notorious Russian-aligned Conti ransomware gang has upped the ante in its attack against Costa Rica, threatening to overthrow the government if it doesn't pay a $20 million ransom. 

    Costa Rican president Rodrigo Chaves said that the country is effectively at war with the gang, who in April infiltrated the government's computer systems, gaining a foothold in 27 agencies at various government levels. The US State Department has offered a $15 million reward leading to the capture of Conti's leaders, who it said have made more than $150 million from 1,000+ victims.

    Conti claimed this week that it has insiders in the Costa Rican government, the AP reported, warning that "We are determined to overthrow the government by means of a cyber attack, we have already shown you all the strength and power, you have introduced an emergency." 

    Continue reading

Biting the hand that feeds IT © 1998–2022