Top video game dev nerve-center Unity can now be used to train AI

Hot graphics and complex worlds provide a good testbed for algorithms


Unity, the most popular cross-platform game engine favored by video game developers, on Tuesday opened up its platform for machine learning researchers to test their algorithms.

Reinforcement learning is a strand of machine learning that teaches agents to perform a specific task in a given environment. It’s been useful for training self-driving cars in simulation before they are tested on the roads, for training robots, and for teaching agents to play games like Go and poker.

If a bot makes a good move, it is rewarded with a point. Since it’s been programmed to collect these points, it’ll keep repeating these good actions until it learns how to perform a function. Transferring the skills learned digitally to real life is difficult, and it helps if the bot has been trained in a realistic rendering of its physical environment.

“At Unity, we wanted to design a system that provides greater flexibility and ease-of-use to the growing groups interested in applying machine learning to developing intelligent agents. Moreover, we wanted to do this while taking advantage of the high-quality physics and graphics, and simple yet powerful developer control provided by the Unity Engine and Editor,” the company said in a blog post.

The platform, known as Unity Machine Learning Agents, includes additional features like the Agent Monitor class, which allows researchers to better understand how agents make decisions so that mistakes are easier to debug.

The difficulty of a task can be gradually increased during the training process by increasing the complexity of the environment, and agents can also access multiple camera streams so they can survey more of their environments.

Since Unity Engine and Editor are geared toward game development, it also makes it easier for machine learning researchers to construct scenarios or even create full games to use as testbeds for their reinforcement learning algorithms.

But there is a slight tradeoff for having prettier graphics and more complex environments – it makes it more difficult for the algorithms to comprehend the play field, and requires more processing power from accelerators such as GPUs, so it’ll be more expensive to train agents.

Other companies such as Elon Musk’s OpenAI and DeepMind have also open-sourced similar environments: Gym and DeepMind Lab, respectively.

The beta for Unity Machine Learning Agents is available on Github here, and currently supports Windows, Mac and Linux. ®

Similar topics


Other stories you might like

  • Battlefield 2042: Please don't be the death knell of the franchise, please don't be the death knell of the franchise

    Another terrible launch, but DICE is already working on improvements

    The RPG Greetings, traveller, and welcome back to The Register Plays Games, our monthly gaming column. Since the last edition on New World, we hit level cap and the "endgame". Around this time, item duping exploits became rife and every attempt Amazon Games made to fix it just broke something else. The post-level 60 "watermark" system for gear drops is also infuriating and tedious, but not something we were able to address in the column. So bear these things in mind if you were ever tempted. On that note, it's time to look at another newly released shit show – Battlefield 2042.

    I wanted to love Battlefield 2042, I really did. After the bum note of the first-person shooter (FPS) franchise's return to Second World War theatres with Battlefield V (2018), I stupidly assumed the next entry from EA-owned Swedish developer DICE would be a return to form. I was wrong.

    The multiplayer military FPS market is dominated by two forces: Activision's Call of Duty (COD) series and EA's Battlefield. Fans of each franchise are loyal to the point of zealotry with little crossover between player bases. Here's where I stand: COD jumped the shark with Modern Warfare 2 in 2009. It's flip-flopped from WW2 to present-day combat and back again, tried sci-fi, and even the Battle Royale trend with the free-to-play Call of Duty: Warzone (2020), which has been thoroughly ruined by hackers and developer inaction.

    Continue reading
  • American diplomats' iPhones reportedly compromised by NSO Group intrusion software

    Reuters claims nine State Department employees outside the US had their devices hacked

    The Apple iPhones of at least nine US State Department officials were compromised by an unidentified entity using NSO Group's Pegasus spyware, according to a report published Friday by Reuters.

    NSO Group in an email to The Register said it has blocked an unnamed customers' access to its system upon receiving an inquiry about the incident but has yet to confirm whether its software was involved.

    "Once the inquiry was received, and before any investigation under our compliance policy, we have decided to immediately terminate relevant customers’ access to the system, due to the severity of the allegations," an NSO spokesperson told The Register in an email. "To this point, we haven’t received any information nor the phone numbers, nor any indication that NSO’s tools were used in this case."

    Continue reading
  • Utility biz Delta-Montrose Electric Association loses billing capability and two decades of records after cyber attack

    All together now - R, A, N, S, O...

    A US utility company based in Colorado was hit by a ransomware attack in November that wiped out two decades' worth of records and knocked out billing systems that won't be restored until next week at the earliest.

    The attack was detailed by the Delta-Montrose Electric Association (DMEA) in a post on its website explaining that current customers won't be penalised for being unable to pay their bills because of the incident.

    "We are a victim of a malicious cyber security attack. In the middle of an investigation, that is as far as I’m willing to go," DMEA chief exec Alyssa Clemsen Roberts told a public board meeting, as reported by a local paper.

    Continue reading

Biting the hand that feeds IT © 1998–2021