A truly kick-ass videogame combines clever code, gorgeous graphics, and artful animation—plus thousands of hours of hard work.
Researchers at Electronic Arts—the company behind FIFA, Madden, and other popular games—are testing recent advances in artificial intelligence as a way to speed the development process and make games more lifelike. And in a neat twist, the researchers are harnessing an AI technique that proved itself by playing some of the earliest console videogames.
A team from EA and the University of British Columbia in Vancouver is using a technique called reinforcement learning, which is loosely inspired by the way animals learn in response to positive and negative feedback, to automatically animate humanoid characters. “The results are very, very promising,” says Fabio Zinno, a senior software engineer at Electronic Arts.
Traditionally, characters in videogames and their actions are crafted manually. Sports games, such as FIFA, make use of motion capture, a technique that involves tracking a real person often using markers on their face or body, to render more lifelike actions in human characters. But the possibilities are limited by the actions that have been recorded, and code still needs to be written to animate the character.
By automating the animation process, as well as other elements of game design and development, AI could save game companies millions of dollars while making games more realistic and efficient, so that a complex game can run on a smartphone, for example.
Reinforcement learning has sparked excitement in recent years by letting computers learn to play complex games and solve vexing problems without any instruction. In 2013, researchers at DeepMind, a UK company later acquired by Google, used reinforcement learning to create a computer program that learned to play several Atari videogames to a superhuman level. The program learned to play through experimentation and feedback from the pixels and the game score. DeepMind later employed the same technique to build a program that mastered the fiendishly complex and subtle board game Go, among other things.
In work to be presented in July at Siggraph 2020, a computer graphics conference, the EA-UBC researchers show that reinforcement learning can create a controllable soccer player that moves realistically without using conventional coding or animation.
To make the character, the team first trained a machine-learning model to identify and reproduce statistical patterns in motion-capture data. They then used reinforcement learning to train another model to reproduce realistic motion with a specific objective, such as running toward a ball in the game. Crucially, this produces animations not found in the original motion-capture data. In other words, the program learns how a soccer player moves, and can then animate the character jogging, sprinting, and shimmying by itself.
“I can definitely see this technology being useful in different ways,” says Julian Togelius, a professor at NYU and the cofounder of a Modl.ai, a company that makes AI tools for games. He adds that the reinforcement learning project is part of a wave of automated or “procedural generation” methods that will transform how game content is created.
“Procedural animation will be a huge thing,” Togelius says. “It basically automates a lot of the work that goes into building game content.”
As consoles, PCs, and smartphones become ever-more powerful, games will become increasingly sophisticated and complex, requiring greater investment from game companies. Existing tools can help make designers and animators more efficient, but they’re still needed at every step. Just as AI can concoct photo-realistic faces and scenes when fed enough data, algorithms may automate the creation of new characters and scenes.
AI could generate content for other genres, including action and role-playing games. Some game companies are experimenting with procedural generation as a way to make games more expansive. A simple method is used to generate new worlds for players to explore in No Man’s Sky, a space-based survival game released in 2016. Togelius says AI is also emerging as a powerful way to test games and find bugs, using artificial players.