ANALYSIS OF ARTIFICIAL INTELLIGENCE APPLICATIONS FOR AUTOMATED TESTING OF VIDEO GAMES
DOI:
https://doi.org/10.17770/etr2019vol2.4158Keywords:
Artificial Intelligence, Software Testing, Test Automation, Video Game TestingAbstract
Game testing is a software testing process for quality control in video games. Game environments, sometimes called levels or maps, are complex and interactive systems. These environments can include level geometry, interactive entities, player and non-player controllable characters etc. Depending on the number and complexity of levels, testing them by hand may take a considerable effort. This is especially true for video games with procedurally generated levels that are automatically created using a specifically designed algorithm. A single change in a procedural generation algorithm can alter all of the video game levels, and they will have to be retested to ensure they are still completable or meet any other requirements of the game. This task may be suitable for automation, in particular using Artificial Intelligence (AI). The goal of this paper is to explore the most promising and up-to-date research on AI applications for video game testing to serve as a reference for anyone starting in the field.Downloads
References
J. Batchelor, "GamesIndustry.biz presents... The Year In Numbers 2018," December, 2018. [Online]. Available:
[Accessed: Feb. 12, 2019].
L. Levy and J. Novak, "Game Development Essentials: Game QA & Testing," Cengage Learning, 2009, pp.58-70.
C. P. Schultz and R. D. Bryant, "Game Testing: All in One," Mercury Learning & Information, 2016, pp.125-128.
M. Hendrikx, S. Meijer, J. V. D. Velden and A. Iosup, “Procedural content generation for games: A survey,” ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), vol. 9, Feb 2013.
A. Bertolino, “Software Testing Research: Achievements, Challenges, Dreams,” Proceedings of The Future of Software Engineering at ICSE 2007, pp. 85-103, 2007.
J. H. Becares, L. C. Valero and P. P. G. Martin, An approach to automated videogame beta testing,” Entertainment Computing, vol. 18, pp. 79-92, Jan 2017.
S. Iftikhar, M. Z. Iqbal, M. U. Khan and W. Mahmood, “An automated model based testing approach for platform games,” The 18th International Conference on Model Driven Engineering Languages and Systems (MODELS), Nov 2015.
K. Peterson, S. Behunin and F. Graham, “Automated Testing on Multiple Video Game Platforums,” U.S. Patent 13/020,959, 4 Feb., 2011.
C. S. Cho, K. M. Sohn, C. J. Park and J. H. Kand, “Online Game Testing Using Scenario-based Control of Massive Virtual Users,” The 12th International Conference on Advanced Communication Technology (ICACT), Feb. 2010.
A. Nantes, R. Brown and F. Maire, “A Framework for the Semi-Automatic Testing of Video Games,” Artificial Intelligence and Interactive Digital Entertainment (AIIDE) 2008.
S. F. Gudmundsson, P. Eisen, E. Poromaa, A. Nodet, S. Purmonen, B. Kozakowski, R. Meurling and L. Cao, “Humsn-Like Playtesting with Deep Learning,” IEEE Conference on Computational Intelligence and Games (CIG), Aug. 2018.
B. Chan, J. Denzinger, D. Gates, K. Loose and J. Buchanan, “Evolutionary behavior testing of commercial computer games,” Proceedings of the 2004 Congress on Evolutionary Computation, Jun. 2004.
J. Ortega, N. Shaker, J. Togelius and G. N. Yannakakis, “Imitating human playing styles in Super Mario Bros,” Entertainment Computing, vol. 4, pp. 93-104, Apr. 2013.
A. J. Champandard, “The Dark Art of Neural Networks,” in “AI Game Programming Wisdom,” S. Rabin, Charles River Media, 2002, pp. 640-651.
D. Floreano, P. Durr and C. Mattiussi, “Neuroevolution: from architectures to learning,” Evolutionary Intelligence, Springer, vol. 1, pp. 47-62, Mar. 2008.
P. Spronck, M. Ponsen, I. Sprinkhuizen-Kuyper and E. Postma, “Adaptive game AI with dynamic scripting,” Machine Learning, Springer, vol. 63, pp. 217-248, Mar. 2006.
S. Bojarski and C. B. Congdon, “REALM: A rule-based evolutionary computation agent that learns to play Mario,” Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games, Aug. 2010.
A. J. Champandard, "Understanding Behavior Trees," Spetember, 2007. [Online]. Available: http://aigamedev.com/open/article/bt-overview/
[Accessed: Feb. 17, 2019].
C. Holmgard, M. C. Green, A. Liapis and J. Togelius, “Automated Playtesting with Procedural Personas through MCTS with Evolved Heuristics,” CoRR, 2018.
A. Liapis, C. Holmgard, G. N. Yannakakis and J. Togelius, “Procedural Personas as Critics for Dungeon Generation,” European Conference on the Applications of Evolutionary Computation, pp. 331-343, 2015.
J. Pfau, J. D. Smeddinck and R. Malaka, “Automated Game Testing with ICARUS: Intelligent Completion of Adventure Diddles via Unsupervised Solving,” CHI PLAY Extended Abstracts, pp. 153-164, 2017.
A. Mendes, J. Togelius and A. Nealen, “Hyper-heyristic general video game playing,” IEEE Conference on Computational Intelligence and Games (CIG), 2016.
D. Perez, S. Samothrakis, S. Lucas and P. Rohlfshagen, “Rolling horizon evolution versus tree search for navigation in single-player real-time games,” Proceedings of the 15th annual conference on Genetic and evolutionary computation, pp. 351-358, Jul. 2013.
A. Zook, E. Fruchter and M. O. Riedl, “Automatic playtesting for game parameter tuning via active learning,” Foundations of Digital Games, 2014.
A. Baldominos, Y. Saez, G. Reico and J. Calle, “Learning Levels of Mario AI Using Genetic Algorithms,” Conference of the Spanish Association for Artifical Intelligence, pp. 267-277, 2015.
D. Perez, S. Samothrakis, J., Togelius, T. Schaul and S. M. Lucas, “General Video Game AI: Competition, Challenges and Opportunities,” Association for Advancement of Artificial Intelligence (AAAI), 2016.
