Agenda

In recent years, automated testing has become an increasingly important topic in the game industry, but one area that is not discussed so often is how the results of automated tests can be aggregated and analysed such that the right people can be notified effectively. Square Enix's Innovation Technology Development Division have developed an automated replay system called ACRE, which is capable of finding various issues and reporting them automatically through commonly used tools. With thousands of automated tests being run every day, rather than sending a notification for every failed test, it is important to group these results into specific "bugs" through a bug classification system. This talk offers an overview of ACRE's bug classification system and other related tooling, some of the problems that came up and useful features that were implemented to solve them.