Testing Assembly 2022

1. @ru_altom
Mobile Automation for
Unity Games
Ru Cindrea - Altom

2. @ru_altom
About me
and Altom
● started as a tester in 2002
● partner and software tester at Altom since 2008
○ software testing services
○ testing training - BBST series online
● into automation in general, mobile testing, mobile automation,
game testing and game development, specifically in Unity
@ru_altom

3. @ru_altom
About me
and Altom
● worked with Bitbar on using Bitbar Cloud for mobile games testing
using image recognition
● working on a concept development project developing apps with
Unity for fast prototyping
● working as an automation engineer for games
@ru_altom

4. @ru_altom
Game testing world

5. @ru_altom
● Fragmentation!
Mobile games: too many device + OS + screen resolution combinations to test manually
https://gs.statcounter.com/
Challenges with non-automated approach

6. @ru_altom
● Games are generally complex and testing all
functionalities manually becomes too time consuming
● Platform diversity - one codebase but testing-wise a lot of
ground to cover
Challenges with non-automated approach

7. @ru_altom
Options for Mobile Game Automation

8. @ru_altom
Unity Test Framework

9. @ru_altom
● Unity Test Runner with Edit / Play Mode
○ Great for unit testing and integration testing
○ Not suitable for end-to-end testing on target
devices/platforms
Unity Test Framework

10. @ru_altom
UI Automation

11. @ru_altom

12. @ru_altom
Works with Browserstack, Bitbar Cloud,
AWS and other Device Cloud platforms
Supports iOS and Android,
Mac, Windows
Testers who are familiar with
Selenium find it easy
Offers great interaction with
the target platform
Many programming languages
APPIUM

13. @ru_altom

14. @ru_altom
Click at coordinates

15. @ru_altom
Image Recognition

16. @ru_altom
Define “House” element using an image

17. @ru_altom
Define “House” element using an image

18. @ru_altom
OpenCV - Feature detection and matching

19. @ru_altom
OpenCV - Feature detection and matching

20. @ru_altom
OpenCV - Feature detection and matching

21. @ru_altom
Resolution Agnostic, works rotated and stretched items

22. @ru_altom
Resolution Agnostic, works rotated and stretched items

23. @ru_altom
Resolution Agnostic, works rotated and stretched items

24. @ru_altom
Resolution Agnostic, works rotated and stretched items

25. @ru_altom
● worked well for simple scenarios
● didn’t require any changes to the game
● found really useful issues
○ out of memory problems
○ crashes
○ graphics missing/not displayed correctly
Image Recognition + Appium
https://github.com/bitbar/testdroid-samples/tree/master/image-recognition

26. @ru_altom
● was not fast enough
● graphics change all the time in games
● didn't work well for apps that had a lot of text
● didn’t give enough granularity when it came to identifying objects
Image Recognition + Appium
https://github.com/bitbar/testdroid-samples/tree/master/image-recognition

27. @ru_altom
Beyond Image Recognition

28. @ru_altom

29. @ru_altom

30. @ru_altom
AltUnityTester

31. @ru_altom
Game/App
GamePlay Scene
MainMenu Scene
Obstacle
Cat
Start Button
Shop Button

32. @ru_altom
Game/App
GamePlay Scene
MainMenu Scene
Obstacle
Cat
Start Button
Shop Button
AltUnityTester
Prefab
AltUnityTester
Server
Port 13000

33. @ru_altom
Game/App
GamePlay Scene
MainMenu Scene
Obstacle
Cat
Start Button
Shop Button
AltUnityTester
Prefab
AltUnityTester
Server
socket connection
AltUnityTester
Bindings for: Works with: Editor
altUnityDriver = new AltUnityDriver(tcp_port = 13000);
Port 13000

34. @ru_altom
Game/App
GamePlay Scene
MainMenu Scene
Obstacle
Cat
Start Button
Shop Button
AltUnityTester
Prefab
AltUnityTester
Server
Load scene
{“scene”: “GamePlay”}
AltUnityTester
Bindings for: Works with: Editor
altUnityDriver = new AltUnityDriver(tcp_port = 13000);
altUnityDriver.LoadScene(“GamePlay”);
Port 13000

35. @ru_altom
Game/App
GamePlay Scene
MainMenu Scene
Obstacle
Cat
Start Button
Shop Button
AltUnityTester
Prefab
AltUnityTester
Server
Find “Cat”
{“el”: “cat”, “x”: 50, “y”: 60}
AltUnityTester
Bindings for: Works with: Editor
altUnityDriver = new AltUnityDriver(tcp_port = 13000);
altUnityDriver.LoadScene(“GamePlay”);
var cat = altUnityDriver.FindObject(By.NAME, “Cat”);
cat.Tap();

36. @ru_altom
AltUnityTester 1.0
https://gitlab.com/altom/altunity/altunitytester

37. @ru_altom
AltUnityTester 1.2
Appium Driver

38. @ru_altom
● worked well even for complex scenarios
● really fast and worked for all types of games
● tests are easier to maintain than with image recognition
AltUnityTester for Mobile Automation
https://gitlab.com/altom/altunity/altunitytester

39. @ru_altom
● requires a special / instrumented game build
● doesn’t work with all device cloud farms at the moment
AltUnityTester for Mobile Automation
https://gitlab.com/altom/altunity/altunitytester

40. @ru_altom
Struggles with UI Automation in Games

41. @ru_altom
● Every change in the code is tested
○ functional tests as automated scripts
○ give continuous feedback on how other parts of the
software are affected by the change
Traditional / Agile Software Development

42. @ru_altom
● QA team performs functional testing once features are
completed
● Playtesting, Alpha testing, Beta testing
Game Software Development

43. @ru_altom
● Small teams => no dedicated testers, developers don’t
have time to invest in automated tests
● Large teams => large teams of “manual” testers with not
enough coding skills
Struggles with UI Automation in Games

44. @ru_altom
● Make the tools more accessible to testers that have no
coding skills
● Offer support as much as possible
○ https://discord.gg/Ag9RSuS
● Keep the development engagement
Struggles with UI Automation in Games

45. @ru_altom
Keep the conversation going

46. @ru_altom
Thank you!
ru@altom.com