Presentation on approaches, tools, automation techniques for testing Android applications. Including demo how we do it at Flo Health. Will be useful for QA engineers who would like to start woking on Android apps testing, developers and managers who would like to introduce testing at their project.

1. Android Apps Testing in 2019
Ivan Katunou

2. About myself
• Software Engineer in Test at Flo Health
• 12 years of experience in IT, 9 years in
automated testing
• Organizer of Minsk Test Automation
Meetup

3. Agenda
1. Introduction
2. Mobile Testing Basics
3. Infrastructure
4. Test Automation
5. Test Automation at Flo Health
6. Demo

4. http://www.wallpapermaiden.com/wallpaper/20209/futuristic-city-towers-buildings-digital-art-sci-fi/download/1920x1080
2014

5. https://1366x768wallpaper.com/games/takkar-mammoths-far-cry-primal-wallpaper--LWNW
2019

6. Mobile Team
Android Developer QA Automation EngineerQA Engineer
https://www.flaticon.com/categories/people

7. Agenda
1. Introduction
2. Mobile Testing Basics
3. Infrastructure
4. Test Automation
5. Test Automation at Flo Health
6. Demo

8. Mobile App Testing

9. Mind maps. Mnemonics
https://badootech.badoo.com/mind-maps-for-fast-and-effective-testing-30aab6bea6f4

10. Official Documentation
1. Test apps on Android
2. Android Testing Codelab
- Types of tests
- Tools
- Samples
- Test project

11. Backend
https://blog.aspiresys.com/digital/mobility/what-is-mobile-backend-as-a-service-mbaas/

12. Agenda
1. Introduction
2. Mobile Testing Basics
3. Infrastructure
4. Test Automation
5. Test Automation at Flo Health
6. Demo

13. Tools
adb
logcat pidcat

14. Developer Options

15. Tools
adb
logcat
Developer options
pidcat

16. Android Profiler

17. Tools
adb
logcat
Developer options
Android Profiler
pidcat

18. Charles

19. Fiddler

20. Tools
adb
logcat
Developer options
Android Profiler
Charles Fiddler
pidcat

21. Crashlytics

22. Tools
adb
logcat
Developer options
Android Profiler
Charles Fiddler
Crashlytics
pidcat

23. HockeyApp

24. Tools
adb
logcat
Developer options
Android Profiler
Charles Fiddler
Crashlytics
HockeyApp
pidcat

25. Emulator

26. Genymotion
https://www.genymotion.com/

27. Emulator + Docker

28. Local Device Farm

29. Cloud Based Solutions

30. Agenda
1. Introduction
2. Mobile Testing Basics
3. Infrastructure
4. Test Automation
5. Test Automation at Flo Health
6. Demo

31. Mobile Test Pyramid
https://developer.android.com/training/testing/fundamentals

32. Unit and Integration Levels
https://developer.android.com/training/testing/fundamentals

33. Unit and Integration Levels

34. UI Test Automation
https://developer.android.com/training/testing/fundamentals

35. UI Test Automation
https://developer.android.com/training/testing/fundamentals

36. Criteria
http://detodounpocofrl.blogspot.com/2016/05/los-famosos-checklist.html

37. Cross Platform Test Automation
https://lab3.co.nz/native/

42. Agenda
1. Introduction
2. Mobile Testing Basics
3. Infrastructure
4. Test Automation
5. Test Automation at Flo Health
6. Demo

43. Tools Evaluation
• Past experience (Appium, Robotium)
• Real devices and emulators
• Support
• Java-based tests, additional libraries support
• Speed of execution
• Does not require instrumentation
• Both local and cloud executions
• Developers can write UI tests

44. Tools Evaluation

45. Espresso

46. Espresso

47. Android Test Orchestrator
• Run each test in it’s own instrumentation process
• Clear app state between tests

48. Kakao

49. Barista

50. Recent news from Google
https://www.youtube.com/watch?v=wYMIadv9iF8

51. Android Test
Part of Jetpack
Common API for each level
Run Espresso tests using Robolectric

52. Project Nitrogen
Standalone binary written in Kotlin
Unified test runner (including sharding, parallel and multidevice
execution)
youtu.be/-_kZC29sWAo
Device management (simulated, virtual, real, device labs)
Improves reporting and debugging
Works with any build system
Supports host and device plugins

53. Agenda
1. Introduction
2. Mobile Testing Basics
3. Infrastructure
4. Test Automation
5. Demo

54. Overall Results
• POC development took less than one day
• Started with covering manual QA acceptance tests
• Requires periodic maintenance
• Can be used with good old page object
• Can reuse resources from the Android app project
• Developing tests in Kotlin is a pleasure
• Next steps: increase coverage

55. UI Bugs Experiment
Stream A B C
Total bugs 35 104 102
UI bugs 2 2 3
UI bugs/Total
bugs
~6% ~2% ~3%
Severity: 5 – Medium, 2 - Low

56. github.com/NavitaK/mobile-testing

57. Thank You! Any Questions?

58. Contacts
• Ivan Katunou, Software Engineer in Test at Flo Health
• ivan.katunou@gmail.com
• @IvanKatunou (Telegram)
• +375 29 259 56 42 (Viber, GSM)