This document discusses strategies for continuous shift-left automated testing in mobile apps. It recommends establishing a mobile testing automation pyramid with increasing levels of testing from unit tests up to end-to-end UI tests. The pyramid advocates automating 5% unit testing, 10% integration testing, 15% functional testing, and keeping 60% for manual testing and 10% for non-functional testing. It provides best practices for setting up a robust test automation framework that facilitates continuous testing, avoids flaky tests, and maximizes code reusability and test execution speed while reducing human errors.

1. Continuous Shift-Left Automated
Testing in
native Mobile apps
MTS 1, Software Engineer, Quality

2. About Suparna
■ XCTest, XCUITest, Selenium, Appium, Espresso, UIAutomator,
SeeTest, Postman, Jenkins, CircleCI, Junit, Nunit, TestNG, GIT
■ Written Tech solutions in BrowserStack, Lambdatest, Medium
■ 1st Winner of TechGig Testathon 2018 - "India's Best Tester"
■ Silver Winner of Applitools Automation Hackathon 2020 -
Top 70
suparna-khamaru
/in/suparnakhamaru/ super-tester.medium.com

3. Agenda
Why Shift Left in Mobile?
Mobile Test Automation Pyramid
How much Mobile Automation is enough?
Right way to Automate
Best Practices in Mobile Automation

4. How to Shift Left?

6. Do we test enough?
Do we automate enough?
Are we using the right resources which
is
 Time saving
 Fast &
 Adding Value?

8. Manual
Testing
Non
Functional
Testing
Functional
Testing
Integration Testing
Unit Testing
(5%)
(95%)
60%
15%
10%
10%

9. Manual
Testing
Non
Functional
Testing
Functional
Testing
Integration Testing
Unit Testing
(5%)
(95%)
60%
15%
10%
10%

10. Manual
Testing
Non
Functional
Testing
Functional Testing
Integration Testing
•Unit Tests
•Snapshot Tests
Unit Testing
(5%)
(95%)
60%
15%
10%
10%

12. Manual
Testing
Non
Functional
Testing
Functional Testing
•API Integration Tests
•SDK Integration Tests
Integration Testing
•Unit Tests
•Snapshot Tests
Unit Testing
(5%)
(95%)
60%
15%
10%
10%

13. Manual
Testing
Non
Functional
Testing
•End to End Tests
•UI Tests on Staging
•UI Tests with SDK integration
•UI Tests on Mock Server
Functional Testing
•Library / SDK / Framework /
API Integration Tests
Integration Testing
•Unit Tests
•Snapshot Tests
Unit Testing
(5%)
(95%)
60%
15%
10%
10%

14. Automation Test Framework
Development
Build
Unit Test Suite UI Test Suite Integrated to CI
Locators
Network
Layer
Set Accessibility
Identifiers
Reusable
& Optimised page
objects
Tests
Test Plan
Report with logs
& screenshots
Test Data
UI tests with
test/prod
environment
UI Tests with SDK
integration
UI tests with API
integration
UI Tests with
Mock API
Code & Test Coverage

15. UI tests with Test/Prod environment
UI Tests with SDK integration
UI tests with API integration
UI Tests with Mock API
Network Layers in E2E Testing
App
Test
Environment
UI Test
Flaky
Tests

16. UI tests with Test/Prod environment
UI Tests with SDK integration
UI tests with API integration
UI Tests with Mock API
Network Layers in E2E Testing
App
Mocke
d API
UI Test
100%
Reliable
Tests
Swifter
Embassy
Nimble
Wiremock
OkHttp

17. UI tests with Test/Prod environment
UI Tests with SDK integration
UI tests with API integration
UI Tests with Mock API
Network Layers in E2E Testing
API
call
App UI Test

18. UI tests with Test/Prod environment
UI Tests with SDK integration
UI tests with API integration
UI Tests with Mock API
Network Layers in E2E Testing
App
SDK
Library
SDK Unit
Test
UI Test

19. UI Tests with SDK integration
Network Layers in E2E Testing

20. Manual
Testing
•Accessibility Tests
•Security Scans
•Performance Tests
•Localisation & Internationalization Tests
Non
Functional
Testing
•End to End Tests
•UI Tests on Staging
•UI Tests with SDK integration
•UI Tests on Mock Server
Functional Testing
•Library / SDK / Framework /
API Integration Tests
Integration Testing
•Unit Tests
•Snapshot Tests
Unit Testing
(5%)
(95%)
60%
15%
10%
10%

22. Accessibility Testing
Localization Testing
■ Calendar / region / Time zone
■ Language support
■ Locale / location
NavigationBar, {{0.0, 20.0}, {375.0, 44.0}}, identifier: 'Rewards'
Button, {{8.0, 20.0}, {43.0, 44.0}}, label: 'Back'
StaticText, {{151.5, 30.0}, {72.0, 22.5}}, label: 'Rewards'
Table, {{0.0, 64.0}, {375.0, 603.0}}
Other, {{0.0, -1091.5}, {375.0, 115.0}}, identifier: ‘BottleTile'
Image, {{139.5, -1091.5}, {96.0, 96.0}}, identifier: 'AwardImage'
Cell, {{0.0, -976.5}, {375.0, 2359.0}}
Button, {{18.0, -966.5}, {169.0, 46.0}}, identifier: ‘Alexa', label: ‘Talk'
Button, {{187.5, -966.5}, {169.0, 46.0}}, identifier: ‘Google', label: ‘Write'

23. •Upgradation Tests
•Exploratory Tests
•Dog Food - Alpha & Beta Tests
Manual
Testing
•Accessibility Tests
•Security Scans
•Performance Tests
•Localisation & Internationalization Tests
Non
Functional
Testing
•End to End Tests
•UI Tests on Staging
•UI Tests with SDK integration
•UI Tests on Mock Server
Functional Testing
•Library / SDK / Framework /
API Integration Tests
Integration Testing
•Unit Tests
•Snapshot Tests
Unit Testing
(5%)
(95%)
60%
15%
10%
10%

24. •Upgradation Tests
•Exploratory Tests
•Dog Food - Alpha & Beta Tests
Manual
Testing
•Accessibility Tests
•Security Scans
•Performance Tests
•Localisation/Internationalization
Non
Functional
Testing
•End to End Tests
•UI Tests on Staging
•UI Tests with SDK
•UI Tests on Mock Server
Functional
Testing
•Library / SDK /
Framework / API
Integration Tests
Integration Testing
•Unit Tests
•Snapshot Tests
Unit Testing
(5%)
(95%)
60%
15%
10%
10%

25. •Upgradation Tests
•Exploratory Tests
•Dog Food - Alpha & Beta Tests
Manual
Testing
•Accessibility Tests
•Security Scans
•Performance Tests
•Localisation/Internationalization
Non
Functional
Testing
•End to End Tests
•UI Tests on Staging
•UI Tests with SDK
•UI Tests on Mock Server
Functional
Testing
•Library / SDK /
Framework / API
Integration Tests
Integration Testing
•Unit Tests
•Snapshot Tests
•Code & Test
Coverage
Unit Testing
(5%)
(95%)
60%
15%
10%
10%
 Nightly Run
 Nightly Run
 Nightly Run
 Every PR
 Every PR
 Every PR

26. Easiest CI integrations
■ Simulators / Emulators
■ Browserstack
■ LambdaTest
■ AWS Device farm
■ TestingBot
■ SauceLabs
■ Firebase Test Lab
xcodebuild test -workspace sampleApp.xcworkspace -scheme sampleAppUITests
-destination 'platform=iOS Simulator,name=iPhone 11' -resultBundlePath
ResultBundle.xcresult
./gradlew connectedAndroidTest
Upload
app
Upload
test suite
Build

27. Best Practices
■ Appoint Dedicated personnel for each Job
■ Continuous Testing
■ Our test should FAIL gracefully
■ Separate test plans
■ No flaky tests
■ Not replacing Exploratory / Manual
Testing
■ Write maintainable, reusable, optimized &
readable Test code

28. Summary
 Accessibility
 Common Repository
 Robust and Low
maintenance
 High Reusability of code
 Fastest Test Executions
 Fastest Bug Detections
 Fastest Scripting
 Parallel Automation
 Boosts confidence
 Fastest Time to Market
every time
 Reduced human errors in
testing
 Earliest Bug Fix
 More mature & Reliable

29. Inner Peace
In God I trust, rest must pass the automated test suites

30. THANK YOU 🙏
/in/suparnakhamaru
suparna-khamaru
super-tester.medium.com