Unit testing: Making sure the functions are fit for use – they perform their desired tasks on a procedural level
Revision from user feedback: Old Menu > New Menu
Question: How many android devices do you think there are in the world?
The Bible of iOS App Development
Smoke Testing – Does the basics of the App work? E.g. does it start? Do my page transitions work?Sanity Testing – Does it work roughly as expected?Ad-hoc Testing – Just wing’ing it and hoping everything will work as expected. – No planFunctional Testing – Make sure all of the features function as expectedBoundary Testing – Test the limits of the input boxes, e.g. minimum characters, maximumUsability Testing – Testing the App on its potential users as to whether its understandable without explicit instructionCompatibility Testing – Does it work on my devices?Performance Testing – How well does it perform? Does it cope?Error Handling Testing – What happens in error cases? E.g. what if the text doesn’t fit in the box?Online & Offline Testing – Connection basedRegression Testing – Ensure that a change hasn’t broken something else!
1. App Testing Strategies
Making sure your App isn’t crApp
2. What is going to be covered?
Testing: What, How, Why?
White Box Testing
Black Box Testing
Distributing Your App
Testing Your App
3. Testing: What, How, Why?
Make sure your App works as intended
Testing is all about questions and answers
Your App has to work all of the time, not some of the time
1 million+ Apps in the iOS App Store & the Google Play Store2
Poor Apps get ignored – The App market is a cut-throat place
26% of the time customers never give the app a second try1
You should test everything thoroughly in different scenarios
On the other hand, testing needs to be cost-effective
1 First Impressions Matter! 26% of Apps Downloaded in 2010 Were Used Just Once
2 Number of available Android Applications
6. White Box Testing
Making sure it works – programmatically
You can perform this during development
Need to have thorough knowledge of the App code
It works, but does it work?
7. Black Box Testing
System Testing – Does it do what it was set out to do?
Acceptance Testing – Client & Beta tests
Compatibility Testing – What devices will it work on?
Can be tested by other people
Overall issues of the App can be identified & addressed
Cannot perform it until White Box testing is finished
Much broader than White Box testing
8. Compatibility Testing
9. STYLECampaign - Mobile Email Testing Rig
11. Accessible at: http://www.opendevicelab.com
Open Device Labs
12. Compatibility Testing
Different Screen Sizes
Access to specific functions e.g. 3G, GPS, NFC
Operating System Versions
Android 2.3, 4.0+
Consumer Behavior e.g. Do they buy Apps on this platform?
Does it meet platform specific guidelines?
13. Accessible at: https://developer.apple.com/library/ios/documentation/userexperience/conceptual/mobilehig/MobileHIG.pdf
iOS Human Interface Guidelines
14. Distributing your App
App Inventor has many ways to test/distribute your App
Emulator - Bad
QR Code for APK
There are other ways to distribute…
15. Testing your App
Develop a Test Plan – System Testing breakdown:
Smoke Testing Sanity Testing
Ad-hoc Testing Functional Testing
Boundary Testing Usability Testing
Compatibility Testing Performance Testing
Error Handling Testing Online & Offline Testing
…and many more
16. Testing your App
Create test cases & scenarios for each testing type
Action(s) to perform Test
Actual Result Pass or Fail
Open the App from the
N/A The App Opens The App
002 Close the
Close the App using
the menu button
N/A The App Closes The App
003 Input a
Input long name into
the name field on the
edit profile view
The name fits The name