The document discusses the importance of testing mobile applications for quality and performance. It notes that only 16% of consumers will try a failing app more than twice and that a 5-star app makes 6 times more money than a 3-star app. The document then introduces Mobitop, a mobile testing platform that allows testing applications on real devices without coding through an easy click-and-record interface. Mobitop provides automated testing, real-time monitoring of performance metrics, and detailed reports.
2. Only 16% of Consumers would try a
failing app more than twice before
dumping it
A poor mobile experience can have
negative impact
You get only one chance to succeed
5 star app makes 6x time more money
than a 3 star app
Why App Testing?
3. Test on Real devices with real user
conditions
A well tested app lives longer with more
downloads
Memory, Network and CPU
consumption are leading causes of
poor performance
52% of apps with poor performance gets a
1 rating
What to Test – Not just function?
4. Coding is easier and Debugging is hard
Constraints in terms of real devices, network
simulation, battery usage etc..
Getting good developers to hire takes time and is
expensive
More bodies in testing doesn’t get the app
performance any better
Tools are expensive, requires coding to use and
build tests
Automation is hard in Mobile (Robotium, Code
Money, Frank, Appium and man more.. Which
one?)
Want to test, but?
5. Automation
Best in class for
Continuous
integration
No scripting
Real Devices
Test on real IOS
and Android
devices
Test on multiple
devices
Introducing Mobitop
Actionable Results
Crash reports
Mem, CPU and
Network captures
Performance
Data
Test results
6. Connect
Test
Report &
Automate
(No Code, No IDE )
What is Mobitop Mobile
7. No Scripting, No coding – Web based
Just Launch, Run Test Scripts (Mobile &
Web)
Increases the Productivity
QA folks start thinking about form, function and the customer
too.. (now)
Click to record the tests
Mobile Automation is as easy 123
It is hard and lot of effort… otherwise
Test and Run on Real devices
Access Multiple Devices from one Mobitop
Platform
Devices, Tests and Testsuites
Why Mobitop Mobile?
A fresh graduate can now write automation
tests on IOS and Android
8. Much more rewarding and satisfying for QA
professionals
Increases the Productivity
QA folks start thinking about form, function and the customer too..
(now)
No Need for skilled Automation Testers
Highly paid, under utilized
Greater pedigree in testing
Method to madness in Mobile Testing
In an otherwise highly unstable frameworks and
environment
High Productivity
Instant Testing
Share and Test on real devices across the Organization
Benefits
No knowledge of Objective C, Java Script,
Cucumber is required to Test and Automate –
Just focus on Application Form and Function
9. Product – On premise
BOX
(Mac or
Linux)
1
2
3
3
10
Browser
Enterprise LAN
Real Devices
P
H
O
N
E
Launch
Click &
Run
10. Product – On Cloud
Cloud
Server
1
2
3
3
10
Browser
P
H
O
N
E
Launch
Click &
Run
Internet
Real Devices
&
Emulators
11. Android and IPhone
Share Real Devices across the
Organization
Simply upload, select device and Test
Install from App Repository
App Testing - Manual
12. Select App, Select Device
Record a Test
Save the Test
Appium Script generated
Add Name, device tags etc.
Schedule the Test
Run the Test – Any time
there after
App Testing - Automation
13. Battery, Network, memory and
CPU usage and monitoring
Dashboard – Tests
Passed/Failed
Detailed Step wise report for a
test
Test case management
App Testing - Metrics
14. Competitive/Related AnalysisProduct/Functi
on
Expiry Test TestDroid TestObjects Ranorex Perfecto
Mobile
Mobitop
Devices Real and
Simulators
Real and Simulator Simulators only Real Devices Real Devices only Real and
Simulators
IOS Yes Yes Yes Yes Yes Yes
Android Yes Yes Yes Yes Yes Yes
Web Testing No No No Yes No Yes
On Premise Node Locked
Desktop Version
Yes No Platform
(Desktop)
Yes. But.. Yes
(Server with
devices)
Cloud Product Yes Yes Yes No Yes Yes
Pricing USD 5000 Per year USD 12000 Per
Annum
USD 4800 for fair
usage
USD 24000
Included Web
USD 3600 Per Year
20 hours/month
USD 3299
Unlimited Usage
No of Devices Upto 5 Per device Device Basis Desktop
(One device)
Per device 25 devices
Recording Yes No No Yes Yes Yes
Reporting No No No NA No Yes (CPU, Net,
Mem, Battery)
Parallel Runs No Yes Yes NA Yes Yes for Android
& one at a time of
IOS
User Experience Missies IOS Events OK Smooth NA Smooth Smooth and
Responsive
Web Desktop Desktop/We Web Desktop Web Web
Test Development IDE IDE None IDE Web Ide Web IDE – No
code
TestSuites No No No No No Yes
15. Robotium
Android Only
Java only
Only for Android
Appium
Automation Tool
All languages
Platform Independent
Selenium Drivers for
IOS/Android
Which Framework?
Calabash
IOS and Android
All languages (Ruby)
Xmarian behind this
technology
Htpp server embedded in
the app
Frank
IOS only
Based on Cucumber
Use UI Automation
Requires XCODE/IOS
for Development
Zucchini
IOS Only
Coffescript, Ruby
Uses UIAutomation
Requires xcode,
Mac OS
MonkeyTalk
IOS and Android
DSL or JavaScript
UIAutomation
Requiers XCODE &
Mac OS
PS: IOS Automation requires Mac
Platform
Tuneup.js
IOS only
Based on Cucumber
Use UI Automation
Requires XCODE/IOS
for Development
16. Most promising tool
Blackbox testing tool – validate and verify
information on the screens
Works for Native, Web and Hybrid
Testing script in any language (we use
python)
Run single script on any mobile OS platform.
Supports Android and IOS
Supported by SauceLabs
Strong community
Appium
Mobitop Mobile is based on Appium