SlideShare a Scribd company logo
1 of 18
Benefits of Automated Mobile Testing
February 24th, 2016
10:00 am PST
Alex Otañez- Shockoe
Danielle Papermaster- SOASTA
1© 2014 SOASTA CONFIDENTIAL - All rights reserved.
Poll- Create in ready talk
What is your role in the organization?
-Developer
-Dev-Ops
-Ecommerce Manager
-Tester
Agenda
• Complexity of testing with mobile vs. desktop app
• Automated testing during agile (sprints)
• What is Automated Mobile Testing?
• Functionality versus usability testing
• Executing tests to work across the android ecosystem
• Customer Success story
Cultivating Innovation for over 5 Years
Continuously delivering award winning apps as Quoted in
Forrester Research, Information Weekly, Clutch
Mobile Strategy
Transformation
User Experience
Design
Mobile Development
Integration
Customer Success
Management
Connected Tech
Analytics
Complexity of Mobile Testing
Mobile vs Desktop Apps
Mobile Testing Matrix has exploded
17 person days of desktop testing = 217 person days in Mobile Testing
Mobile App (26 devices)
217 pd / 5 people = 43 days or
217 pd / 65 people = 3.3 days
Desktop App (2 browsers)
17 pd / 5 people = 3.3 days
Same sprint testing?
How do I use my current resources to
automate?
Automation is key to keep up
Testing in Agile
Time compounds the problem
Automation is strategic. You cannot automate everything.
Automation is incremental. Start with the easy stuff.
Automation is a process. Expect to adapt and grow.
What is Automated Functional Testing?
Automated Functional vs Manual Functional Testing
Functional Testing is a feature by feature
validation of behavior or development
Functionality testing should be done first and
can be automated, usability should come
second and is generally a manual process
Usability testing focuses on the overall
structure/navigation, layout of elements, &
clarity of content
Functionality Versus Usability Testing
The best design is no design
The Android Ecosystem
Right tests on the right device
Processor, RAM, screen size, & resolution
is daunting
Test on OpenGL ES 2.0 and 3.0.CPU and make
sure app runs on high-end and low-end
handsets
Works on my Samsung ABC, but crashes on
my Nexus QPR
http://developer.android.com/about/dashboards/index.html
The App: Increasing customer engagement through multiple digital means, including Pre-Line, In-Line, and
At-Register engagement.
• Innovative Rewards Program
• Browse Menu Options and Drink Creator
• Payment Options
• The Coffee Story
The Challenge: Manual testing was delaying product launches and not finding all bugs and errors, nor giving
the customer the full picture - The customer needed to obtain actionable data to meet expectations.
Results: To meet expectations, the client worked with Shockoe and decided SOASTA TouchTest would help
them test the code faster and better. With TouchTest, the customer was able to not only test its own apps,
but also seamlessly take those tests to the cloud to scale without investing in additional environments. As a
result usability testing focused on the experience, not the functionality.
Customer Success
Redefining the Coffee Shop Experience
Demo
13© 2014 SOASTA CONFIDENTIAL - All rights reserved.
Webinar Series
Next Webinar: Building test scripts and regression suites
best practices
Upcoming Webinars
• Health check- what’s my app’s health?
Identifying the metrics that matter
• Mobile Load Testing
• Continuous Mobile Testing
14© 2014 SOASTA CONFIDENTIAL - All rights reserved.
Poll- Create in ready talk
Want more, click below to opt in for more
information.
-White paper- 7 Pragmatic steps to mobile testing
-I’d like to attend the next webinar: Best practices to building test scripts and regression
suites
-Talk to an expert for a mobile strategy consultation
-I’d like to see a demo
-I’d like to try a free version of TouchTest Lite
15© 2014 SOASTA CONFIDENTIAL - All rights reserved.
Contact Us
Alex Otañez, Shockoe- alex@shockoe.com
Mike Ostenberg, SOASTA- mostenberg@soasta.com
Question?
SOASTA & Shockoe Webinar - The Benefits of Automated Mobile Testing

More Related Content

Viewers also liked

Advanced Software Test Automation
Advanced Software Test AutomationAdvanced Software Test Automation
Advanced Software Test AutomationUnmesh Ballal
 
Sustainable Automation Frameworks by Kelsey Shannahan
Sustainable Automation Frameworks by Kelsey ShannahanSustainable Automation Frameworks by Kelsey Shannahan
Sustainable Automation Frameworks by Kelsey ShannahanQA or the Highway
 
Continuous integration
Continuous integrationContinuous integration
Continuous integrationLior Tal
 
Continuous Load Testing with CloudTest and Jenkins
Continuous Load Testing with CloudTest and JenkinsContinuous Load Testing with CloudTest and Jenkins
Continuous Load Testing with CloudTest and JenkinsSOASTA
 
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...SOASTA
 
DPM in Pictures
DPM in PicturesDPM in Pictures
DPM in PicturesSOASTA
 
Software Testing for International Students
Software Testing for International StudentsSoftware Testing for International Students
Software Testing for International Studentscristianoribeirosilva
 
Testing web services by Stan Jónsson
Testing web services by Stan JónssonTesting web services by Stan Jónsson
Testing web services by Stan JónssonQA or the Highway
 
Test Automation and Continuous Integration
Test Automation and Continuous Integration Test Automation and Continuous Integration
Test Automation and Continuous Integration TestCampRO
 
Scrum gathering Paris 2013 - test automation strategy for Scrum Projects
Scrum gathering Paris 2013 -  test automation strategy for Scrum ProjectsScrum gathering Paris 2013 -  test automation strategy for Scrum Projects
Scrum gathering Paris 2013 - test automation strategy for Scrum ProjectsEliane Collins
 
Distributed Testing Environment
Distributed Testing EnvironmentDistributed Testing Environment
Distributed Testing EnvironmentŁukasz Morawski
 
Continuous test automation
Continuous test automationContinuous test automation
Continuous test automationViresh Doshi
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingTechniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingSOASTA
 

Viewers also liked (13)

Advanced Software Test Automation
Advanced Software Test AutomationAdvanced Software Test Automation
Advanced Software Test Automation
 
Sustainable Automation Frameworks by Kelsey Shannahan
Sustainable Automation Frameworks by Kelsey ShannahanSustainable Automation Frameworks by Kelsey Shannahan
Sustainable Automation Frameworks by Kelsey Shannahan
 
Continuous integration
Continuous integrationContinuous integration
Continuous integration
 
Continuous Load Testing with CloudTest and Jenkins
Continuous Load Testing with CloudTest and JenkinsContinuous Load Testing with CloudTest and Jenkins
Continuous Load Testing with CloudTest and Jenkins
 
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
 
DPM in Pictures
DPM in PicturesDPM in Pictures
DPM in Pictures
 
Software Testing for International Students
Software Testing for International StudentsSoftware Testing for International Students
Software Testing for International Students
 
Testing web services by Stan Jónsson
Testing web services by Stan JónssonTesting web services by Stan Jónsson
Testing web services by Stan Jónsson
 
Test Automation and Continuous Integration
Test Automation and Continuous Integration Test Automation and Continuous Integration
Test Automation and Continuous Integration
 
Scrum gathering Paris 2013 - test automation strategy for Scrum Projects
Scrum gathering Paris 2013 -  test automation strategy for Scrum ProjectsScrum gathering Paris 2013 -  test automation strategy for Scrum Projects
Scrum gathering Paris 2013 - test automation strategy for Scrum Projects
 
Distributed Testing Environment
Distributed Testing EnvironmentDistributed Testing Environment
Distributed Testing Environment
 
Continuous test automation
Continuous test automationContinuous test automation
Continuous test automation
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingTechniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App Testing
 

More from Jennifer Finney

SOASTA Office Depot Case Study
SOASTA Office Depot Case StudySOASTA Office Depot Case Study
SOASTA Office Depot Case StudyJennifer Finney
 
Webinar: How to Load Test for Your Mobile Peak
Webinar: How to Load Test for Your Mobile PeakWebinar: How to Load Test for Your Mobile Peak
Webinar: How to Load Test for Your Mobile PeakJennifer Finney
 
Turning Digital Performance into Competitive Advantage
Turning Digital Performance into Competitive AdvantageTurning Digital Performance into Competitive Advantage
Turning Digital Performance into Competitive AdvantageJennifer Finney
 
Welcome to the Intelligent Testing Revolution!
Welcome to the Intelligent Testing Revolution!Welcome to the Intelligent Testing Revolution!
Welcome to the Intelligent Testing Revolution!Jennifer Finney
 
Using JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous TestingUsing JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous TestingJennifer Finney
 
Webinar: Proactive Strategies for Finding and Fixing Performance Issues
Webinar: Proactive Strategies for Finding and Fixing Performance IssuesWebinar: Proactive Strategies for Finding and Fixing Performance Issues
Webinar: Proactive Strategies for Finding and Fixing Performance IssuesJennifer Finney
 
Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?Jennifer Finney
 
Webinar: Version Control in SOASTA 57
Webinar: Version Control in SOASTA 57Webinar: Version Control in SOASTA 57
Webinar: Version Control in SOASTA 57Jennifer Finney
 
Network Emulation in SOASTA 57 Spring Release
Network Emulation in SOASTA 57 Spring ReleaseNetwork Emulation in SOASTA 57 Spring Release
Network Emulation in SOASTA 57 Spring ReleaseJennifer Finney
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTestIntegrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTestJennifer Finney
 
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...Jennifer Finney
 
DPM Overview Soasta Partners.pptx
DPM Overview Soasta Partners.pptxDPM Overview Soasta Partners.pptx
DPM Overview Soasta Partners.pptxJennifer Finney
 
What You Don't Know About 3rd Party Scripts Can Hurt You!
What You Don't Know About 3rd Party Scripts Can Hurt You!What You Don't Know About 3rd Party Scripts Can Hurt You!
What You Don't Know About 3rd Party Scripts Can Hurt You!Jennifer Finney
 
Soasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest WebinarSoasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest WebinarJennifer Finney
 

More from Jennifer Finney (14)

SOASTA Office Depot Case Study
SOASTA Office Depot Case StudySOASTA Office Depot Case Study
SOASTA Office Depot Case Study
 
Webinar: How to Load Test for Your Mobile Peak
Webinar: How to Load Test for Your Mobile PeakWebinar: How to Load Test for Your Mobile Peak
Webinar: How to Load Test for Your Mobile Peak
 
Turning Digital Performance into Competitive Advantage
Turning Digital Performance into Competitive AdvantageTurning Digital Performance into Competitive Advantage
Turning Digital Performance into Competitive Advantage
 
Welcome to the Intelligent Testing Revolution!
Welcome to the Intelligent Testing Revolution!Welcome to the Intelligent Testing Revolution!
Welcome to the Intelligent Testing Revolution!
 
Using JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous TestingUsing JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous Testing
 
Webinar: Proactive Strategies for Finding and Fixing Performance Issues
Webinar: Proactive Strategies for Finding and Fixing Performance IssuesWebinar: Proactive Strategies for Finding and Fixing Performance Issues
Webinar: Proactive Strategies for Finding and Fixing Performance Issues
 
Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?
 
Webinar: Version Control in SOASTA 57
Webinar: Version Control in SOASTA 57Webinar: Version Control in SOASTA 57
Webinar: Version Control in SOASTA 57
 
Network Emulation in SOASTA 57 Spring Release
Network Emulation in SOASTA 57 Spring ReleaseNetwork Emulation in SOASTA 57 Spring Release
Network Emulation in SOASTA 57 Spring Release
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTestIntegrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
 
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
 
DPM Overview Soasta Partners.pptx
DPM Overview Soasta Partners.pptxDPM Overview Soasta Partners.pptx
DPM Overview Soasta Partners.pptx
 
What You Don't Know About 3rd Party Scripts Can Hurt You!
What You Don't Know About 3rd Party Scripts Can Hurt You!What You Don't Know About 3rd Party Scripts Can Hurt You!
What You Don't Know About 3rd Party Scripts Can Hurt You!
 
Soasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest WebinarSoasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest Webinar
 

Recently uploaded

9999266834 Call Girls In Noida Sector 52 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 52 (Delhi) Call Girl Service9999266834 Call Girls In Noida Sector 52 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 52 (Delhi) Call Girl Servicenishacall1
 
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCRFULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCRnishacall1
 
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost LoverPowerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost LoverPsychicRuben LoveSpells
 
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort ServiceDelhi Call girls
 
Leading Mobile App Development Companies in India (2).pdf
Leading Mobile App Development Companies in India (2).pdfLeading Mobile App Development Companies in India (2).pdf
Leading Mobile App Development Companies in India (2).pdfCWS Technology
 

Recently uploaded (6)

9999266834 Call Girls In Noida Sector 52 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 52 (Delhi) Call Girl Service9999266834 Call Girls In Noida Sector 52 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 52 (Delhi) Call Girl Service
 
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCRFULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
FULL ENJOY - 9999218229 Call Girls in {Mahipalpur}| Delhi NCR
 
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost LoverPowerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
Powerful Love Spells in Arkansas, AR (310) 882-6330 Bring Back Lost Lover
 
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 71 Noida Escorts >༒8448380779 Escort Service
 
Obat Penggugur Kandungan Di Apotik Kimia Farma (087776558899)
Obat Penggugur Kandungan Di Apotik Kimia Farma (087776558899)Obat Penggugur Kandungan Di Apotik Kimia Farma (087776558899)
Obat Penggugur Kandungan Di Apotik Kimia Farma (087776558899)
 
Leading Mobile App Development Companies in India (2).pdf
Leading Mobile App Development Companies in India (2).pdfLeading Mobile App Development Companies in India (2).pdf
Leading Mobile App Development Companies in India (2).pdf
 

SOASTA & Shockoe Webinar - The Benefits of Automated Mobile Testing

  • 1. Benefits of Automated Mobile Testing February 24th, 2016 10:00 am PST Alex Otañez- Shockoe Danielle Papermaster- SOASTA
  • 2. 1© 2014 SOASTA CONFIDENTIAL - All rights reserved. Poll- Create in ready talk What is your role in the organization? -Developer -Dev-Ops -Ecommerce Manager -Tester
  • 3. Agenda • Complexity of testing with mobile vs. desktop app • Automated testing during agile (sprints) • What is Automated Mobile Testing? • Functionality versus usability testing • Executing tests to work across the android ecosystem • Customer Success story
  • 4. Cultivating Innovation for over 5 Years Continuously delivering award winning apps as Quoted in Forrester Research, Information Weekly, Clutch Mobile Strategy Transformation User Experience Design Mobile Development Integration Customer Success Management Connected Tech Analytics
  • 5.
  • 7. Mobile vs Desktop Apps Mobile Testing Matrix has exploded 17 person days of desktop testing = 217 person days in Mobile Testing Mobile App (26 devices) 217 pd / 5 people = 43 days or 217 pd / 65 people = 3.3 days Desktop App (2 browsers) 17 pd / 5 people = 3.3 days
  • 8. Same sprint testing? How do I use my current resources to automate? Automation is key to keep up Testing in Agile Time compounds the problem
  • 9. Automation is strategic. You cannot automate everything. Automation is incremental. Start with the easy stuff. Automation is a process. Expect to adapt and grow. What is Automated Functional Testing? Automated Functional vs Manual Functional Testing
  • 10. Functional Testing is a feature by feature validation of behavior or development Functionality testing should be done first and can be automated, usability should come second and is generally a manual process Usability testing focuses on the overall structure/navigation, layout of elements, & clarity of content Functionality Versus Usability Testing The best design is no design
  • 11. The Android Ecosystem Right tests on the right device Processor, RAM, screen size, & resolution is daunting Test on OpenGL ES 2.0 and 3.0.CPU and make sure app runs on high-end and low-end handsets Works on my Samsung ABC, but crashes on my Nexus QPR http://developer.android.com/about/dashboards/index.html
  • 12. The App: Increasing customer engagement through multiple digital means, including Pre-Line, In-Line, and At-Register engagement. • Innovative Rewards Program • Browse Menu Options and Drink Creator • Payment Options • The Coffee Story The Challenge: Manual testing was delaying product launches and not finding all bugs and errors, nor giving the customer the full picture - The customer needed to obtain actionable data to meet expectations. Results: To meet expectations, the client worked with Shockoe and decided SOASTA TouchTest would help them test the code faster and better. With TouchTest, the customer was able to not only test its own apps, but also seamlessly take those tests to the cloud to scale without investing in additional environments. As a result usability testing focused on the experience, not the functionality. Customer Success Redefining the Coffee Shop Experience
  • 13. Demo
  • 14. 13© 2014 SOASTA CONFIDENTIAL - All rights reserved. Webinar Series Next Webinar: Building test scripts and regression suites best practices Upcoming Webinars • Health check- what’s my app’s health? Identifying the metrics that matter • Mobile Load Testing • Continuous Mobile Testing
  • 15. 14© 2014 SOASTA CONFIDENTIAL - All rights reserved. Poll- Create in ready talk Want more, click below to opt in for more information. -White paper- 7 Pragmatic steps to mobile testing -I’d like to attend the next webinar: Best practices to building test scripts and regression suites -Talk to an expert for a mobile strategy consultation -I’d like to see a demo -I’d like to try a free version of TouchTest Lite
  • 16. 15© 2014 SOASTA CONFIDENTIAL - All rights reserved. Contact Us Alex Otañez, Shockoe- alex@shockoe.com Mike Ostenberg, SOASTA- mostenberg@soasta.com