SlideShare a Scribd company logo
T22
Concurrent Class
10/3/2013 3:00:00 PM

"Mobile Test Automation with
Big Data Analytics"
Presented by:
Tarun Bhatia
Microsoft

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Tarun Bhatia
Microsoft
Tarun Bhatia is a Program Manager in charge of driving the best breed of performance
measurements and analysis for Microsoft Online Office Division. In this role, Tarun leads
innovative strategies—analytics, performance, benchmark, compatibility—and guides the team
to create an effective, reliable, and robust monitoring architecture. With more than six years of
software development experience in quality and service assurance, Tarun shows that taking
initiative and thinking outside the box can deliver big results—both personally and for the
company.
9/19/2013

Mobile Test Automation
Using Big Data Analytics
Tarun Bhatia
Microsoft Corp.

Introduction
quality as·sur·ance:
A program for the
systematic monitoring
and evaluation of the
various aspects of a
project, service, or
facility to ensure that
standards of quality are
being met
Source: http://www.merriamwebster.com/dictionary/quality%20assurance

1
9/19/2013

Question

“ If you think you can,

or if you think you can’t,
you are correct. – Henry Ford

”

How it Starts!
• Company needs mobile presence
• They hire Mobile Devs and Testers (usually
Stage 1 manual)

Stage 2

• App becomes too complex to cover all the
permutations via manual testing
• Company hires Automation Engineers (SDET)
and are told to “automate everything”!

• Full-on effort to catch-up and automate
all features
Stage 3 • Extreme SDET burnout!

2
9/19/2013

Creating a Plan

Automation
Framework

Prioritize
Feature Test
Cases

Device Lab
Successful
Automation
Plan

Stress /
Performance /
Other
Additional
Testing

Create a Device Lab

3
9/19/2013

Create a Device Lab

Total # of
Devices

Devices with
most # of
reported bugs

Your most
Popular
Devices

Time box and
add bug to
your backlog

Buy/Loan/Rent
device and
bring it inhouse

Create a Device Lab
Total # of Devices > 1850!!

Apple

LG MS770

Samsung Galaxy SIII

Microsoft

Coolpad Quatro 4G

ZTE N9210

Samsung Galaxy Admire 4G

Droid RAZR

Samsung Galaxy Note II

LG Esteem

LG MS870

Samsung Admire

Samsung Epic 4G

Samsung Galaxy SII

Samsung Omnia II

Other

4
9/19/2013

Pick an Automation Test Framework

Prioritize
Usage Data

KPI
Marketing
Data

Revenue
Stream
Data

5
9/19/2013

Real User Usage Pattern

Home Screen
Detail Screen 3

Detail Screen 1
All Other Values

Detail Screen 2

Real User Data

Stress

Server Vs. UI
Data

Tests

Performance
New Features

Production data
System
Under Test
Run Tests
Test Results

Quality
Assessment

6
9/19/2013

Stress Testing
 Find Resource Leaks
 Find App’s Capacity and
Capabilities
 Find Memory and Battery
Consumption Trends

Server Vs. UI Testing
• Verify data is in-sync
during testing

Server

• Ensure no data loss
during test progress

Client

Test
Framework

• Detect UI TTL (Time to
Load) on devices
under various
conditions

7
9/19/2013

Performance Testing (Analyze and
Record KPIs)

Effective Testing

Write
Once,
Test
Anywhere

Test Re-Use
Performance
Availability
Active
Monitoring

8
9/19/2013

Conclusion

9

More Related Content

What's hot

Juc oct 2014 final
Juc oct 2014 finalJuc oct 2014 final
Juc oct 2014 final
Perfecto Mobile
 
Mobile Test Coverage- Israel 4th meetup
Mobile Test Coverage- Israel 4th meetupMobile Test Coverage- Israel 4th meetup
Mobile Test Coverage- Israel 4th meetup
Perfecto Mobile
 
Inspector presentation
Inspector presentationInspector presentation
Inspector presentation
Valerio Barbera
 
Seven Steps to Remove Barriers and Accelerate Mobile Testing
Seven Steps to Remove Barriers and Accelerate Mobile TestingSeven Steps to Remove Barriers and Accelerate Mobile Testing
Seven Steps to Remove Barriers and Accelerate Mobile Testing
Keynote Mobile Testing
 
Wearables meetup
Wearables meetupWearables meetup
Wearables meetup
Perfecto Mobile
 
Digital Assurance - Today & Tomorrow
Digital Assurance - Today & TomorrowDigital Assurance - Today & Tomorrow
Digital Assurance - Today & Tomorrow
Agile Testing Alliance
 
Can We Deliver Mobile Apps Continuously?
Can We Deliver Mobile Apps Continuously?Can We Deliver Mobile Apps Continuously?
Can We Deliver Mobile Apps Continuously?
Dan Waters
 
Mastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita PuramMastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita Puram
QA or the Highway
 
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
Applitools
 
Building Agility for Automated Mobile Apps Testing
Building Agility for Automated Mobile Apps TestingBuilding Agility for Automated Mobile Apps Testing
Building Agility for Automated Mobile Apps Testing
Kapil Saxena
 
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GameWhy Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Perfecto by Perforce
 
Virgin Media's Mobile Quality Transformation
Virgin Media's Mobile Quality TransformationVirgin Media's Mobile Quality Transformation
Virgin Media's Mobile Quality Transformation
Perfecto by Perforce
 
Common Web UI Problems Transforming Manual to Automation
Common Web UI Problems Transforming Manual to Automation Common Web UI Problems Transforming Manual to Automation
Common Web UI Problems Transforming Manual to Automation
Ho Chi Minh City Software Testing Club
 
Code to Release using Artificial Intelligence and Machine Learning
Code to Release using Artificial Intelligence and Machine LearningCode to Release using Artificial Intelligence and Machine Learning
Code to Release using Artificial Intelligence and Machine Learning
STePINForum
 
Applitools - Cross Browser
Applitools - Cross BrowserApplitools - Cross Browser
Applitools - Cross Browser
Applitools
 
Appurify Performance Automation Whitepaper FINAL
Appurify Performance Automation Whitepaper FINALAppurify Performance Automation Whitepaper FINAL
Appurify Performance Automation Whitepaper FINAL
Jennifer Shambroom
 
Test Army - testing agency who cares about software quality
Test Army - testing agency who cares about software qualityTest Army - testing agency who cares about software quality
Test Army - testing agency who cares about software quality
Tomasz Jamka
 
Testplant: 10 Steps to State of the Art Software Testing
Testplant: 10 Steps to State of the Art Software TestingTestplant: 10 Steps to State of the Art Software Testing
Testplant: 10 Steps to State of the Art Software Testing
Testplant
 
Bloor: Test Design Automation
Bloor: Test Design AutomationBloor: Test Design Automation
Bloor: Test Design Automation
Testplant
 
Bringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & ApplitoolsBringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & Applitools
Applitools
 

What's hot (20)

Juc oct 2014 final
Juc oct 2014 finalJuc oct 2014 final
Juc oct 2014 final
 
Mobile Test Coverage- Israel 4th meetup
Mobile Test Coverage- Israel 4th meetupMobile Test Coverage- Israel 4th meetup
Mobile Test Coverage- Israel 4th meetup
 
Inspector presentation
Inspector presentationInspector presentation
Inspector presentation
 
Seven Steps to Remove Barriers and Accelerate Mobile Testing
Seven Steps to Remove Barriers and Accelerate Mobile TestingSeven Steps to Remove Barriers and Accelerate Mobile Testing
Seven Steps to Remove Barriers and Accelerate Mobile Testing
 
Wearables meetup
Wearables meetupWearables meetup
Wearables meetup
 
Digital Assurance - Today & Tomorrow
Digital Assurance - Today & TomorrowDigital Assurance - Today & Tomorrow
Digital Assurance - Today & Tomorrow
 
Can We Deliver Mobile Apps Continuously?
Can We Deliver Mobile Apps Continuously?Can We Deliver Mobile Apps Continuously?
Can We Deliver Mobile Apps Continuously?
 
Mastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita PuramMastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita Puram
 
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
 
Building Agility for Automated Mobile Apps Testing
Building Agility for Automated Mobile Apps TestingBuilding Agility for Automated Mobile Apps Testing
Building Agility for Automated Mobile Apps Testing
 
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GameWhy Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
 
Virgin Media's Mobile Quality Transformation
Virgin Media's Mobile Quality TransformationVirgin Media's Mobile Quality Transformation
Virgin Media's Mobile Quality Transformation
 
Common Web UI Problems Transforming Manual to Automation
Common Web UI Problems Transforming Manual to Automation Common Web UI Problems Transforming Manual to Automation
Common Web UI Problems Transforming Manual to Automation
 
Code to Release using Artificial Intelligence and Machine Learning
Code to Release using Artificial Intelligence and Machine LearningCode to Release using Artificial Intelligence and Machine Learning
Code to Release using Artificial Intelligence and Machine Learning
 
Applitools - Cross Browser
Applitools - Cross BrowserApplitools - Cross Browser
Applitools - Cross Browser
 
Appurify Performance Automation Whitepaper FINAL
Appurify Performance Automation Whitepaper FINALAppurify Performance Automation Whitepaper FINAL
Appurify Performance Automation Whitepaper FINAL
 
Test Army - testing agency who cares about software quality
Test Army - testing agency who cares about software qualityTest Army - testing agency who cares about software quality
Test Army - testing agency who cares about software quality
 
Testplant: 10 Steps to State of the Art Software Testing
Testplant: 10 Steps to State of the Art Software TestingTestplant: 10 Steps to State of the Art Software Testing
Testplant: 10 Steps to State of the Art Software Testing
 
Bloor: Test Design Automation
Bloor: Test Design AutomationBloor: Test Design Automation
Bloor: Test Design Automation
 
Bringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & ApplitoolsBringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & Applitools
 

Viewers also liked

Validating Assumptions: From Unknown to Known
Validating Assumptions: From Unknown to KnownValidating Assumptions: From Unknown to Known
Validating Assumptions: From Unknown to Known
TechWell
 
Using Business Objectives to Design Better Products
Using Business Objectives to Design Better ProductsUsing Business Objectives to Design Better Products
Using Business Objectives to Design Better Products
TechWell
 
Patterns for Collaboration: Toward Whole-Team Quality
Patterns for Collaboration: Toward Whole-Team QualityPatterns for Collaboration: Toward Whole-Team Quality
Patterns for Collaboration: Toward Whole-Team Quality
TechWell
 
Configuration Management Best Practices
Configuration Management Best PracticesConfiguration Management Best Practices
Configuration Management Best Practices
TechWell
 
Measure Customer and Business Feedback to Drive Improvement
Measure Customer and Business Feedback to Drive ImprovementMeasure Customer and Business Feedback to Drive Improvement
Measure Customer and Business Feedback to Drive Improvement
TechWell
 
Games Software People Play: Reasoning, Tactics, Biases, Fallacies
Games Software People Play: Reasoning, Tactics, Biases, FallaciesGames Software People Play: Reasoning, Tactics, Biases, Fallacies
Games Software People Play: Reasoning, Tactics, Biases, Fallacies
TechWell
 
Acceptance Test-Driven Development: Mastering Agile Testing
Acceptance Test-Driven Development: Mastering Agile TestingAcceptance Test-Driven Development: Mastering Agile Testing
Acceptance Test-Driven Development: Mastering Agile Testing
TechWell
 
A Year of “Testing” the Cloud for Development and Test
A Year of “Testing” the Cloud for Development and TestA Year of “Testing” the Cloud for Development and Test
A Year of “Testing” the Cloud for Development and Test
TechWell
 
Eight Steps to Kanban
Eight Steps to KanbanEight Steps to Kanban
Eight Steps to Kanban
TechWell
 
Essential Patterns of Mature Agile Teams
Essential Patterns of Mature Agile TeamsEssential Patterns of Mature Agile Teams
Essential Patterns of Mature Agile Teams
TechWell
 
Writing workshop adcbsc east13
Writing workshop adcbsc east13Writing workshop adcbsc east13
Writing workshop adcbsc east13
TechWell
 
Model-Based Testing with Keywords
Model-Based Testing with KeywordsModel-Based Testing with Keywords
Model-Based Testing with Keywords
TechWell
 
Rapid Performance Testing: No Load Generation Required
Rapid Performance Testing: No Load Generation RequiredRapid Performance Testing: No Load Generation Required
Rapid Performance Testing: No Load Generation Required
TechWell
 
Dealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and CommitmentDealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and Commitment
TechWell
 
Continuous Delivery: Rapid and Reliable Releases with DevOps Practices
Continuous Delivery: Rapid and Reliable Releases with DevOps PracticesContinuous Delivery: Rapid and Reliable Releases with DevOps Practices
Continuous Delivery: Rapid and Reliable Releases with DevOps Practices
TechWell
 

Viewers also liked (15)

Validating Assumptions: From Unknown to Known
Validating Assumptions: From Unknown to KnownValidating Assumptions: From Unknown to Known
Validating Assumptions: From Unknown to Known
 
Using Business Objectives to Design Better Products
Using Business Objectives to Design Better ProductsUsing Business Objectives to Design Better Products
Using Business Objectives to Design Better Products
 
Patterns for Collaboration: Toward Whole-Team Quality
Patterns for Collaboration: Toward Whole-Team QualityPatterns for Collaboration: Toward Whole-Team Quality
Patterns for Collaboration: Toward Whole-Team Quality
 
Configuration Management Best Practices
Configuration Management Best PracticesConfiguration Management Best Practices
Configuration Management Best Practices
 
Measure Customer and Business Feedback to Drive Improvement
Measure Customer and Business Feedback to Drive ImprovementMeasure Customer and Business Feedback to Drive Improvement
Measure Customer and Business Feedback to Drive Improvement
 
Games Software People Play: Reasoning, Tactics, Biases, Fallacies
Games Software People Play: Reasoning, Tactics, Biases, FallaciesGames Software People Play: Reasoning, Tactics, Biases, Fallacies
Games Software People Play: Reasoning, Tactics, Biases, Fallacies
 
Acceptance Test-Driven Development: Mastering Agile Testing
Acceptance Test-Driven Development: Mastering Agile TestingAcceptance Test-Driven Development: Mastering Agile Testing
Acceptance Test-Driven Development: Mastering Agile Testing
 
A Year of “Testing” the Cloud for Development and Test
A Year of “Testing” the Cloud for Development and TestA Year of “Testing” the Cloud for Development and Test
A Year of “Testing” the Cloud for Development and Test
 
Eight Steps to Kanban
Eight Steps to KanbanEight Steps to Kanban
Eight Steps to Kanban
 
Essential Patterns of Mature Agile Teams
Essential Patterns of Mature Agile TeamsEssential Patterns of Mature Agile Teams
Essential Patterns of Mature Agile Teams
 
Writing workshop adcbsc east13
Writing workshop adcbsc east13Writing workshop adcbsc east13
Writing workshop adcbsc east13
 
Model-Based Testing with Keywords
Model-Based Testing with KeywordsModel-Based Testing with Keywords
Model-Based Testing with Keywords
 
Rapid Performance Testing: No Load Generation Required
Rapid Performance Testing: No Load Generation RequiredRapid Performance Testing: No Load Generation Required
Rapid Performance Testing: No Load Generation Required
 
Dealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and CommitmentDealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and Commitment
 
Continuous Delivery: Rapid and Reliable Releases with DevOps Practices
Continuous Delivery: Rapid and Reliable Releases with DevOps PracticesContinuous Delivery: Rapid and Reliable Releases with DevOps Practices
Continuous Delivery: Rapid and Reliable Releases with DevOps Practices
 

Similar to Mobile Test Automation with Big Data Analytics

End-to-End Automation: Providing Stakeholders Feedback on Quality
End-to-End Automation: Providing Stakeholders Feedback on QualityEnd-to-End Automation: Providing Stakeholders Feedback on Quality
End-to-End Automation: Providing Stakeholders Feedback on Quality
TechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
TechWell
 
Streamline the Salesforce Testing With No-Code Test Automation.pdf
Streamline the Salesforce Testing With No-Code Test Automation.pdfStreamline the Salesforce Testing With No-Code Test Automation.pdf
Streamline the Salesforce Testing With No-Code Test Automation.pdf
RohitBhandari66
 
What Everyone on the Team Needs to Know about Test Automation
What Everyone on the Team Needs to Know about Test AutomationWhat Everyone on the Team Needs to Know about Test Automation
What Everyone on the Team Needs to Know about Test Automation
TechWell
 
Quest2018 erank optimize test automation
Quest2018 erank optimize test automationQuest2018 erank optimize test automation
Quest2018 erank optimize test automation
Perfecto Mobile
 
Mobile Testing Tools 101
Mobile Testing Tools 101Mobile Testing Tools 101
Mobile Testing Tools 101
TechWell
 
Security Development Life Cycle
Security Development Life CycleSecurity Development Life Cycle
Achieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobileAchieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobile
Perfecto Mobile
 
Managing an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product LeaderManaging an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product Leader
Product School
 
Project Proposal - Employee Monitoring Systems Evaluation
Project Proposal - Employee Monitoring Systems EvaluationProject Proposal - Employee Monitoring Systems Evaluation
Project Proposal - Employee Monitoring Systems Evaluation
Megan B. McDaniel
 
Thought frameworks brochure
Thought frameworks brochureThought frameworks brochure
Thought frameworks brochure
Swetha Muthu
 
Tech Mastermind - Test Suite 20.10.pdf
Tech Mastermind - Test Suite 20.10.pdfTech Mastermind - Test Suite 20.10.pdf
Tech Mastermind - Test Suite 20.10.pdf
SaiKumarBorusu
 
Senior Quality Analyst
Senior Quality AnalystSenior Quality Analyst
Senior Quality Analyst
Ankur Gupta
 
Thought_Frameworks_Brochure
Thought_Frameworks_BrochureThought_Frameworks_Brochure
Thought_Frameworks_Brochure
Swetha(Sandy) Muthu
 
Creating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran KinsbrunerCreating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran Kinsbruner
QA or the Highway
 
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with SplunkSplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
Splunk
 
06 operations and feedback
06   operations and feedback06   operations and feedback
06 operations and feedback
Clemens Reijnen
 
Service Virtualization: What, Who, When, and How
Service Virtualization: What, Who, When, and HowService Virtualization: What, Who, When, and How
Service Virtualization: What, Who, When, and How
TechWell
 
SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with SplunkSplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
Splunk
 
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfimplementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
sarah david
 

Similar to Mobile Test Automation with Big Data Analytics (20)

End-to-End Automation: Providing Stakeholders Feedback on Quality
End-to-End Automation: Providing Stakeholders Feedback on QualityEnd-to-End Automation: Providing Stakeholders Feedback on Quality
End-to-End Automation: Providing Stakeholders Feedback on Quality
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Streamline the Salesforce Testing With No-Code Test Automation.pdf
Streamline the Salesforce Testing With No-Code Test Automation.pdfStreamline the Salesforce Testing With No-Code Test Automation.pdf
Streamline the Salesforce Testing With No-Code Test Automation.pdf
 
What Everyone on the Team Needs to Know about Test Automation
What Everyone on the Team Needs to Know about Test AutomationWhat Everyone on the Team Needs to Know about Test Automation
What Everyone on the Team Needs to Know about Test Automation
 
Quest2018 erank optimize test automation
Quest2018 erank optimize test automationQuest2018 erank optimize test automation
Quest2018 erank optimize test automation
 
Mobile Testing Tools 101
Mobile Testing Tools 101Mobile Testing Tools 101
Mobile Testing Tools 101
 
Security Development Life Cycle
Security Development Life CycleSecurity Development Life Cycle
Security Development Life Cycle
 
Achieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobileAchieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobile
 
Managing an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product LeaderManaging an Experimentation Platform by LinkedIn Product Leader
Managing an Experimentation Platform by LinkedIn Product Leader
 
Project Proposal - Employee Monitoring Systems Evaluation
Project Proposal - Employee Monitoring Systems EvaluationProject Proposal - Employee Monitoring Systems Evaluation
Project Proposal - Employee Monitoring Systems Evaluation
 
Thought frameworks brochure
Thought frameworks brochureThought frameworks brochure
Thought frameworks brochure
 
Tech Mastermind - Test Suite 20.10.pdf
Tech Mastermind - Test Suite 20.10.pdfTech Mastermind - Test Suite 20.10.pdf
Tech Mastermind - Test Suite 20.10.pdf
 
Senior Quality Analyst
Senior Quality AnalystSenior Quality Analyst
Senior Quality Analyst
 
Thought_Frameworks_Brochure
Thought_Frameworks_BrochureThought_Frameworks_Brochure
Thought_Frameworks_Brochure
 
Creating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran KinsbrunerCreating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran Kinsbruner
 
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with SplunkSplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
 
06 operations and feedback
06   operations and feedback06   operations and feedback
06 operations and feedback
 
Service Virtualization: What, Who, When, and How
Service Virtualization: What, Who, When, and HowService Virtualization: What, Who, When, and How
Service Virtualization: What, Who, When, and How
 
SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with SplunkSplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
 
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfimplementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
 

More from TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
TechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
TechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
Ma 15Ma 15
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
TechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development Today
TechWell
 

More from TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development Today
 

Recently uploaded

Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Precisely
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
BibashShahi
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Fwdays
 
What is an RPA CoE? Session 1 – CoE Vision
What is an RPA CoE?  Session 1 – CoE VisionWhat is an RPA CoE?  Session 1 – CoE Vision
What is an RPA CoE? Session 1 – CoE Vision
DianaGray10
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Y-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PPY-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PP
c5vrf27qcz
 
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Neo4j
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
saastr
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
Miro Wengner
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 

Recently uploaded (20)

Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
 
What is an RPA CoE? Session 1 – CoE Vision
What is an RPA CoE?  Session 1 – CoE VisionWhat is an RPA CoE?  Session 1 – CoE Vision
What is an RPA CoE? Session 1 – CoE Vision
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Y-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PPY-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PP
 
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 

Mobile Test Automation with Big Data Analytics

  • 1. T22 Concurrent Class 10/3/2013 3:00:00 PM "Mobile Test Automation with Big Data Analytics" Presented by: Tarun Bhatia Microsoft Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Tarun Bhatia Microsoft Tarun Bhatia is a Program Manager in charge of driving the best breed of performance measurements and analysis for Microsoft Online Office Division. In this role, Tarun leads innovative strategies—analytics, performance, benchmark, compatibility—and guides the team to create an effective, reliable, and robust monitoring architecture. With more than six years of software development experience in quality and service assurance, Tarun shows that taking initiative and thinking outside the box can deliver big results—both personally and for the company.
  • 3. 9/19/2013 Mobile Test Automation Using Big Data Analytics Tarun Bhatia Microsoft Corp. Introduction quality as·sur·ance: A program for the systematic monitoring and evaluation of the various aspects of a project, service, or facility to ensure that standards of quality are being met Source: http://www.merriamwebster.com/dictionary/quality%20assurance 1
  • 4. 9/19/2013 Question “ If you think you can, or if you think you can’t, you are correct. – Henry Ford ” How it Starts! • Company needs mobile presence • They hire Mobile Devs and Testers (usually Stage 1 manual) Stage 2 • App becomes too complex to cover all the permutations via manual testing • Company hires Automation Engineers (SDET) and are told to “automate everything”! • Full-on effort to catch-up and automate all features Stage 3 • Extreme SDET burnout! 2
  • 5. 9/19/2013 Creating a Plan Automation Framework Prioritize Feature Test Cases Device Lab Successful Automation Plan Stress / Performance / Other Additional Testing Create a Device Lab 3
  • 6. 9/19/2013 Create a Device Lab Total # of Devices Devices with most # of reported bugs Your most Popular Devices Time box and add bug to your backlog Buy/Loan/Rent device and bring it inhouse Create a Device Lab Total # of Devices > 1850!! Apple LG MS770 Samsung Galaxy SIII Microsoft Coolpad Quatro 4G ZTE N9210 Samsung Galaxy Admire 4G Droid RAZR Samsung Galaxy Note II LG Esteem LG MS870 Samsung Admire Samsung Epic 4G Samsung Galaxy SII Samsung Omnia II Other 4
  • 7. 9/19/2013 Pick an Automation Test Framework Prioritize Usage Data KPI Marketing Data Revenue Stream Data 5
  • 8. 9/19/2013 Real User Usage Pattern Home Screen Detail Screen 3 Detail Screen 1 All Other Values Detail Screen 2 Real User Data Stress Server Vs. UI Data Tests Performance New Features Production data System Under Test Run Tests Test Results Quality Assessment 6
  • 9. 9/19/2013 Stress Testing  Find Resource Leaks  Find App’s Capacity and Capabilities  Find Memory and Battery Consumption Trends Server Vs. UI Testing • Verify data is in-sync during testing Server • Ensure no data loss during test progress Client Test Framework • Detect UI TTL (Time to Load) on devices under various conditions 7
  • 10. 9/19/2013 Performance Testing (Analyze and Record KPIs) Effective Testing Write Once, Test Anywhere Test Re-Use Performance Availability Active Monitoring 8