SlideShare a Scribd company logo
T16	
  
Mobile	
  Testing	
  
5/5/16	
  13:30	
  
Stay	
  Ahead	
  of	
  the	
  Mobile	
  and	
  Web	
  
Testing	
  Maturity	
  Curve	
  
Presented	
  by:	
  
Danny	
  	
  McKeown	
  
Paychex	
  
Brought	
  to	
  you	
  by:	
  	
  
350	
  Corporate	
  Way,	
  Suite	
  400,	
  Orange	
  Park,	
  FL	
  32073	
  	
  
888-­‐-­‐-­‐268-­‐-­‐-­‐8770	
  ·∙·∙	
  904-­‐-­‐-­‐278-­‐-­‐-­‐0524	
  -­‐	
  info@techwell.com	
  -­‐	
  http://www.stareast.techwell.com/	
  
Danny	
  	
  McKeown	
  
Paychex	
  
Danny	
  McKeown	
  has	
  more	
  than	
  thirty	
  years	
  of	
  technical	
  and	
  management	
  
experience	
  in	
  information	
  technology.	
  With	
  Paychex	
  for	
  twelve	
  years,	
  Danny	
  has	
  
spent	
  the	
  last	
  six	
  years	
  as	
  the	
  test	
  automation	
  architect.	
  In	
  this	
  role,	
  he	
  is	
  
instrumental	
  in	
  implementing	
  a	
  secure	
  integration	
  of	
  Perfecto	
  Mobile's	
  solution	
  
with	
  the	
  Paychex	
  automation	
  framework	
  that	
  leverages	
  HP	
  UFT	
  and	
  Selenium	
  
technologies.	
  In	
  addition,	
  Danny	
  is	
  an	
  adjunct	
  lecturer	
  in	
  the	
  software	
  
engineering	
  department	
  at	
  the	
  Rochester	
  Institute	
  of	
  Technology.	
  	
  
Unit
API
UI Unit
API
UI
T16
Danny McKeown
Staying Ahead of the Mobile and Web
Testing Maturity Curve
Unit
API
UI
About the Speaker
Danny McKeown has more than 30 years of technical
and management experience in information
technology. With Paychex for 12 years , Danny has
spent the last six years as the test automation
architect. In this role, he is instrumental in
implementing a secure integration of Perfecto
Mobile’s solution with the Paychex automation
framework that leverages HP UFT and Selenium
technologies . In addition, Danny is an adjunct
lecturer in the software engineering department at
the Rochester Institute of Technology.
Unit
API
UI
Unit
API
UI
About Paychex
 Leader in payroll, human resource, and
benefits outsourcing solutions
 Small- to medium-sized businesses
 Over half million clients
 24 x 7, 365 days per year availability
 Mobile application – Paychex Flex
Unit
API
UI
Unit
API
UI
Today’s Focus
 Automation Strategy
 Environment Readiness Check
 Continuous Delivery
 Automation Adoption
 Impact of Agile Process
 Impact of Responsive Technology
 Our Mobile Timeline
 What’s next…
Unit
API
UI
Unit
API
UI
Change does not come easy
Unit
API
UI
Unit
API
UI
Why Test Automation?
Continuous improvement of:
 Raising the bar on Quality
“Degree of Excellence”
 Driving Efficiency
Time to Market
 Delighting the Customers
Unit
API
UI
Unit
API
UI
Automation Strategy
 Does your organization have a
test automation strategy?
 Paychex adopted the
Test Automation Pyramid
 Introduced by Mike Cohn
 Built an architecture around it
Unit
API
UI
Unit
API
UI
Test Automation Pyramid
Page #8
Unit Tests
API Tests
Headless, Non-UI, Service,
Database, & Business Logic Testing
UI
Tests
Supports Agile and Continuous Delivery
Unit
API
UI
Unit
API
UI
Test Automation Software StackEncapsulation, Scalability, Reuse
Page #9
Operating System
Windows, IE, Chrome, Firefox, Edge
API
Test/Job Execution, Reports
IT Tool
Integration
Resource
Objects, Scenarios, Scenario Drivers, Tests
Repository
Engine
Database, Services, Web (10 Engines)
Core Code
Language/IDE & 3rd Party Plugins
HTML 5, C#/.Net, Visual Studio, Perfecto, Applitools, Selenium, Ranorex
Vendor
Integration
Persistent Storage
SQL, Server, Entity, Framework, NAS
SOX
Application
Suite
User
Unit
API
UI
Unit
API
UI
Test Environments
Contribute to false negative test results?
99.9% availability?
99% availability?
90% availability?
What is the availability?
Configured correctly?
Patches up to date?
Monitored?
Change Control?
Unit
API
UI
Unit
API
UI
Apply Pre-Condition Testing
Input + Pre-Conditions = Post Conditions + Output
 Execute readiness check at each pyramid tier
Unit
API
UI
Unit
API
UI
Executing Automated Scripts
Execute scripts often to get automation value!
On DemandScheduled
Any time, for anyone, and any IT tool?
Paychex implemented an Automation Execution
Center (AEC) that supports Continuous Delivery (CD)
Unit
API
UI
Unit
API
UI
Automation Execution Center
Page #13
TRANSPOSE JOB
Exposed API Server
Exposed Web ServerLDAP
Tool
Independence
QUEUE JOB
STORE RESULTS
ARCHIVE
Automation DB
Tool Agnostic
Test Job
Secure
Controlled
Physical
Access
Account
TARGET
ENVIRONMENT
Non-Prod & Prod
Environments
Cloud
Computing
TEST JOB
SUBMISSION
No Test
Automation
Tools
Your IT platform
Continuous Delivery
Integrated, Scalable, Parallel Execution
EXECUTE JOB
Tool Dependent
Parallel Processing
Load Balancing
VM Farm
(also direct log in)
Tools installed
Unit
API
UI
Execute mobile “build/deploy/test” 3+ cycles per day
Release
Web Service & other Non-UI Regression
Majority of Business Logic is within the Web Services
Majority of User Experience is within the Mobile UI
Perfecto Cloud Connectivity/Latest App Version Copied
Sanity
Regression
Jenkins – Orchestrates Build, Deploy, & Test
Unit
API
UI
Unit
API
UI
Automation Adoption
At Paychex many implement automation:
 Development – Create unit tests
 Test Automation – Develop framework & automation apps
 Build Automation – Develop build, deploy, & test pipeline
 Testers - Utilize automation apps to create & execute test scripts
Automation is a cultural shift…needed some definitions
(and goals) to assist in the transformation
Unit
API
UI
Unit
API
UI
Test Automation Belts
Covers from Concepts to Non-UI & UI understanding
to Script Debugging
Unit
API
UI
Unit
API
UI
Agile impact on automation
Page #17
CORE TEAM
Developers
Testers
Business Analysts
Scrum Master
Dev Solution Lead Product Owner
Automation
Solution Lead
assigned to
each team
 Definition of “Done” expanded to include
automation, i.e., more automation
 Developers & Testers both
implement functional auto scripts
 Developers & Testers
naturally collaborating more
Unit
API
UI
Unit
API
UI
Responsive Technology
 Accelerated the need for mobile
web testing:
 Chrome, Firefox, IE, Edge (future)
 Safari
 Chrome (mobile)
 Accelerated the need for CD:
 Create a sustainable build, deployment
and test pipeline
 Promotion process from early to late
environments (Test to Prod)
 Test Automation went from a
“want” to a “need”!
Unit
API
UI
Unit
API
UI
Mobile Timeline
Page #19
Automation Solution
Manual
Testing
2012 2013
Automated
Testing
2014
Continuous
Delivery
2015
Agile
2016
Cross
Browser
Unit
API
UI
Unit
API
UI
What’s next…
 Testing desktop browsers in the cloud
 Profiling our test users
 Advance cross browser testing
 Seamless testing from test to prod with same suite of scripts
 Create tools to create test data for spun-up environments (CD)
Unit
API
UI
Unit
API
UI
We are all trained but…
Unit
API
UI
Thank You

More Related Content

What's hot

"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
Applitools
 
Test Automation for Mobile Applications: A Practical Guide
Test Automation for Mobile Applications: A Practical GuideTest Automation for Mobile Applications: A Practical Guide
Test Automation for Mobile Applications: A Practical Guide
TechWell
 
SQADAYS 21 Moscow 2017
SQADAYS 21 Moscow 2017SQADAYS 21 Moscow 2017
SQADAYS 21 Moscow 2017
Adam Sandman
 
Mastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita PuramMastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita Puram
QA or the Highway
 
Web application automated testing types and tools
Web application automated testing types and toolsWeb application automated testing types and tools
Web application automated testing types and tools
TestingXperts
 
Headless browser a stepping stone towards developing smarter web applicatio...
Headless browser   a stepping stone towards developing smarter web applicatio...Headless browser   a stepping stone towards developing smarter web applicatio...
Headless browser a stepping stone towards developing smarter web applicatio...
Bala Murugan
 
5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing
Perfecto by Perforce
 
Mobile Monitoring Best Practices
Mobile Monitoring Best PracticesMobile Monitoring Best Practices
Mobile Monitoring Best Practices
Lizzy Guido (she/her)
 
Automated Visual Testing at Scale : Real-life Example from Dow Jones
Automated Visual Testing at Scale : Real-life Example from Dow JonesAutomated Visual Testing at Scale : Real-life Example from Dow Jones
Automated Visual Testing at Scale : Real-life Example from Dow Jones
Applitools
 
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GameWhy Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Austin Marie Gay
 
Virgin Media's Mobile Quality Transformation
Virgin Media's Mobile Quality TransformationVirgin Media's Mobile Quality Transformation
Virgin Media's Mobile Quality Transformation
Perfecto by Perforce
 
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...
Perfecto by Perforce
 
Testing Tools with AI
Testing Tools with AITesting Tools with AI
Testing Tools with AI
VodqaBLR
 
Effective practices for API Test Automation
 Effective practices for API Test Automation  Effective practices for API Test Automation
Effective practices for API Test Automation
Cigniti Technologies Ltd
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More Accessible
Perfecto by Perforce
 
DevGeekWeek 2017 Inflectra Meetup in Herzliya Presentation
DevGeekWeek 2017 Inflectra Meetup in Herzliya PresentationDevGeekWeek 2017 Inflectra Meetup in Herzliya Presentation
DevGeekWeek 2017 Inflectra Meetup in Herzliya Presentation
Adam Sandman
 
How to Add Perfecto to Your CI
How to Add Perfecto to Your CIHow to Add Perfecto to Your CI
How to Add Perfecto to Your CI
Lizzy Guido (she/her)
 
TechTalk: Get to Know Perfecto
TechTalk: Get to Know Perfecto TechTalk: Get to Know Perfecto
TechTalk: Get to Know Perfecto
Lizzy Guido (she/her)
 
Mobile test automation perfecto star east
Mobile test automation perfecto star eastMobile test automation perfecto star east
Mobile test automation perfecto star east
Perfecto Mobile
 
Bringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & ApplitoolsBringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & Applitools
Applitools
 

What's hot (20)

"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
 
Test Automation for Mobile Applications: A Practical Guide
Test Automation for Mobile Applications: A Practical GuideTest Automation for Mobile Applications: A Practical Guide
Test Automation for Mobile Applications: A Practical Guide
 
SQADAYS 21 Moscow 2017
SQADAYS 21 Moscow 2017SQADAYS 21 Moscow 2017
SQADAYS 21 Moscow 2017
 
Mastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita PuramMastering the Art of Mobile Testing by Akshita Puram
Mastering the Art of Mobile Testing by Akshita Puram
 
Web application automated testing types and tools
Web application automated testing types and toolsWeb application automated testing types and tools
Web application automated testing types and tools
 
Headless browser a stepping stone towards developing smarter web applicatio...
Headless browser   a stepping stone towards developing smarter web applicatio...Headless browser   a stepping stone towards developing smarter web applicatio...
Headless browser a stepping stone towards developing smarter web applicatio...
 
5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing
 
Mobile Monitoring Best Practices
Mobile Monitoring Best PracticesMobile Monitoring Best Practices
Mobile Monitoring Best Practices
 
Automated Visual Testing at Scale : Real-life Example from Dow Jones
Automated Visual Testing at Scale : Real-life Example from Dow JonesAutomated Visual Testing at Scale : Real-life Example from Dow Jones
Automated Visual Testing at Scale : Real-life Example from Dow Jones
 
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GameWhy Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
 
Virgin Media's Mobile Quality Transformation
Virgin Media's Mobile Quality TransformationVirgin Media's Mobile Quality Transformation
Virgin Media's Mobile Quality Transformation
 
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...
 
Testing Tools with AI
Testing Tools with AITesting Tools with AI
Testing Tools with AI
 
Effective practices for API Test Automation
 Effective practices for API Test Automation  Effective practices for API Test Automation
Effective practices for API Test Automation
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More Accessible
 
DevGeekWeek 2017 Inflectra Meetup in Herzliya Presentation
DevGeekWeek 2017 Inflectra Meetup in Herzliya PresentationDevGeekWeek 2017 Inflectra Meetup in Herzliya Presentation
DevGeekWeek 2017 Inflectra Meetup in Herzliya Presentation
 
How to Add Perfecto to Your CI
How to Add Perfecto to Your CIHow to Add Perfecto to Your CI
How to Add Perfecto to Your CI
 
TechTalk: Get to Know Perfecto
TechTalk: Get to Know Perfecto TechTalk: Get to Know Perfecto
TechTalk: Get to Know Perfecto
 
Mobile test automation perfecto star east
Mobile test automation perfecto star eastMobile test automation perfecto star east
Mobile test automation perfecto star east
 
Bringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & ApplitoolsBringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & Applitools
 

Similar to Stay Ahead of the Mobile and Web Testing Maturity Curve

Test Automation at the Speed of Agile: Making It Work Every Build
Test Automation at the Speed of Agile: Making It Work Every BuildTest Automation at the Speed of Agile: Making It Work Every Build
Test Automation at the Speed of Agile: Making It Work Every Build
TechWell
 
Creating an MVP with Oracle
Creating an MVP with OracleCreating an MVP with Oracle
Creating an MVP with Oracle
Franco Ucci
 
All You Need to Know About Automated Integration Testing.pdf
All You Need to Know About Automated Integration Testing.pdfAll You Need to Know About Automated Integration Testing.pdf
All You Need to Know About Automated Integration Testing.pdf
RohitBhandari66
 
Dot Net Profile_8 Years Exp
Dot Net Profile_8 Years ExpDot Net Profile_8 Years Exp
Dot Net Profile_8 Years ExpAyyappan K
 
Discover the power of QA automation testing
Discover the power of QA automation testingDiscover the power of QA automation testing
Discover the power of QA automation testing
Softweb Solutions
 
Mohan_Resume
Mohan_ResumeMohan_Resume
Mohan_ResumeMohan P
 
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + KobitonLeveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Applitools
 
Resume-Neha-AWS
Resume-Neha-AWSResume-Neha-AWS
Resume-Neha-AWSNeha Gupta
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
QA or the Highway
 
Dev ops in agile - 1st Conference Melbourne
Dev ops in agile - 1st Conference MelbourneDev ops in agile - 1st Conference Melbourne
Dev ops in agile - 1st Conference Melbourne
Mirco Hering
 
Integrate Your Test Automation Tools for More Power
Integrate Your Test Automation Tools for More PowerIntegrate Your Test Automation Tools for More Power
Integrate Your Test Automation Tools for More Power
TechWell
 
Rajan ariaputhri res
Rajan ariaputhri resRajan ariaputhri res
Rajan ariaputhri res
Rajan Ariaputhri
 
Rajan ariaputhri res
Rajan ariaputhri resRajan ariaputhri res
Rajan ariaputhri res
Rajan Ariaputhri
 
VishalSinha_Resume_Ora
VishalSinha_Resume_OraVishalSinha_Resume_Ora
VishalSinha_Resume_OraVishal Sinha
 
Mobile Test Automation with Big Data Analytics
Mobile Test Automation with Big Data AnalyticsMobile Test Automation with Big Data Analytics
Mobile Test Automation with Big Data Analytics
TechWell
 
David_Walaski_Resume
David_Walaski_ResumeDavid_Walaski_Resume
David_Walaski_ResumeDavid Walaski
 
Mobile devops transformation
Mobile devops transformationMobile devops transformation
Mobile devops transformation
Praveen Kumar Kushwaha
 

Similar to Stay Ahead of the Mobile and Web Testing Maturity Curve (20)

Test Automation at the Speed of Agile: Making It Work Every Build
Test Automation at the Speed of Agile: Making It Work Every BuildTest Automation at the Speed of Agile: Making It Work Every Build
Test Automation at the Speed of Agile: Making It Work Every Build
 
Creating an MVP with Oracle
Creating an MVP with OracleCreating an MVP with Oracle
Creating an MVP with Oracle
 
All You Need to Know About Automated Integration Testing.pdf
All You Need to Know About Automated Integration Testing.pdfAll You Need to Know About Automated Integration Testing.pdf
All You Need to Know About Automated Integration Testing.pdf
 
Dot Net Profile_8 Years Exp
Dot Net Profile_8 Years ExpDot Net Profile_8 Years Exp
Dot Net Profile_8 Years Exp
 
Discover the power of QA automation testing
Discover the power of QA automation testingDiscover the power of QA automation testing
Discover the power of QA automation testing
 
Mohan_Resume
Mohan_ResumeMohan_Resume
Mohan_Resume
 
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + KobitonLeveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
 
Ayaz_Resume
Ayaz_ResumeAyaz_Resume
Ayaz_Resume
 
Resume-Neha-AWS
Resume-Neha-AWSResume-Neha-AWS
Resume-Neha-AWS
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
 
Dev ops in agile - 1st Conference Melbourne
Dev ops in agile - 1st Conference MelbourneDev ops in agile - 1st Conference Melbourne
Dev ops in agile - 1st Conference Melbourne
 
Integrate Your Test Automation Tools for More Power
Integrate Your Test Automation Tools for More PowerIntegrate Your Test Automation Tools for More Power
Integrate Your Test Automation Tools for More Power
 
Rajan ariaputhri res
Rajan ariaputhri resRajan ariaputhri res
Rajan ariaputhri res
 
Rajan ariaputhri res
Rajan ariaputhri resRajan ariaputhri res
Rajan ariaputhri res
 
Bakiyaraj_Profile_25-May-2015
Bakiyaraj_Profile_25-May-2015Bakiyaraj_Profile_25-May-2015
Bakiyaraj_Profile_25-May-2015
 
VishalSinha_Resume_Ora
VishalSinha_Resume_OraVishalSinha_Resume_Ora
VishalSinha_Resume_Ora
 
Mobile Test Automation with Big Data Analytics
Mobile Test Automation with Big Data AnalyticsMobile Test Automation with Big Data Analytics
Mobile Test Automation with Big Data Analytics
 
Resume of Praveen
Resume of PraveenResume of Praveen
Resume of Praveen
 
David_Walaski_Resume
David_Walaski_ResumeDavid_Walaski_Resume
David_Walaski_Resume
 
Mobile devops transformation
Mobile devops transformationMobile devops transformation
Mobile devops transformation
 

More from Josiah Renaudin

Solve Everyday IT Problems with DevOps
Solve Everyday IT Problems with DevOpsSolve Everyday IT Problems with DevOps
Solve Everyday IT Problems with DevOps
Josiah Renaudin
 
End-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of TestingEnd-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of Testing
Josiah Renaudin
 
Product Management: The Innovation Glue for the Lean Enterprise
Product Management: The Innovation Glue for the Lean EnterpriseProduct Management: The Innovation Glue for the Lean Enterprise
Product Management: The Innovation Glue for the Lean Enterprise
Josiah Renaudin
 
Slay the Dragons of Agile Measurement
Slay the Dragons of Agile MeasurementSlay the Dragons of Agile Measurement
Slay the Dragons of Agile Measurement
Josiah Renaudin
 
Blending Product Discovery and Product Delivery
Blending Product Discovery and Product DeliveryBlending Product Discovery and Product Delivery
Blending Product Discovery and Product Delivery
Josiah Renaudin
 
Determining Business Value in Agile Development
Determining Business Value in Agile DevelopmentDetermining Business Value in Agile Development
Determining Business Value in Agile Development
Josiah Renaudin
 
Three Things You MUST Know to Transform into an Agile Enterprise
Three Things You MUST Know to Transform into an Agile EnterpriseThree Things You MUST Know to Transform into an Agile Enterprise
Three Things You MUST Know to Transform into an Agile Enterprise
Josiah Renaudin
 
Internet of Things and the Wisdom of Mobile
Internet of Things and the Wisdom of MobileInternet of Things and the Wisdom of Mobile
Internet of Things and the Wisdom of Mobile
Josiah Renaudin
 
How to Do Kick-Ass Software Development
How to Do Kick-Ass Software DevelopmentHow to Do Kick-Ass Software Development
How to Do Kick-Ass Software Development
Josiah Renaudin
 
The Power of an Agile Mindset
The Power of an Agile MindsetThe Power of an Agile Mindset
The Power of an Agile Mindset
Josiah Renaudin
 
DevOps and the Culture of High-Performing Software Organizations
DevOps and the Culture of High-Performing Software OrganizationsDevOps and the Culture of High-Performing Software Organizations
DevOps and the Culture of High-Performing Software Organizations
Josiah Renaudin
 
Uncover Untold Stories in Your Data: A Deep Dive on Data Profiling
Uncover Untold Stories in Your Data: A Deep Dive on Data ProfilingUncover Untold Stories in Your Data: A Deep Dive on Data Profiling
Uncover Untold Stories in Your Data: A Deep Dive on Data Profiling
Josiah Renaudin
 
Build a Quality Engineering and Automation Framework
Build a Quality Engineering and Automation FrameworkBuild a Quality Engineering and Automation Framework
Build a Quality Engineering and Automation Framework
Josiah Renaudin
 
Don’t Be Another Statistic! Develop a Long-Term Test Automation Strategy
Don’t Be Another Statistic! Develop a Long-Term Test Automation StrategyDon’t Be Another Statistic! Develop a Long-Term Test Automation Strategy
Don’t Be Another Statistic! Develop a Long-Term Test Automation Strategy
Josiah Renaudin
 
Testing Lessons from the Land of Make Believe
Testing Lessons from the Land of Make BelieveTesting Lessons from the Land of Make Believe
Testing Lessons from the Land of Make Believe
Josiah Renaudin
 
Finding Success with Test Process Improvement
Finding Success with Test Process ImprovementFinding Success with Test Process Improvement
Finding Success with Test Process Improvement
Josiah Renaudin
 
Git and GitHub for Testers
Git and GitHub for TestersGit and GitHub for Testers
Git and GitHub for Testers
Josiah Renaudin
 
The Selenium Grid: Run Multiple Automated Tests in Parallel
The Selenium Grid: Run Multiple Automated Tests in ParallelThe Selenium Grid: Run Multiple Automated Tests in Parallel
The Selenium Grid: Run Multiple Automated Tests in Parallel
Josiah Renaudin
 
Testing at Startup Companies: What, When, Where, and How
Testing at Startup Companies: What, When, Where, and HowTesting at Startup Companies: What, When, Where, and How
Testing at Startup Companies: What, When, Where, and How
Josiah Renaudin
 
Boost Test Coverage with Automated Visual Testing
Boost Test Coverage with Automated Visual TestingBoost Test Coverage with Automated Visual Testing
Boost Test Coverage with Automated Visual Testing
Josiah Renaudin
 

More from Josiah Renaudin (20)

Solve Everyday IT Problems with DevOps
Solve Everyday IT Problems with DevOpsSolve Everyday IT Problems with DevOps
Solve Everyday IT Problems with DevOps
 
End-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of TestingEnd-to-End Quality Approach: 14 Levels of Testing
End-to-End Quality Approach: 14 Levels of Testing
 
Product Management: The Innovation Glue for the Lean Enterprise
Product Management: The Innovation Glue for the Lean EnterpriseProduct Management: The Innovation Glue for the Lean Enterprise
Product Management: The Innovation Glue for the Lean Enterprise
 
Slay the Dragons of Agile Measurement
Slay the Dragons of Agile MeasurementSlay the Dragons of Agile Measurement
Slay the Dragons of Agile Measurement
 
Blending Product Discovery and Product Delivery
Blending Product Discovery and Product DeliveryBlending Product Discovery and Product Delivery
Blending Product Discovery and Product Delivery
 
Determining Business Value in Agile Development
Determining Business Value in Agile DevelopmentDetermining Business Value in Agile Development
Determining Business Value in Agile Development
 
Three Things You MUST Know to Transform into an Agile Enterprise
Three Things You MUST Know to Transform into an Agile EnterpriseThree Things You MUST Know to Transform into an Agile Enterprise
Three Things You MUST Know to Transform into an Agile Enterprise
 
Internet of Things and the Wisdom of Mobile
Internet of Things and the Wisdom of MobileInternet of Things and the Wisdom of Mobile
Internet of Things and the Wisdom of Mobile
 
How to Do Kick-Ass Software Development
How to Do Kick-Ass Software DevelopmentHow to Do Kick-Ass Software Development
How to Do Kick-Ass Software Development
 
The Power of an Agile Mindset
The Power of an Agile MindsetThe Power of an Agile Mindset
The Power of an Agile Mindset
 
DevOps and the Culture of High-Performing Software Organizations
DevOps and the Culture of High-Performing Software OrganizationsDevOps and the Culture of High-Performing Software Organizations
DevOps and the Culture of High-Performing Software Organizations
 
Uncover Untold Stories in Your Data: A Deep Dive on Data Profiling
Uncover Untold Stories in Your Data: A Deep Dive on Data ProfilingUncover Untold Stories in Your Data: A Deep Dive on Data Profiling
Uncover Untold Stories in Your Data: A Deep Dive on Data Profiling
 
Build a Quality Engineering and Automation Framework
Build a Quality Engineering and Automation FrameworkBuild a Quality Engineering and Automation Framework
Build a Quality Engineering and Automation Framework
 
Don’t Be Another Statistic! Develop a Long-Term Test Automation Strategy
Don’t Be Another Statistic! Develop a Long-Term Test Automation StrategyDon’t Be Another Statistic! Develop a Long-Term Test Automation Strategy
Don’t Be Another Statistic! Develop a Long-Term Test Automation Strategy
 
Testing Lessons from the Land of Make Believe
Testing Lessons from the Land of Make BelieveTesting Lessons from the Land of Make Believe
Testing Lessons from the Land of Make Believe
 
Finding Success with Test Process Improvement
Finding Success with Test Process ImprovementFinding Success with Test Process Improvement
Finding Success with Test Process Improvement
 
Git and GitHub for Testers
Git and GitHub for TestersGit and GitHub for Testers
Git and GitHub for Testers
 
The Selenium Grid: Run Multiple Automated Tests in Parallel
The Selenium Grid: Run Multiple Automated Tests in ParallelThe Selenium Grid: Run Multiple Automated Tests in Parallel
The Selenium Grid: Run Multiple Automated Tests in Parallel
 
Testing at Startup Companies: What, When, Where, and How
Testing at Startup Companies: What, When, Where, and HowTesting at Startup Companies: What, When, Where, and How
Testing at Startup Companies: What, When, Where, and How
 
Boost Test Coverage with Automated Visual Testing
Boost Test Coverage with Automated Visual TestingBoost Test Coverage with Automated Visual Testing
Boost Test Coverage with Automated Visual Testing
 

Recently uploaded

Software Testing Exam imp Ques Notes.pdf
Software Testing Exam imp Ques Notes.pdfSoftware Testing Exam imp Ques Notes.pdf
Software Testing Exam imp Ques Notes.pdf
MayankTawar1
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
vrstrong314
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
informapgpstrackings
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with Platformless
WSO2
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
A Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdfA Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdf
kalichargn70th171
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptx
varshanayak241
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
Globus
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
Globus
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
Globus
 
Corporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMSCorporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMS
Tendenci - The Open Source AMS (Association Management Software)
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
XfilesPro
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
XfilesPro
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
Ortus Solutions, Corp
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Shahin Sheidaei
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should Know
Peter Caitens
 

Recently uploaded (20)

Software Testing Exam imp Ques Notes.pdf
Software Testing Exam imp Ques Notes.pdfSoftware Testing Exam imp Ques Notes.pdf
Software Testing Exam imp Ques Notes.pdf
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with Platformless
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
A Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdfA Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdf
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptx
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
Corporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMSCorporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMS
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should Know
 

Stay Ahead of the Mobile and Web Testing Maturity Curve

  • 1. T16   Mobile  Testing   5/5/16  13:30   Stay  Ahead  of  the  Mobile  and  Web   Testing  Maturity  Curve   Presented  by:   Danny    McKeown   Paychex   Brought  to  you  by:     350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073     888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  info@techwell.com  -­‐  http://www.stareast.techwell.com/  
  • 2. Danny    McKeown   Paychex   Danny  McKeown  has  more  than  thirty  years  of  technical  and  management   experience  in  information  technology.  With  Paychex  for  twelve  years,  Danny  has   spent  the  last  six  years  as  the  test  automation  architect.  In  this  role,  he  is   instrumental  in  implementing  a  secure  integration  of  Perfecto  Mobile's  solution   with  the  Paychex  automation  framework  that  leverages  HP  UFT  and  Selenium   technologies.  In  addition,  Danny  is  an  adjunct  lecturer  in  the  software   engineering  department  at  the  Rochester  Institute  of  Technology.    
  • 3. Unit API UI Unit API UI T16 Danny McKeown Staying Ahead of the Mobile and Web Testing Maturity Curve
  • 4. Unit API UI About the Speaker Danny McKeown has more than 30 years of technical and management experience in information technology. With Paychex for 12 years , Danny has spent the last six years as the test automation architect. In this role, he is instrumental in implementing a secure integration of Perfecto Mobile’s solution with the Paychex automation framework that leverages HP UFT and Selenium technologies . In addition, Danny is an adjunct lecturer in the software engineering department at the Rochester Institute of Technology.
  • 5. Unit API UI Unit API UI About Paychex  Leader in payroll, human resource, and benefits outsourcing solutions  Small- to medium-sized businesses  Over half million clients  24 x 7, 365 days per year availability  Mobile application – Paychex Flex
  • 6. Unit API UI Unit API UI Today’s Focus  Automation Strategy  Environment Readiness Check  Continuous Delivery  Automation Adoption  Impact of Agile Process  Impact of Responsive Technology  Our Mobile Timeline  What’s next…
  • 8. Unit API UI Unit API UI Why Test Automation? Continuous improvement of:  Raising the bar on Quality “Degree of Excellence”  Driving Efficiency Time to Market  Delighting the Customers
  • 9. Unit API UI Unit API UI Automation Strategy  Does your organization have a test automation strategy?  Paychex adopted the Test Automation Pyramid  Introduced by Mike Cohn  Built an architecture around it
  • 10. Unit API UI Unit API UI Test Automation Pyramid Page #8 Unit Tests API Tests Headless, Non-UI, Service, Database, & Business Logic Testing UI Tests Supports Agile and Continuous Delivery
  • 11. Unit API UI Unit API UI Test Automation Software StackEncapsulation, Scalability, Reuse Page #9 Operating System Windows, IE, Chrome, Firefox, Edge API Test/Job Execution, Reports IT Tool Integration Resource Objects, Scenarios, Scenario Drivers, Tests Repository Engine Database, Services, Web (10 Engines) Core Code Language/IDE & 3rd Party Plugins HTML 5, C#/.Net, Visual Studio, Perfecto, Applitools, Selenium, Ranorex Vendor Integration Persistent Storage SQL, Server, Entity, Framework, NAS SOX Application Suite User
  • 12. Unit API UI Unit API UI Test Environments Contribute to false negative test results? 99.9% availability? 99% availability? 90% availability? What is the availability? Configured correctly? Patches up to date? Monitored? Change Control?
  • 13. Unit API UI Unit API UI Apply Pre-Condition Testing Input + Pre-Conditions = Post Conditions + Output  Execute readiness check at each pyramid tier
  • 14. Unit API UI Unit API UI Executing Automated Scripts Execute scripts often to get automation value! On DemandScheduled Any time, for anyone, and any IT tool? Paychex implemented an Automation Execution Center (AEC) that supports Continuous Delivery (CD)
  • 15. Unit API UI Unit API UI Automation Execution Center Page #13 TRANSPOSE JOB Exposed API Server Exposed Web ServerLDAP Tool Independence QUEUE JOB STORE RESULTS ARCHIVE Automation DB Tool Agnostic Test Job Secure Controlled Physical Access Account TARGET ENVIRONMENT Non-Prod & Prod Environments Cloud Computing TEST JOB SUBMISSION No Test Automation Tools Your IT platform Continuous Delivery Integrated, Scalable, Parallel Execution EXECUTE JOB Tool Dependent Parallel Processing Load Balancing VM Farm (also direct log in) Tools installed
  • 16. Unit API UI Execute mobile “build/deploy/test” 3+ cycles per day Release Web Service & other Non-UI Regression Majority of Business Logic is within the Web Services Majority of User Experience is within the Mobile UI Perfecto Cloud Connectivity/Latest App Version Copied Sanity Regression Jenkins – Orchestrates Build, Deploy, & Test
  • 17. Unit API UI Unit API UI Automation Adoption At Paychex many implement automation:  Development – Create unit tests  Test Automation – Develop framework & automation apps  Build Automation – Develop build, deploy, & test pipeline  Testers - Utilize automation apps to create & execute test scripts Automation is a cultural shift…needed some definitions (and goals) to assist in the transformation
  • 18. Unit API UI Unit API UI Test Automation Belts Covers from Concepts to Non-UI & UI understanding to Script Debugging
  • 19. Unit API UI Unit API UI Agile impact on automation Page #17 CORE TEAM Developers Testers Business Analysts Scrum Master Dev Solution Lead Product Owner Automation Solution Lead assigned to each team  Definition of “Done” expanded to include automation, i.e., more automation  Developers & Testers both implement functional auto scripts  Developers & Testers naturally collaborating more
  • 20. Unit API UI Unit API UI Responsive Technology  Accelerated the need for mobile web testing:  Chrome, Firefox, IE, Edge (future)  Safari  Chrome (mobile)  Accelerated the need for CD:  Create a sustainable build, deployment and test pipeline  Promotion process from early to late environments (Test to Prod)  Test Automation went from a “want” to a “need”!
  • 21. Unit API UI Unit API UI Mobile Timeline Page #19 Automation Solution Manual Testing 2012 2013 Automated Testing 2014 Continuous Delivery 2015 Agile 2016 Cross Browser
  • 22. Unit API UI Unit API UI What’s next…  Testing desktop browsers in the cloud  Profiling our test users  Advance cross browser testing  Seamless testing from test to prod with same suite of scripts  Create tools to create test data for spun-up environments (CD)