SlideShare a Scribd company logo
 
	
  
	
  
	
  
	
  
	
  
	
  
	
  
T22	
  
Cloud	
  Testing	
  
5/11/17	
  15:00	
  
	
  
	
  
	
  
	
  
	
  
Continuous	
  Testing	
  of	
  Cloud	
  
Applications	
  
	
  
Presented	
  by:	
  	
  
	
  
	
   Ganesh	
  Iyer	
  
	
  
Progress	
  Software	
  Development	
  
	
  
Brought	
  to	
  you	
  by:	
  	
  
	
  	
  
	
  
	
  
	
  
	
  
350	
  Corporate	
  Way,	
  Suite	
  400,	
  Orange	
  Park,	
  FL	
  32073	
  	
  
888-­‐-­‐-­‐268-­‐-­‐-­‐8770	
  ·∙·∙	
  904-­‐-­‐-­‐278-­‐-­‐-­‐0524	
  -­‐	
  info@techwell.com	
  -­‐	
  http://www.starwest.techwell.com/	
  	
  	
  
 
	
  	
  
	
  
Ganesh	
  Iyer	
  
	
  
Ganesh	
  Iyer	
  -­‐	
  QA	
  architect,	
  technology	
  evangelist,	
  researcher,	
  professor,	
  blogger,	
  
photographer,	
  and	
  dancer	
  -­‐	
  is	
  a	
  QA	
  architect	
  with	
  Progress	
  Software	
  Development.	
  
He	
  is	
  involved	
  in	
  several	
  key	
  QA	
  initiatives	
  including	
  cloud	
  test	
  architecture,	
  24/7	
  
test	
  automation	
  framework,	
  web	
  automation	
  framework	
  using	
  Selenium	
  and	
  
TypeScript,	
  and	
  a	
  high-­‐availability	
  test	
  framework	
  with	
  tests	
  in	
  long	
  running	
  mode.	
  
A	
  visiting	
  faculty	
  member	
  at	
  IIIT-­‐Hyderabad,	
  Ganesh	
  has	
  authored	
  book	
  chapters	
  
and	
  journal	
  articles,	
  and	
  presented	
  talks	
  and	
  workshops	
  on	
  various	
  technologies	
  in	
  
international	
  settings.	
  
	
  
Continuous Testing
Dr Ganesh Neelakanta Iyer
QA Architect
GANESHNIYER
gaiyer@progress.com
http://ganeshniyer.com
About Me
§  12+ years of Research and Development experience
§  Masters and Ph.D. from National University of Singapore
§  Several talks/workshops in India, USA, Europe and Australia
§  Personal Interests: Kathakali, Teaching, Traveling
§  Website: http://ganeshniyer.com
GANESHNIYER
§  Current:
•  Technical Support Manager (Asia Pacific) at Progress Software, India
•  Visiting Faculty at IIIT-H (A premier academic institution in India)
•  Technology/Product Evangelist
§  Past:
•  Software Developer
•  QA Architect
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.3
Quick Poll
Are you using Version Control?
Safe?
Can you release new version of
your software in one day?
Quick
Can you release new, well-
tested version of your software
in one day?
Quick & Safe?
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.7
Agenda
§  Software Development today
§  Continuous Integration and Continuous Testing
§  24x7 Testing
What are top changes in
Software development
that were disruptive for
existing test
methodologies?
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.9
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.10
Agile
Credit: Blazemeter; Continuous Testing in Practice
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.11
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.12
Test Challenges with Agile Methodology
Frequently changing requirements
• Thanks to Agile à Changes can happen at any point of time during release cycle
• Requirements and Test Cases developed in parallel or test first strategy
Frequent releases
• Progress Rollbase released new features every 9 days in 2016
• Testing needs to happen Early and Often, Everyone needs to Test
Understanding and testing real world behavior
• How customers see the product behavior after a release?
• No SRS-level waterfall documents to drive testing plan
Multiple environments & differences for test and production systems
• 3rd party systems integrated to the product
• Raises a requirement for GoLive Testing à But in minimal time
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.13
Software Test Challenges With Cloud
§  Web-driven SaaS applications
§  Everything in a few mouse clicks
§  Frequent releases / Frequent changes
§  No SRS documents
§  Publically shared resources
§  Multi-tenant penetration testing
Paradigm Shift
§  High Availability and Resiliency are key
§  Seamless upgrades
Everything is Agile
Availability Everything is shared
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.14
Continuous Integration & Automation are Key in Agile
Automation
•  Nightly / Weekly
Build
Integration
•  Combination of
unit tests and
regression tests
Dev-
environment
•  Unit-tested
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.15
Continuous Integration and
Continuous Testing
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.16
Dev/Test à Expectations continue to increase
Better – Cheaper - Faster
Past
• Balance between speed, cost
and risk
Today
• Demand for releasing high
quality software faster
Credit: IBM article on Continuous Testing
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.17
Applications are becoming more complex to test
§  Setting up complex environments
§  Delays caused by lack of system
availability
§  Third party services can be costly
§  Testers spend more time setting up
tests than testing
Testing teams
spend on setting
up test
environments,
instead of testing
30-50%
average
time
Credit: IBM article on Continuous Testing
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.18
Continuous Integration and continuous testing
Accelerate software
delivery – for faster
time to value
Balance speed, cost,
quality and risk – for
increased capacity to
innovate
Reduce time to
customer feedback –
for improved
customer experience
PC Credit: https://https://goo.gl/A2AaQw
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.19
Shift left, test early, test often
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.20
The Testing
Process – From
Development to
Operations
Credit: Blazemeter; Continuous Testing in Practice
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.21
Continuous Testing in Practice – Requirements Checklist
Tools, Scripting and
Overall Test Creation
•  The provision of libraries and APIs to create “homegrown” tests
•  The ability to create browser-based tests
•  Ability for load and scalability testing
Provisioning and
Resources
•  The option to run the same sets of tests with different provisioning
•  The ability to easily adopt a new provisioning scheme when a test
configuration is executed in a different environment (e.g. Dev, CI,
Pre-Prod, Post-Prod)
•  The ability to start testing as part of the CI process
Automation
•  The ability to run any test configuration, a test, or a set of tests
using simple API calls
•  The option to run as many tests as required in parallel
On-Demand Testing
and Re-Running Failed
Use Cases
•  The ability to run any type of test on-demand. This is critical for
test development, debugging, troubleshooting and identifying the
root cause of a failure
•  The option to automate test executions and run the same test on-
demand
Credit: Blazemeter; Continuous Testing in Practice
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.22
Continuous Testing in Practice – Requirements Checklist
Modules, Builds,
Release Candidates,
Releases and
Production
•  The ability to combine different configuration fragments into one test
configuration in order to comprehensively test build, release, and
production snapshots.
Version Control Friendly
Incremental Testing
•  The ability to support version control, incremental testing and
associate test configurations, sets of tests, and tests with versions (e.g
code, build, RC, releases).
Automatic ‘Failure’
Alerts
•  Automatic indications of failures, with an alerting scheme per
developer, module and project
•  The ability to gather all test artifacts and immediately send to relevant
people
•  The option to run the failed tests again to identify the root cause
Reporting
•  A seamless integration with existing reporting solutions (e.g. Jenkins
Performance Trend)
•  The option to group tests by builds
•  The ability to give jobs a ‘pass’ or ‘fail’ status and group accordingly
•  Pass/fail trend reports
Credit: Blazemeter; Continuous Testing in Practice
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.23
24x7 Testing; A Case study of
what we do at Progress
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.24
24 x 7 Testing
Understanding and testing real world behavior
What is 24x7?
•  Running a set of test
cases continuously 24 x
7
•  Simulates real time
customer behavior
How 24x7?
•  A few parallel threads
accessing the product
•  Tests consisting of
regression (or it’s subset)
tests
Why 24 x 7?
•  Many things can’t be
caught by regular
functional testing
•  Error handling and retries
•  Product can be made
more resilient and robust
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.25
24 x 7 Testing
VMs / Build Integration Machines
ANT ScriptTests
Reports using
Kendo UI controls
Decides
parallelism
HTTP POST reqBatch
Script
Decides
frequency
Logs
SUT
• Progress
products such
as Rollbase
• Uses any test
environments
• Existing test
cases can be
leveraged
Batch Script
• Decides the
frequency
• E.g. run on an
hourly basis
• Run in an
infinite loop
24x7
ANT Script
• We configure
#Threads,
#Tests to run in
parallel
• Tests can run
on VMs / Build
integration
machines
Reports
• Shown using
Keno UI
controls /
widgets
• Driver scripts
sends results
to the portal
• Machine stores
the logs
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.26
Case Study - Example
§  Cloud platform that let you build SaaS-
based business apps in days/hours
§  Responsive UI with built-in themes
§  Typical apps customers build
•  CRM
•  Employee Management
•  Bug Tracking System
What could be some typical tests for this platform?
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.27
Case study - Identifying tests; Example
§  100 parallel treads
•  50 of them access “Bug Tracking System” application
•  50 of them access “CRM Application”
§  Use cases
1.  Create a bug and assign it to a user which will run an email trigger and related record trigger
– 10 users
2.  Update the workflow status of some existing bug which will run a trigger – 20 users
3.  Filter operation on bug object – 20 users
4.  Create a lead from CRM portal and attach the lead to an account – 20 users
5.  Look for all leads whose workflow status is “Open - Not Contacted” – 10 users
6.  Create a new opportunity, assign it to an owner and attach it to an account – 10 users
7.  Change the workflow status of an existing opportunity to “Closed-won” – 10 users
Tests should not
be self-cleaning
Why?
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.28
Layout of the infrastructure
BATCH script
•  Checkout latest test scripts
•  Compile and run them
ANT script
•  Properties file containing the details of
test agents
•  Invoke scripts in the agent machine
Central
Machine
Test
Agent 1
Test
Agent 2
…
Test
Agent n
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.29
Central Server
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.30
Central Server – Build.properties
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.31
Central Server – <Product name>.properties
testtype=Telerik
testlist="Psexec.exe 172.29.36.205 -u Administrator -p Progress!2009 -i 2 -w c:Telerik
c:Teleriktelerik.bat";"Psexec.exe 172.29.36.207 -u Administrator -p Progress!2009 -i 2
-w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.208 -u Administrator -p
Progress!2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.209 -u
Administrator -p Progress!2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 
172.29.36.215 -u Administrator -p Progress!2009 -i 2 -w c:Telerik c:Telerik
telerik.bat";"Psexec.exe 172.29.36.90 -u Administrator -p Progress!2009 -i 2 -w c:
Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.227 -u Administrator -p Progress!
2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.231 -u
Administrator -p Progress!2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 
172.29.36.229 -u Administrator -p Progress!2009 -i 2 -w c:Telerik c:Telerik
telerik.bat";"Psexec.exe 172.29.36.233 -u Administrator -p Progress!2009 -i 2 -w c:
Telerik c:Teleriktelerik.bat"
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.32
24 x 7 Testing – Sample report
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.33
Key Advantages of 24x7 testing
§  Catch issues which are difficult to catch using normal functional
testing
§  Make products resilient and robust
§  Catch unexpected integration issues
§  Test real time customer behavior
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.34
Catch issues which are difficult to catch using normal functional testing
https://cdn.tutsplus.com/wp/uploads/2013/12/session-diagram.jpg
http://biobeasts.artix.com/content/images/2015/07/memory-leak.jpg
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.35
Make products resilient and robust
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.36
Catch unexpected integration issues
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.37
Test real time customer behavior
http://blog.perfectomobile.com/wp-content/uploads/2015/10/WINDTUNNELGRAPHIC.jpg
© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.38
Advantages of continuous Testing
Helping to make software development faster
•  Continuous testing can make it possible to making software available sooner without
compromising quality
Reduced Risk
•  Every time a change is made to code or new code is written, there is the potential for error to
occur. Identifying the problem is much easier when continuous testing is performed and the
issue is caught immediately so problems can be corrected.
Making consistency simpler
•  Automation of testing makes it easier to achieve consistency by providing a carefully configured
environment and maintaining the same correct configuration for all relevant tests
Faster releases
•  The process of regularly using continuous testing means that cleaner code can be released to
end users in a timely manner
https://www.etesting.com/2014/02/25/benefits-of-continuous-testing/
Are you ready to implement
Continuous Testing in your
organization?
gaiyer@progress.com
http://ganeshniyer.com
GANESHNIYER

More Related Content

What's hot

Vladimir Primakov - Qa management in big agile teams
Vladimir Primakov - Qa management in big agile teamsVladimir Primakov - Qa management in big agile teams
Vladimir Primakov - Qa management in big agile teams
Ievgenii Katsan
 
ApexUnit: Open source test framework for apex
ApexUnit: Open source test framework for apexApexUnit: Open source test framework for apex
ApexUnit: Open source test framework for apex
Vamshidhar Gandham
 
Continuous testing
Continuous testing Continuous testing
Continuous testing
Dr Ganesh Iyer
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps Environment
Neotys
 
Test Metrics in Agile - powerful tool to support changes - Zavertailo Iuliia
Test Metrics in Agile - powerful tool to support changes - Zavertailo IuliiaTest Metrics in Agile - powerful tool to support changes - Zavertailo Iuliia
Test Metrics in Agile - powerful tool to support changes - Zavertailo IuliiaYulia Zavertailo
 
“ЕРАМ у Південному регіоні та можливості розвитку для QA спеціалістів” Online...
“ЕРАМ у Південному регіоні та можливості розвитку для QA спеціалістів” Online...“ЕРАМ у Південному регіоні та можливості розвитку для QA спеціалістів” Online...
“ЕРАМ у Південному регіоні та можливості розвитку для QA спеціалістів” Online...
QADay
 
Achieve Performance Testing Excellence for Your SAP Apps
Achieve Performance Testing Excellence for Your SAP AppsAchieve Performance Testing Excellence for Your SAP Apps
Achieve Performance Testing Excellence for Your SAP Apps
Neotys
 
Agile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged ApplicationsAgile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged Applications
Worksoft
 
How Developers and Quality Engineer Collaborate at Salesforce
How Developers and Quality Engineer Collaborate at SalesforceHow Developers and Quality Engineer Collaborate at Salesforce
How Developers and Quality Engineer Collaborate at Salesforce
Salesforce Engineering
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
QA or the Highway
 
Insurance for your Assurance Team
Insurance for your Assurance TeamInsurance for your Assurance Team
Insurance for your Assurance Team
Worksoft
 
Test Metrics in Agile: A Powerful Tool to Demonstrate Value
Test Metrics in Agile: A Powerful Tool to Demonstrate ValueTest Metrics in Agile: A Powerful Tool to Demonstrate Value
Test Metrics in Agile: A Powerful Tool to Demonstrate Value
TechWell
 
DevOps as-a-Service (DaaS) value
DevOps as-a-Service (DaaS) valueDevOps as-a-Service (DaaS) value
DevOps as-a-Service (DaaS) value
Marc Hornbeek
 
DevOps 2017 Conf: evolving from automated to continuous
DevOps 2017 Conf: evolving from automated to continuousDevOps 2017 Conf: evolving from automated to continuous
DevOps 2017 Conf: evolving from automated to continuous
Arthur Hicken
 
Test Automation is for Everyone
Test Automation is for EveryoneTest Automation is for Everyone
Test Automation is for Everyone
Worksoft
 
Webinar: DevOps challenges facing QA
Webinar: DevOps challenges facing QAWebinar: DevOps challenges facing QA
Webinar: DevOps challenges facing QA
Qualitest
 
How Verizon Uses Automation to Accelerate SAP Projects
How Verizon Uses Automation to Accelerate SAP ProjectsHow Verizon Uses Automation to Accelerate SAP Projects
How Verizon Uses Automation to Accelerate SAP Projects
Worksoft
 
Automate Salesforce Releases with DevOps: Crawl, Walk, Run!
Automate Salesforce Releases with DevOps: Crawl, Walk, Run!Automate Salesforce Releases with DevOps: Crawl, Walk, Run!
Automate Salesforce Releases with DevOps: Crawl, Walk, Run!
Susmitha Vakkalanka
 
How to implement DevOps in your Organization
How to implement DevOps in your OrganizationHow to implement DevOps in your Organization
How to implement DevOps in your Organization
Dalibor Blazevic
 
Dev ops
Dev opsDev ops
Dev ops
Tomas Riha
 

What's hot (20)

Vladimir Primakov - Qa management in big agile teams
Vladimir Primakov - Qa management in big agile teamsVladimir Primakov - Qa management in big agile teams
Vladimir Primakov - Qa management in big agile teams
 
ApexUnit: Open source test framework for apex
ApexUnit: Open source test framework for apexApexUnit: Open source test framework for apex
ApexUnit: Open source test framework for apex
 
Continuous testing
Continuous testing Continuous testing
Continuous testing
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps Environment
 
Test Metrics in Agile - powerful tool to support changes - Zavertailo Iuliia
Test Metrics in Agile - powerful tool to support changes - Zavertailo IuliiaTest Metrics in Agile - powerful tool to support changes - Zavertailo Iuliia
Test Metrics in Agile - powerful tool to support changes - Zavertailo Iuliia
 
“ЕРАМ у Південному регіоні та можливості розвитку для QA спеціалістів” Online...
“ЕРАМ у Південному регіоні та можливості розвитку для QA спеціалістів” Online...“ЕРАМ у Південному регіоні та можливості розвитку для QA спеціалістів” Online...
“ЕРАМ у Південному регіоні та можливості розвитку для QA спеціалістів” Online...
 
Achieve Performance Testing Excellence for Your SAP Apps
Achieve Performance Testing Excellence for Your SAP AppsAchieve Performance Testing Excellence for Your SAP Apps
Achieve Performance Testing Excellence for Your SAP Apps
 
Agile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged ApplicationsAgile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged Applications
 
How Developers and Quality Engineer Collaborate at Salesforce
How Developers and Quality Engineer Collaborate at SalesforceHow Developers and Quality Engineer Collaborate at Salesforce
How Developers and Quality Engineer Collaborate at Salesforce
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
 
Insurance for your Assurance Team
Insurance for your Assurance TeamInsurance for your Assurance Team
Insurance for your Assurance Team
 
Test Metrics in Agile: A Powerful Tool to Demonstrate Value
Test Metrics in Agile: A Powerful Tool to Demonstrate ValueTest Metrics in Agile: A Powerful Tool to Demonstrate Value
Test Metrics in Agile: A Powerful Tool to Demonstrate Value
 
DevOps as-a-Service (DaaS) value
DevOps as-a-Service (DaaS) valueDevOps as-a-Service (DaaS) value
DevOps as-a-Service (DaaS) value
 
DevOps 2017 Conf: evolving from automated to continuous
DevOps 2017 Conf: evolving from automated to continuousDevOps 2017 Conf: evolving from automated to continuous
DevOps 2017 Conf: evolving from automated to continuous
 
Test Automation is for Everyone
Test Automation is for EveryoneTest Automation is for Everyone
Test Automation is for Everyone
 
Webinar: DevOps challenges facing QA
Webinar: DevOps challenges facing QAWebinar: DevOps challenges facing QA
Webinar: DevOps challenges facing QA
 
How Verizon Uses Automation to Accelerate SAP Projects
How Verizon Uses Automation to Accelerate SAP ProjectsHow Verizon Uses Automation to Accelerate SAP Projects
How Verizon Uses Automation to Accelerate SAP Projects
 
Automate Salesforce Releases with DevOps: Crawl, Walk, Run!
Automate Salesforce Releases with DevOps: Crawl, Walk, Run!Automate Salesforce Releases with DevOps: Crawl, Walk, Run!
Automate Salesforce Releases with DevOps: Crawl, Walk, Run!
 
How to implement DevOps in your Organization
How to implement DevOps in your OrganizationHow to implement DevOps in your Organization
How to implement DevOps in your Organization
 
Dev ops
Dev opsDev ops
Dev ops
 

Similar to Continuous Testing of Cloud Applications

5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation
Sauce Labs
 
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Emtec Inc.
 
No Devops Without Continuous Testing
No Devops Without Continuous TestingNo Devops Without Continuous Testing
No Devops Without Continuous Testing
Parasoft
 
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
RapidValue
 
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-54&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
hemasubbu08
 
Dev ops for mainframe innovate session 2402
Dev ops for mainframe innovate session 2402Dev ops for mainframe innovate session 2402
Dev ops for mainframe innovate session 2402Rosalind Radcliffe
 
An Essential Guide to Effective Test Automation Leveraging Open Source
An Essential Guide to Effective Test Automation Leveraging Open SourceAn Essential Guide to Effective Test Automation Leveraging Open Source
An Essential Guide to Effective Test Automation Leveraging Open Source
RapidValue
 
Top Regression Testing Tools_ A Comprehensive Overview for 2024.pdf
Top Regression Testing Tools_ A Comprehensive Overview for 2024.pdfTop Regression Testing Tools_ A Comprehensive Overview for 2024.pdf
Top Regression Testing Tools_ A Comprehensive Overview for 2024.pdf
kalichargn70th171
 
Listen to Your Machines: DevOps Analytics for Better Feedback Loops
Listen to Your Machines: DevOps Analytics for Better Feedback LoopsListen to Your Machines: DevOps Analytics for Better Feedback Loops
Listen to Your Machines: DevOps Analytics for Better Feedback Loops
Splunk
 
QA Role in Agile Teams
QA Role in Agile Teams QA Role in Agile Teams
QA Role in Agile Teams
Synerzip
 
Neev QA Offering
Neev QA OfferingNeev QA Offering
Neev QA Offering
Neev Technologies
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks
Ulf Mattsson
 
The QA/Testing Process
The QA/Testing ProcessThe QA/Testing Process
The QA/Testing Process
Synerzip
 
Agile Testing 2020
Agile Testing 2020Agile Testing 2020
Agile Testing 2020
arzu TR
 
Dev ops assessment deck
Dev ops assessment deck Dev ops assessment deck
Dev ops assessment deck
Augusta HiTech
 
DevOps Roadshow - removing barriers between development and operations
DevOps Roadshow - removing barriers between development and operationsDevOps Roadshow - removing barriers between development and operations
DevOps Roadshow - removing barriers between development and operations
Microsoft Developer Norway
 
Functional and Non-functional Test automation
Functional and Non-functional Test automationFunctional and Non-functional Test automation
Functional and Non-functional Test automation
Dr Ganesh Iyer
 
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity Software Ireland
 
Software Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experienceSoftware Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experiencevijaya lakshmi
 

Similar to Continuous Testing of Cloud Applications (20)

5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation
 
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
 
No Devops Without Continuous Testing
No Devops Without Continuous TestingNo Devops Without Continuous Testing
No Devops Without Continuous Testing
 
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...
 
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-54&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
 
Dev ops for mainframe innovate session 2402
Dev ops for mainframe innovate session 2402Dev ops for mainframe innovate session 2402
Dev ops for mainframe innovate session 2402
 
An Essential Guide to Effective Test Automation Leveraging Open Source
An Essential Guide to Effective Test Automation Leveraging Open SourceAn Essential Guide to Effective Test Automation Leveraging Open Source
An Essential Guide to Effective Test Automation Leveraging Open Source
 
Top Regression Testing Tools_ A Comprehensive Overview for 2024.pdf
Top Regression Testing Tools_ A Comprehensive Overview for 2024.pdfTop Regression Testing Tools_ A Comprehensive Overview for 2024.pdf
Top Regression Testing Tools_ A Comprehensive Overview for 2024.pdf
 
Listen to Your Machines: DevOps Analytics for Better Feedback Loops
Listen to Your Machines: DevOps Analytics for Better Feedback LoopsListen to Your Machines: DevOps Analytics for Better Feedback Loops
Listen to Your Machines: DevOps Analytics for Better Feedback Loops
 
QA Role in Agile Teams
QA Role in Agile Teams QA Role in Agile Teams
QA Role in Agile Teams
 
Neev QA Offering
Neev QA OfferingNeev QA Offering
Neev QA Offering
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks
 
The QA/Testing Process
The QA/Testing ProcessThe QA/Testing Process
The QA/Testing Process
 
Agile Testing 2020
Agile Testing 2020Agile Testing 2020
Agile Testing 2020
 
Dev ops assessment deck
Dev ops assessment deck Dev ops assessment deck
Dev ops assessment deck
 
DevOps Roadshow - removing barriers between development and operations
DevOps Roadshow - removing barriers between development and operationsDevOps Roadshow - removing barriers between development and operations
DevOps Roadshow - removing barriers between development and operations
 
Walter_resume_PTM
Walter_resume_PTMWalter_resume_PTM
Walter_resume_PTM
 
Functional and Non-functional Test automation
Functional and Non-functional Test automationFunctional and Non-functional Test automation
Functional and Non-functional Test automation
 
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
 
Software Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experienceSoftware Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experience
 

More from TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
TechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
TechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
Ma 15Ma 15
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
TechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
TechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 

More from TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Recently uploaded

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 
Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...
Globus
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
Globus
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
AMB-Review
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
De mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FMEDe mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FME
Jelle | Nordend
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
vrstrong314
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
Ortus Solutions, Corp
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Globus
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus
 
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
Hivelance Technology
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
XfilesPro
 
Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024
Paco van Beckhoven
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with Platformless
WSO2
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
Globus
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
Ortus Solutions, Corp
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Globus
 
Using IESVE for Room Loads Analysis - Australia & New Zealand
Using IESVE for Room Loads Analysis - Australia & New ZealandUsing IESVE for Room Loads Analysis - Australia & New Zealand
Using IESVE for Room Loads Analysis - Australia & New Zealand
IES VE
 

Recently uploaded (20)

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...Developing Distributed High-performance Computing Capabilities of an Open Sci...
Developing Distributed High-performance Computing Capabilities of an Open Sci...
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
De mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FMEDe mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FME
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
 
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
 
Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with Platformless
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
 
Using IESVE for Room Loads Analysis - Australia & New Zealand
Using IESVE for Room Loads Analysis - Australia & New ZealandUsing IESVE for Room Loads Analysis - Australia & New Zealand
Using IESVE for Room Loads Analysis - Australia & New Zealand
 

Continuous Testing of Cloud Applications

  • 1.                 T22   Cloud  Testing   5/11/17  15:00             Continuous  Testing  of  Cloud   Applications     Presented  by:         Ganesh  Iyer     Progress  Software  Development     Brought  to  you  by:                 350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073     888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  info@techwell.com  -­‐  http://www.starwest.techwell.com/      
  • 2.         Ganesh  Iyer     Ganesh  Iyer  -­‐  QA  architect,  technology  evangelist,  researcher,  professor,  blogger,   photographer,  and  dancer  -­‐  is  a  QA  architect  with  Progress  Software  Development.   He  is  involved  in  several  key  QA  initiatives  including  cloud  test  architecture,  24/7   test  automation  framework,  web  automation  framework  using  Selenium  and   TypeScript,  and  a  high-­‐availability  test  framework  with  tests  in  long  running  mode.   A  visiting  faculty  member  at  IIIT-­‐Hyderabad,  Ganesh  has  authored  book  chapters   and  journal  articles,  and  presented  talks  and  workshops  on  various  technologies  in   international  settings.    
  • 3. Continuous Testing Dr Ganesh Neelakanta Iyer QA Architect GANESHNIYER gaiyer@progress.com http://ganeshniyer.com
  • 4. About Me §  12+ years of Research and Development experience §  Masters and Ph.D. from National University of Singapore §  Several talks/workshops in India, USA, Europe and Australia §  Personal Interests: Kathakali, Teaching, Traveling §  Website: http://ganeshniyer.com GANESHNIYER §  Current: •  Technical Support Manager (Asia Pacific) at Progress Software, India •  Visiting Faculty at IIIT-H (A premier academic institution in India) •  Technology/Product Evangelist §  Past: •  Software Developer •  QA Architect
  • 5. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.3 Quick Poll
  • 6. Are you using Version Control? Safe?
  • 7. Can you release new version of your software in one day? Quick
  • 8. Can you release new, well- tested version of your software in one day? Quick & Safe?
  • 9. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.7 Agenda §  Software Development today §  Continuous Integration and Continuous Testing §  24x7 Testing
  • 10. What are top changes in Software development that were disruptive for existing test methodologies?
  • 11. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.9
  • 12. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.10 Agile Credit: Blazemeter; Continuous Testing in Practice
  • 13. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.11
  • 14. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.12 Test Challenges with Agile Methodology Frequently changing requirements • Thanks to Agile à Changes can happen at any point of time during release cycle • Requirements and Test Cases developed in parallel or test first strategy Frequent releases • Progress Rollbase released new features every 9 days in 2016 • Testing needs to happen Early and Often, Everyone needs to Test Understanding and testing real world behavior • How customers see the product behavior after a release? • No SRS-level waterfall documents to drive testing plan Multiple environments & differences for test and production systems • 3rd party systems integrated to the product • Raises a requirement for GoLive Testing à But in minimal time
  • 15. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.13 Software Test Challenges With Cloud §  Web-driven SaaS applications §  Everything in a few mouse clicks §  Frequent releases / Frequent changes §  No SRS documents §  Publically shared resources §  Multi-tenant penetration testing Paradigm Shift §  High Availability and Resiliency are key §  Seamless upgrades Everything is Agile Availability Everything is shared
  • 16. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.14 Continuous Integration & Automation are Key in Agile Automation •  Nightly / Weekly Build Integration •  Combination of unit tests and regression tests Dev- environment •  Unit-tested
  • 17. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.15 Continuous Integration and Continuous Testing
  • 18. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.16 Dev/Test à Expectations continue to increase Better – Cheaper - Faster Past • Balance between speed, cost and risk Today • Demand for releasing high quality software faster Credit: IBM article on Continuous Testing
  • 19. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.17 Applications are becoming more complex to test §  Setting up complex environments §  Delays caused by lack of system availability §  Third party services can be costly §  Testers spend more time setting up tests than testing Testing teams spend on setting up test environments, instead of testing 30-50% average time Credit: IBM article on Continuous Testing
  • 20. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.18 Continuous Integration and continuous testing Accelerate software delivery – for faster time to value Balance speed, cost, quality and risk – for increased capacity to innovate Reduce time to customer feedback – for improved customer experience PC Credit: https://https://goo.gl/A2AaQw
  • 21. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.19 Shift left, test early, test often
  • 22. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.20 The Testing Process – From Development to Operations Credit: Blazemeter; Continuous Testing in Practice
  • 23. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.21 Continuous Testing in Practice – Requirements Checklist Tools, Scripting and Overall Test Creation •  The provision of libraries and APIs to create “homegrown” tests •  The ability to create browser-based tests •  Ability for load and scalability testing Provisioning and Resources •  The option to run the same sets of tests with different provisioning •  The ability to easily adopt a new provisioning scheme when a test configuration is executed in a different environment (e.g. Dev, CI, Pre-Prod, Post-Prod) •  The ability to start testing as part of the CI process Automation •  The ability to run any test configuration, a test, or a set of tests using simple API calls •  The option to run as many tests as required in parallel On-Demand Testing and Re-Running Failed Use Cases •  The ability to run any type of test on-demand. This is critical for test development, debugging, troubleshooting and identifying the root cause of a failure •  The option to automate test executions and run the same test on- demand Credit: Blazemeter; Continuous Testing in Practice
  • 24. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.22 Continuous Testing in Practice – Requirements Checklist Modules, Builds, Release Candidates, Releases and Production •  The ability to combine different configuration fragments into one test configuration in order to comprehensively test build, release, and production snapshots. Version Control Friendly Incremental Testing •  The ability to support version control, incremental testing and associate test configurations, sets of tests, and tests with versions (e.g code, build, RC, releases). Automatic ‘Failure’ Alerts •  Automatic indications of failures, with an alerting scheme per developer, module and project •  The ability to gather all test artifacts and immediately send to relevant people •  The option to run the failed tests again to identify the root cause Reporting •  A seamless integration with existing reporting solutions (e.g. Jenkins Performance Trend) •  The option to group tests by builds •  The ability to give jobs a ‘pass’ or ‘fail’ status and group accordingly •  Pass/fail trend reports Credit: Blazemeter; Continuous Testing in Practice
  • 25. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.23 24x7 Testing; A Case study of what we do at Progress
  • 26. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.24 24 x 7 Testing Understanding and testing real world behavior What is 24x7? •  Running a set of test cases continuously 24 x 7 •  Simulates real time customer behavior How 24x7? •  A few parallel threads accessing the product •  Tests consisting of regression (or it’s subset) tests Why 24 x 7? •  Many things can’t be caught by regular functional testing •  Error handling and retries •  Product can be made more resilient and robust
  • 27. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.25 24 x 7 Testing VMs / Build Integration Machines ANT ScriptTests Reports using Kendo UI controls Decides parallelism HTTP POST reqBatch Script Decides frequency Logs SUT • Progress products such as Rollbase • Uses any test environments • Existing test cases can be leveraged Batch Script • Decides the frequency • E.g. run on an hourly basis • Run in an infinite loop 24x7 ANT Script • We configure #Threads, #Tests to run in parallel • Tests can run on VMs / Build integration machines Reports • Shown using Keno UI controls / widgets • Driver scripts sends results to the portal • Machine stores the logs
  • 28. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.26 Case Study - Example §  Cloud platform that let you build SaaS- based business apps in days/hours §  Responsive UI with built-in themes §  Typical apps customers build •  CRM •  Employee Management •  Bug Tracking System What could be some typical tests for this platform?
  • 29. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.27 Case study - Identifying tests; Example §  100 parallel treads •  50 of them access “Bug Tracking System” application •  50 of them access “CRM Application” §  Use cases 1.  Create a bug and assign it to a user which will run an email trigger and related record trigger – 10 users 2.  Update the workflow status of some existing bug which will run a trigger – 20 users 3.  Filter operation on bug object – 20 users 4.  Create a lead from CRM portal and attach the lead to an account – 20 users 5.  Look for all leads whose workflow status is “Open - Not Contacted” – 10 users 6.  Create a new opportunity, assign it to an owner and attach it to an account – 10 users 7.  Change the workflow status of an existing opportunity to “Closed-won” – 10 users Tests should not be self-cleaning Why?
  • 30. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.28 Layout of the infrastructure BATCH script •  Checkout latest test scripts •  Compile and run them ANT script •  Properties file containing the details of test agents •  Invoke scripts in the agent machine Central Machine Test Agent 1 Test Agent 2 … Test Agent n
  • 31. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.29 Central Server
  • 32. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.30 Central Server – Build.properties
  • 33. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.31 Central Server – <Product name>.properties testtype=Telerik testlist="Psexec.exe 172.29.36.205 -u Administrator -p Progress!2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.207 -u Administrator -p Progress!2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.208 -u Administrator -p Progress!2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.209 -u Administrator -p Progress!2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.215 -u Administrator -p Progress!2009 -i 2 -w c:Telerik c:Telerik telerik.bat";"Psexec.exe 172.29.36.90 -u Administrator -p Progress!2009 -i 2 -w c: Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.227 -u Administrator -p Progress! 2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.231 -u Administrator -p Progress!2009 -i 2 -w c:Telerik c:Teleriktelerik.bat";"Psexec.exe 172.29.36.229 -u Administrator -p Progress!2009 -i 2 -w c:Telerik c:Telerik telerik.bat";"Psexec.exe 172.29.36.233 -u Administrator -p Progress!2009 -i 2 -w c: Telerik c:Teleriktelerik.bat"
  • 34. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.32 24 x 7 Testing – Sample report
  • 35. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.33 Key Advantages of 24x7 testing §  Catch issues which are difficult to catch using normal functional testing §  Make products resilient and robust §  Catch unexpected integration issues §  Test real time customer behavior
  • 36. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.34 Catch issues which are difficult to catch using normal functional testing https://cdn.tutsplus.com/wp/uploads/2013/12/session-diagram.jpg http://biobeasts.artix.com/content/images/2015/07/memory-leak.jpg
  • 37. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.35 Make products resilient and robust
  • 38. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.36 Catch unexpected integration issues
  • 39. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.37 Test real time customer behavior http://blog.perfectomobile.com/wp-content/uploads/2015/10/WINDTUNNELGRAPHIC.jpg
  • 40. © 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.38 Advantages of continuous Testing Helping to make software development faster •  Continuous testing can make it possible to making software available sooner without compromising quality Reduced Risk •  Every time a change is made to code or new code is written, there is the potential for error to occur. Identifying the problem is much easier when continuous testing is performed and the issue is caught immediately so problems can be corrected. Making consistency simpler •  Automation of testing makes it easier to achieve consistency by providing a carefully configured environment and maintaining the same correct configuration for all relevant tests Faster releases •  The process of regularly using continuous testing means that cleaner code can be released to end users in a timely manner https://www.etesting.com/2014/02/25/benefits-of-continuous-testing/
  • 41. Are you ready to implement Continuous Testing in your organization?