The document discusses leveraging cloud capabilities for testing in an agile environment. Some key benefits include elasticity, pay-as-you-go models, and easy setup of distributed test environments. However, challenges also exist around preserving existing investments, information sensitivity, and ensuring accurate performance measurements when testing in cloud environments. The document describes IBM's continuous testing solution and how it addresses issues such as test automation, virtualization, quality management, and performance testing both on-premises and in cloud environments.

1. Agile Testing by leveraging Cloud
Karthikeyan Dakshinamurthy (Karthi)
kdakshin@in.ibm.com
Software Architect
IBM DevOps Continuous Test products team
Confidential | Copyright © Agile Testing Alliance Global Gathering
Brought To You By
&

2. Abstract
Testing from the cloud has its obvious advantages but
also come with its own challenges. Firewalls, reliable
measurements, ability to hold onto investments that
are already made with on premises solutions, etc. IBM
has a point of view on how these could be handled and
Confidential | Copyright © Agile Testing Alliance Global Gathering
has a point of view on how these could be handled and
this session will elaborate on how testing from the
cloud could fit into our agile practices.

3. Continuous Testing enables Continuous
Delivery!
Continuous Testing:
■ helps extend agile and lean practices across the
delivery lifecycle
■ removes traditional testing bottlenecks such as
unavailable test environments to increase efficiency
Why organizations need Continuous Testing?
Accelerating the delivery of higher quality software
Confidential | Copyright © Agile Testing Alliance Global Gathering
unavailable test environments to increase efficiency
■ enables teams to test earlier and with greater
coverage at lower cost
■ provides project teams with continuous feedback
on software quality to reduce business risk
IBM’s comprehensive Continuous Testing solution
covers quality management, UI and integration testing
automation, performance testing, and service
virtualization.
Resolve today’s testing
challenges with confidence

4. IBM’s continuous testing solutionIBM’s Continuous Testing solution
Helping organizations get higher quality software to market faster
Test
Automation
Continuous
Service
Virtualization
Confidential | Copyright © Agile Testing Alliance Global Gathering
Quality
Management
Security
Continuous
Testing
Test Data
Management
Performance

5. IBM’s continuous testing solutionIBM’s Continuous Testing solution
Helping organizations get higher quality software to market faster
Test
Automation
Continuous
Service
Virtualization
IBM Rational
Test Workbench
IBM Rational
Test Workbench
IBM Rational
Test Virtualization
Server
IBM Rational
Test Virtualization
Server
IBM Rational
Performance
Test Server
IBM Rational
Performance
Test Server
IBM Rational
Quality Manager
IBM Rational
Quality Manager
Confidential | Copyright © Agile Testing Alliance Global Gathering
Quality
Management
Security
Continuous
Testing
Test Data
Management
Performance
IBM InfoSphere
Optim Test Data
Management
IBM InfoSphere
Optim Test Data
Management
IBM AppScan
Security
IBM AppScan
Security

6. IBM Continuous Deployment Solution orchestrates and automates the
deployment of applications, middleware configuration, and database
changes into development, test and production environments.
Databases Internal
Messages
Third-party
Services
virtual components
Combining continuous testing withContinuous Testing enables Continuous Delivery
Repeatable, & traceable test and deployment automation
Test Environments
IBM UrbanCode
Deploy
Deploy just built
applications
IBM continuous delivery
Orchestrate the
delivery pipeline
integrated with
Confidential | Copyright © Agile Testing Alliance Global Gathering
Simultaneously
test across
multiple test
stages
Dev QA
IBM Rational Test
Virtualization Server
IBM Rational
Test Workbench
Dynamic Infrastructure
Virtualize unavailable yet
dependent software &
systems
Continuously test in
production-like env.
IBM Rational
Quality Manager
Manage quality across the
lifecycle
Deploy private, secure
right sized test data
IBM InfoSphere
Optim Test Data Mgmt
integrated with

7. Leveraging Cloud for Testing
■ Leveraging Cloud Characteristics
▬ Elasticity
▬ Pay-as-you-go
▬ Easy to setup
▬ Distributed data centers
■ Testing as a Service
Confidential | Copyright © Agile Testing Alliance Global Gathering
■ Testing as a Service
▬ Performance
▬ Functional
▬ Integration
▬ Security

8. Challenges in Testing using Cloud
■ Preserving investments (Licenses, Hardware, Test assets)
■ OnPrem, Cloud (private/public) or even Hybrid
‒ Apps behind firewall, existing investments
■ Same tests for different kind of testing
■ Information sensitivity
Confidential | Copyright © Agile Testing Alliance Global Gathering
‒ Assets, results data on Cloud vs. OnPrem
‒ Complete SaaS vs OnPrem authoring/results
■ Accurate measurement
■ Working with Continuous Integration tools

9. Accuracy in Measurement - Control Agent Approach
Control Agent
For measurement accuracy
Load Agent
Load Agent
Load Agent
Confidential | Copyright © Agile Testing Alliance Global Gathering
Application Under Test
Control Agents forControl Agents for
accurateaccurate
MeasurementsMeasurements

10. Load Agent vs Control Agent response time comparision
Step Performance Report
Confidential | Copyright © Agile Testing Alliance Global Gathering

11. IBM Testing Solutions on Cloud
■ The cloud trial is free and available since April 2015
▬ Sign up at www.ibm.com/software/products/en/rpts
▬ Step-by-step Overview & Getting started guide at:
http://download.boulder.ibm.com/ibmdl/pub/software/dw/cloud/getting
_started_rpt_cloud_based_load_generation_service_trial.pdf
Confidential | Copyright © Agile Testing Alliance Global Gathering

12. Thank You!
atagg@agiletestingalliance.org
@AgileTA
Confidential | Copyright © Agile Testing Alliance Global Gathering
@AgileTA
https://www.facebook.com/AgileTestingAlliance
contact@unicomlearning.com
@UNICOMLearning
https://www.facebook.com/joinunicom