Virtualization to Improve Speed and Increase Quality

T20
Test Techniques
5/7/2015 3:00:00 PM
Virtualization to Improve Speed
and Increase Quality
Presented by:
Clint Sprauve
HP
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com

Clint Sprauve
HP
Clint Sprauve is the senior product marketing manager for HP Software Functional Testing.
Previously, Clint was the director of product strategy for the Borland Solutions division of Micro
Focus, where he created Borland’s mobile strategy for functional test automation. With more
than twenty years of experience in the software development and quality assurance industry,
Clint has served as the senior product marketing manager for the Silk Testing Solutions at
Borland Software and Segue Software, and as a senior technical sales engineer for both
companies. He has been an independent consultant, specializing in test management and test
automation.

4/30/2015
1
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Virtualization
Improve Speed &
Increase Quality
Clint Sprauve – Product Marketing Manager, Functional Testing
Todd DeCapua – Thought Leadership, Service & Network Virtualization
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2
Agenda
Welcome!
- The IT world we live in today
- The Lifecycle Virtualization Story
- Network and Services
- A real customer case-study
- Q+A

4/30/2015
2
The IT world we live in
today
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4
It’s a mobile world
+
without
compromising
time to market
that actually
scale and perform
and truly leverage
the power of big data
+
Test Across Multiple Devices Deliver Beautiful Experiences Accelerate Application Delivery7 000 000 000 mobile subscriptions WW (2014)
40 000 000 000+app downloads on Apple alone
$1.3T Mobile technology spend by 2015 (35% of the technology economy)

4/30/2015
3
Essential evolution
High quality application performance is essential to success
Poorly performing applications and
software updates that anger and
alienate are not an option.
It’s time for an aggressive approach.
Virtualization of users, services,
and networks to create realistic test
conditions, and accurate results.
D.I.Y.
TESTING
FREEWAR
E
SIMULATIO
N
HP SERVICE AND NETWORK
VIRTUALIZATION
Networks
A constantly challenging course
Many challenges impede the delivery of high-quality and stable
applications
Services
Agile
Data center
moves
Composite
apps
ERP
Security
Cloud
E2E
testing
Mobile

4/30/2015
4
The cost of poor app performance
Your business can perform no better than its applications
Lost revenue
Lost brand
reputation
Lost
customer
s
Lost
competitive
advantage
61%
of users are unlikely to return to a
site if they’d had trouble viewing it
on a mobile device
70%
of mobile transaction
response time stems
from the network
37%
of consumers will
shop elsewhere if a
mobile site or app
fails to load in 3
secs.
1 sec.
Is how long mobile
devices have to respond to
user input, in order to keep
the user engaged.
Poor performance drives
customers away:
© Copyright 2014 Hewlett-Packard Development Company, L.P.
The information contained herein is subject to change without notice.
The essentials for high-quality apps
Lifecycle Virtualization – a solution offering only available from HP
User
Virtualize users and transactions to
execute as real world users would
exercise the systems
Service
Virtualize infrastructure and
service interactions to simulate
E2E business processes
Data
Virtualize production
data and transaction
responses to emulate
application request
and responses
Network
Virtualize network
conditions to emulate
production architecture and
real user conditions

4/30/2015
5
The new style of IT
Problems lie on both sides of the application delivery lifecycle
* Source: “The Data Explosion in 2014 Minute-by-Minute” by ACI Information Group.
http://aci.info/2014/07/12/the-data-explosion-in-2014-minute-by-minute-infographic/
MODERN APPLICATION DEVELOPMENT
Applications not releasing quickly
enough
Low quality releases
DELIVER
Y
Deliver amazing user experiences
Reduce costs
Increase customer attraction/retention
Increase the value of your brand
Get to market faster
The new style of IT
Mega-trends create demands on modern applications
A data explosion in 2015
* Source: “Enterprise Mobile Facts You Need to Know in 2015” by App Data Room.
http://appdataroom.com/enterprise-mobile-facts-need-know-2015/
Mobile
Cloud
45%
of mobile enterprise app initiatives
will be delayed or go over budget
due to infrastructure difficulties
25%
IT software budget dedicated to
mobile app development,
deployment and management
by 2017
35%
of large enterprises will use
mobile app development platforms
1 in 5
of these will be specifically
for enterprise use
381 million tablets
will be sold worldwide
Dev
Ops
Agile

4/30/2015
6
The new style of IT
Many challenges impede the delivery of high-quality applications
Networks
Data center
moves
ERP
E2E testing
Agile
Composite apps
Security Services
Lost brandLost brand
reputationreputation
Lost customersLost customers
Lost revenueLost revenue
Lost competitiveLost competitive
advantageadvantage
Reduce costs
Increase customer attraction/retention
Increase the value of your brand
Get to market faster
Complicated,
unavailable
or expensive testing
Deliver amazing user experiences
Poor quality
release
Poor
performance
Delayed release
schedule
Hitting the roadblocks
Constraints plague application development and testing
Third Party
Services
Mobile
Customer
Corp.
Customer
Mobile
Employee
HQ
Employe
e
Mobile
Partner
Remote Site
EmployeeUser & UI
Enterprise Mobile Reporting Website Warehouse Partner
Application
& Services
SOAP AdapterMQ Adapter SOAP
Adapter
RFC /
IDOC
Adapter
Enterprise
Service Bus
&
Integration
Mobile
Components
Mainframe
Distributed
Services
ERP
(SAP, Peoplesoft, etc.)
Systems &
Backend
APPLICATION
LAYER:
Too
Costly
Not
Available
Not
Available
Too
Costly
Not
Available
How?
Limited
How?
How?
How?
Limited

4/30/2015
7
The lifecycle
virtualization story
Essentials of Lifecycle Virtualization
The four foundations of virtualization
Data
Virtualize production data and
transaction responses to emulate
application request and
responses
Network
Virtualize network conditions
to emulate production
architecture and real user
conditions
DEV TEST OPS
MODERN APPLICATION
DEVELOPMENT
User
Virtualize users and
transactions to execute as real
world users would exercise the
systems
Service
Virtualize infrastructure and
service interactions to simulate
E2E business processes

4/30/2015
8
Without virtualization, testing is incomplete
Reality is rarely local. Why should your test be?
DATA CENTER
Local Virtual
Users
• Load generators
• Local switch
Application
under test
Hi-Speed
LAN
Hi-Speed
WiFiTablets
Smartphones
LOCAL TEST ENVIRONMENT
Branch office
Residential
Mobile
anywhere
Road warrior
Mobile
workforce
SITES
DEVICES
FIRE
WAL
L
NETWOR
K
APPS
Business
systems
Online
B2C
Mobile
Corporate
Mobile
Consume
r
Mobile
Consume
r
Service Virtualization (SV)
Composite applications need virtualized services
SERVICE
VIRTUALIZATION
WORLD-CLASS
APPLICATION
services can support a single composite
application.
With HP Virtualization software, virtual services
can be created to replace these targeted
services.
38
Up to

4/30/2015
9
SERVICE
VIRTUALIZATION
WORLD-CLASS
APPLICATION
Service Virtualization (SV)
Composite applications need virtualized services
Developers and testers can perform functional
or performance testing even when:
• Real services are not available
• Data access is restricted
• Data is difficult to attain
• Services are not suitable for the particular test
Service Virtualization: The Impact
The cost of not using virtualized services
Delayed or lack of real
quality and performance
testing
Delayed production
waiting for access to
services
Delayed development
Delayed delivery times
Expensive test
hardware
and back-end systems

4/30/2015
10
Network Virtualization (NV)
WORLD-CLASS
APPLICATION
NETWORK
VIRTUALIZATION
of mobile transaction response time is
spent on the network.
NV recreates mobile, cloud, internet and
corporate network conditions, in order to
test applications under real world network
conditions.
70%
Network Virtualization: The Impact
What happens when you don’t take the network into account
No visibility into the performance that your users will
get
Failure in transactions under
actual mobile network
conditions
1.2 1.3
4.3
1
12.2
5.2 7.4
2
22.3
19.2
27.4
2.3
39.2 37
59
2.8
0
10
20
30
40
50
60
70
Launch App Log In View Account Sign Out
Local User (No NV)
WiFi (Remote
Branch)
4G
3G
NV can reveal as much as a 10x difference in
response time under mobile conditions
Customer dissatisfaction
Brand damage

4/30/2015
11
Network Virtualization goes beyond the test
Discovery and capture
Identify and record real-world
network performance
conditions
Virtualization and test
Virtualize production network
conditions to accurately emulate
and test app performance
Analysis and Optimization
Analyze test results and
implement optimization strategies
to improve performance
Lifecycle Virtualization has a role everywhere
The four essential components are involved across the entire app
architecture
Mainframe
Storage
DB
servers
Web services
App
servers
Web
servers
Load
balancers
Mobile components
Major
ISP
3rd party
cloud services
Content
delivery
networks
Mobile
carriers &
ISPsBrowsers
& devices
Customers
Distributed
services
Employee
s
User Virtualization
UV
UV
UV
Service Virtualization
SV
SV
SV SV SV
SV
SV
SV
Network Virtualization
NV
NV
NV
NV
NV
NV
NV
NV
NV
NV
NV
NV
NV
NV
Data Virtualization
DV
DVDV
DV
DV
DV
DV
DV
DV
DV

4/30/2015
12
Lifecycle Virtualization Benefits are everywhere
Helping the product and the players
Development
Test
Operations
Business
Enterprise
System
Architects
IT Security
• Functional
• Performance
• Security
User
• Infrastructure
• Service
• 3rd party component
Service
• Discovery & capture
• Emulate & test
• Analysis &
Optimization
Network
Faster time to market
Higher quality
Applications that delight
Increased brand value
WHO? ROLES WHAT? VIRTUALIZATION &
CAPABILITY
HOW? IMPACT
• Front end
• In motion
• Back end
Data
Wait for SAP
availibility
Coordinate
remote LG for
the test
Pilot release
modules 1 and
2
Field test
Lifecycle Virtualization delivers velocity
Accelerating the process
Dev Module 1
Dev Module 2
Test 1 / 2 Perf Test 1 / 2 Release
Wait for Module 1 to be
complete
Wait for Module 1 and 2
to be complete
A typical application delivery schedule involves a lot of delays
using Module 1 virtual svcs
with
real world conditions
Monitor User
Experience
Virtualization enables faster releases and
higher quality

4/30/2015
13
Lifecycle Virtualization Results
Client results are unbeatable
400+%
ROI
50%
reduction in application
transaction response time
10X
improvements in mobile
transaction times
90
50-90%
reduction in wait time
5X
decreased effort to test
Less than
30%
faster application delivery
45%
increase in test coverage
and cycles in same time
EFFICIENCYPERFORMANCE VALUE
day break even
60%
cost savings due to
faster simulation of
services
LV Customers are Everywhere
Successes span industries and use cases
Successes:
Cost Savings: Reduction and avoidance
Improved Brand Equity
Improved services offerings
Increased revenue
Gov’t / Public Sector
Financial Services
Healthcare
Higher Education
Power and Energy
Increased performance
Predictive analysis – performance incidents
Realistic testing – network conditions
Reduced delays - server, performance, network, test
Retail
Telcomm
Full end-to-end Testing
Enterprise Systems
(e.g.: SAP, Oracle, SFDC, PPLSFT, etc)
Remote site Operations
Ecommerce
and POS
Systems
Data Center
Consolidation/Relocation
Performance CoE /
Performance Incident
Management Process
Release Automation /
Management and DevOps

4/30/2015
14
SV+NV= A complete solution
All the information you need for truly accurate app testing and more
Lost revenue
Lost brand
reputation
Lost
customer
s
Lost
competitive
advantage
Increased
revenue
Strong
brand
reputation
More
customers
Industry
leader
Avoiding the pitfalls of
poor performance .
and instead,
capitalizing on the new
style of IT
Customer Case-Study

4/30/2015
15
A Retailer Real-Life Scenario
Tracking the course
Custome
r login
Add to
cart
Checkou
t
Shipping
detail
Delivery
tracking
Shopping app
(web or mobile)
Purchas
e
received
A typical online purchase has
predictable landmarks in its
processBut the road from beginning to
end is hardly a direct route
QUIT SCENARIO
Tracking the course
Shopping app
(web or mobile)
Database
activity
Security
validation
Inventory
query
Database
activity
3rd party
ship
service
Logistical
services
Acc’t
info
3rd party
database
3rd party
reporting
Purchas
e
received
Add to
cart
Shipping
detail
Delivery
tracking
Custome
r login
Security
validation
3rd party
payment services
Account
authorization
Checkou
t
But the road from beginning to
end is hardly a direct route
QUIT SCENARIO

4/30/2015
16
Database
activity
Security
validation
Inventory
query
Database
activity
3rd party
ship
service
Logistical
services
Acc’t
info
3rd party
database
3rd party
reporting
Security
validation
3rd party
payment services
Account
authorization
Shopping app
(web or mobile)
Purchas
e
received
Add to
cart
Shipping
detail
Delivery
tracking
Custome
r login
Checkou
t
Use cases raise numerous questions at every step
Mobile
Performance
Functional
DevOps
Security
Development
How does it look
on the screen?
Is it secure?
What’s happening
with CPU / MEM?
OS’s?
Browsers
?
What
devices?
Do I have
the right
transactions?
Where are my
users coming
from?
What
network
connection?
What
happens
offline or
unavailable
?
Was the
experience within
brand?
USE CASE:
QUIT SCENARIO
Mobile
Performance
USE CASE:
Database
activity
Security
validation
Inventory
query
Database
activity
3rd party
ship
service
Logistical
services
Acc’t
info
3rd party
database
3rd party
reporting
Security
validation
3rd party
payment services
Account
authorization
Shopping app
(web or mobile)
Purchas
e
received
Add to
cart
Shipping
detail
Delivery
tracking
Custome
r login
Checkou
t
User types?
(mobile, web, other)
Scenarios
and
transactions
?
Geographies of
users?
Type of network
connections?
Production load
vs. test load?
Environment scale? How
about waiting for
environment?
Services
availability
and cost?
Does it meet future
needs? How much
capacity?
Is it secure
under load?
Open
sessions?
Functional
DevOps
Security
Development
QUIT SCENARIO

4/30/2015
17
Database
activity
Security
validation
Inventory
query
Database
activity
3rd party
ship
service
Logistical
services
Acc’t
info
3rd party
database
3rd party
reporting
Security
validation
3rd party
payment services
Account
authorization
Shopping app
(web or mobile)
Purchas
e
received
Add to
cart
Shipping
detail
Delivery
tracking
Custome
r login
Checkou
t
Geographies of
users?
Flows?
User types?
(mobile, web, other)
Services availability
and cost?
Single vs.
Multiple?
Type of
network
connections?
Environment
availability?
Is it secure?
Does it
function?
Functional
Development
USE CASE:
Performance
DevOps
Security
Mobile
QUIT SCENARIO
Database
activity
Security
validation
Inventory
query
Database
activity
3rd party
ship
service
Logistical
services
Acc’t
info
3rd party
database
3rd party
reporting
Security
validation
3rd party
payment services
Account
authorization
Shopping app
(web or mobile)
Purchas
e
received
Add to
cart
Shipping
detail
Delivery
tracking
Custome
r login
Checkou
t
DevOps
USE CASE:
How many
versions to
support?
Release
rollback
test pass?
Operations break/fix
environment for
Prod incidents?
Capacity
for
login?
Data center config?
(on premises, hybrid, cloud, live
live)
System
and
component
resiliency?
Integrations:
secure, tested,
working?
What are we monitoring for
KPI’s
in Prod and Pre-Prod?
What if 3rd party
dependency fails?
Performance
Functional
Security
Development
Mobile
QUIT SCENARIO

4/30/2015
18
Database
activity
Security
validation
Inventory
query
Database
activity
3rd party
ship
service
Logistical
services
Acc’t
info
3rd party
database
3rd party
reporting
Security
validation
3rd party
payment services
Account
authorization
Shopping app
(web or mobile)
Purchas
e
received
Add to
cart
Shipping
detail
Delivery
tracking
Custome
r login
Checkou
t
End-to-end
performance and user
experience:
Too much security?
Regulatory:
Legal, 3rd party,
audit, other
security?
Data security:
Front, Motion,
Back
What if “authorization”
is compromised?
Impact from
network on
Security: XSS,
SQL Injection?
X Factor
authentication?
Internal
security
risks?Risks from
BYOD,
browsers,
etc?
Intrusion
detection?
Security
Performance
Functional
DevOps
Development
Mobile
USE CASE:
QUIT SCENARIO
Development
Database
activity
Security
validation
Inventory
query
Database
activity
3rd party
ship
service
Logistical
services
Acc’t
info
3rd party
database
3rd party
reporting
Security
validation
3rd party
payment services
Account
authorization
Shopping app
(web or mobile)
Purchas
e
received
Add to
cart
Shipping
detail
Delivery
tracking
Custome
r login
Checkou
t
How are we
testing
security?
How to manage as a
service, and have
available?
Continuous Integration,
Development, Release?
How to manage as a
service, and have
available?
How does it
perform?
Development
data available?
Does it meet
Business Need
and Customer
Experience?
Target end user
device(s), interface(s),
portal(s)
Integrated
Development
Framework?
Performance
Functional
DevOps
Security
Mobile
USE CASE:
QUIT SCENARIO

4/30/2015
19
Thank you

Virtualization to Improve Speed and Increase Quality

Recommended

Recommended

More Related Content

What's hot

What's hot (19)

Viewers also liked

Viewers also liked (19)

Similar to Virtualization to Improve Speed and Increase Quality

Similar to Virtualization to Improve Speed and Increase Quality (20)

More from TechWell

More from TechWell (20)

Recently uploaded

Recently uploaded (20)

Virtualization to Improve Speed and Increase Quality