Welcome to the 2013

This webinar is presented by Kees Blokland and he will discuss:

‘Going Cloudy? How to test SaaS?’

J...
Going Cloudy?
How to test SaaS?
Kees Blokland
Polteq Test Services BV
The Netherlands
ISBN 978-1-937538-38-5
3
searching, recording, accounting, paying, writing, reviewing,
tracking, calculating, developing, listening, analyzing,
tra...
Develop and Test

Operate and Manage
6

Email
Surf
Transfer

Store
Develop and Test

redundancy, proliferation

limitations

Email
Surf
Transfer

80% unused

storage claim
Operate and Manag...
Develop and Test

Email
Surf
Transfer

SOA

internet technology

virtualization

standard software
Operate and Manage
8

b...
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing, listening,
Develop and Te...
Essential characteristics
 On-demand service

 Broad network access
 Resource pooling

 Rapid elasticity

Deployment m...
Standards
Cyber crime

Continuity

Privacy

Legislation

Multi platform

Impact organisation

143
Performance risks

Standards

Security risks Cyber crime
Availability and continuity Continuïty
risks
Functionality risks ...
Performance risks

Security risks

YOUR
Operational Profile

Availability and continuity
risks
Functionality risks

Other ...
Performance risks

Security risks

The idea:
“it’s safe”

Availability and continuity
risks
Functionality risks

Everythin...
Performance risks

Security risks

No free choice of
device.

Availability and continuity
risks
Functionality risks

Bring...
Performance risks

Security risks

Planned and
controlled

Availability and continuity
risks
Functionality risks

Updates,...
Performance risks

Security risks

In house.

Availability and continuity
risks
Functionality risks

Where is my data?
And...
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation ...
Testing?
Interview
Check
Trial

Proof of concept

Review

20
Testing!
Interview
Check
Trial

Proof of concept

Proef
Proof ofInterview
concept
Testen
Intake
Review

21
Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testi...
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation ...
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation ...
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation ...
Performance risks

Security risks
Availability and continuity
risks

Testing during selection
Performance testing
Security...
Testing during selection

Selection

Performance testing
Security testing

Testing for manageability

Implementation

Avai...
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation ...
Testing during selection
Performance testing

Selection Criteria

Security testing

Testing for manageability
Availability...
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation ...
Testing during selection
Performance testing

Known measures
tuned and tweaked

Security testing

Testing for manageabilit...
Testing during selection
YOUR
Operational Profile

Performance testing
Security testing

Testing for manageability

Load T...
Testing during selection
Performance testing
Load and stress.
Security testing

Testing for manageability

Elasticity

Ava...
load test – ‘up’

load test – ‘down’

101
100

boundary values

99

load

path test
extend?

no

yes
200
charged
34

100
c...
Testing during selection
Multiplatform
testing.

Performance testing
Security testing

Testing for manageability

Any devi...
3997 distinct Android devices

http://opensignal.com/reports/fragmentation.php
36
Internet Explorer 7

Windows XP

Internet Explorer 8

Windows Vista

Firefox 3.6
Windows 7

Firefox 4
Browsers

Windows 20...
Testing during selection
Performance testing
Incidental testing.
Security testing

Legislation + Regulations
=
Test basis
...
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation ...
Testing during selection

Continuous
End-to-End Test

Performance testing
Security testing

Testing for manageability
Avai...
Standards
Cyber crime

Check

Continuity

Interview
Privacy

Legislation

Proof of concept

Trial
Multi platform

Impact o...
Performance risks

Security risks
Availability and continuity
risks

Testing during selection
Performance testing
Security...
ISBN 978-1-937538-38-5
43
Thanks for listening!

Go to www.eurostarconferences.com for more information
@esconfs
#esconfs

www.eurostarconferences.c...
EuroStar Webinar Testing Cloud Services Kees Blokland
EuroStar Webinar Testing Cloud Services Kees Blokland
Upcoming SlideShare
Loading in …5
×

EuroStar Webinar Testing Cloud Services Kees Blokland

159 views
102 views

Published on

On September 17 Polteq contributed to the EuroSTAR online event ”Software Testing Summit” with a webinar about testing cloud services with title ”Going Cloudy? How to test SaaS?”

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
159
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

EuroStar Webinar Testing Cloud Services Kees Blokland

  1. 1. Welcome to the 2013 This webinar is presented by Kees Blokland and he will discuss: ‘Going Cloudy? How to test SaaS?’ Join us on Twitter! @esconfs #esconfs www.eurostarconferences.com
  2. 2. Going Cloudy? How to test SaaS? Kees Blokland Polteq Test Services BV The Netherlands
  3. 3. ISBN 978-1-937538-38-5 3
  4. 4. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, talking, designing, making, verifying, measuring
  5. 5. Develop and Test Operate and Manage 6 Email Surf Transfer Store
  6. 6. Develop and Test redundancy, proliferation limitations Email Surf Transfer 80% unused storage claim Operate and Manage 7 environmentally unfriendly Store
  7. 7. Develop and Test Email Surf Transfer SOA internet technology virtualization standard software Operate and Manage 8 bandwidth Store
  8. 8. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, Develop and Test Email Surf analyzing, transmitting, learning, controlling, Transfer purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, Operate communicating, reading, playing, working, Store mailing, and Manage meeting, gambling, shopping, storing, cross 9
  9. 9. Essential characteristics  On-demand service  Broad network access  Resource pooling  Rapid elasticity Deployment models – private cloud – community cloud – public cloud – hybrid cloud Service Models  Measured service Software as a Service Platform as a Service Infrastructure as a Service US: National Institute of Standards and Technology http://www.nist.gov
  10. 10. Standards Cyber crime Continuity Privacy Legislation Multi platform Impact organisation 143
  11. 11. Performance risks Standards Security risks Cyber crime Availability and continuity Continuïty risks Functionality risks Privacy Maintainability risks Multi platform Legislation and regulations risks Suppliers and Impact organisation outsourcing risks Legislation
  12. 12. Performance risks Security risks YOUR Operational Profile Availability and continuity risks Functionality risks Other customers Maintainability risks Legislation and regulations risks 14 Suppliers and outsourcing risks YOUR Operational Profile PLUS
  13. 13. Performance risks Security risks The idea: “it’s safe” Availability and continuity risks Functionality risks Everything over the web Maintainability risks Legislation and regulations risks 15 Suppliers and outsourcing risks Home ground for hackers
  14. 14. Performance risks Security risks No free choice of device. Availability and continuity risks Functionality risks Bring Your Own Device Maintainability risks Legislation and regulations risks 16 Suppliers and outsourcing risks No control.
  15. 15. Performance risks Security risks Planned and controlled Availability and continuity risks Functionality risks Updates, patches, fixes, … Maintainability risks Legislation and regulations risks 17 Suppliers and outsourcing risks Do I have a choice?
  16. 16. Performance risks Security risks In house. Availability and continuity risks Functionality risks Where is my data? And is that OK? Maintainability risks Legislation and regulations risks 18 Suppliers and outsourcing risks Somewhere…
  17. 17. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 19 Suppliers and outsourcing risks
  18. 18. Testing? Interview Check Trial Proof of concept Review 20
  19. 19. Testing! Interview Check Trial Proof of concept Proef Proof ofInterview concept Testen Intake Review 21
  20. 20. Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Proef Proof ofInterview concept Testen Intake Functional testing Migration testing Testing caused by legislation and regulations 22 Testing in production
  21. 21. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 23 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  22. 22. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 24 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  23. 23. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 25 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  24. 24. Performance risks Security risks Availability and continuity risks Testing during selection Performance testing Security testing Architecture for manageability Testing Functionality risks Availability and continuity testing From “individual” riskstesting Functional Maintainability risks to Migration testing Legislation and regulations “individual” test measures by Testing caused risks 26 Suppliers and outsourcing risks legislation and regulations Testing in production
  25. 25. Testing during selection Selection Performance testing Security testing Testing for manageability Implementation Availability and continuity testing Functional testing Migration testing Production 27 Testing caused by legislation and regulations Testing in production
  26. 26. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 28 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  27. 27. Testing during selection Performance testing Selection Criteria Security testing Testing for manageability Availability and continuity testing Proof of Concept Functional testing Migration testing Testing caused by legislation and regulations 29 Testing in production
  28. 28. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 30 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  29. 29. Testing during selection Performance testing Known measures tuned and tweaked Security testing Testing for manageability Availability and continuity testing Functional testing New measures developed Migration testing Testing caused by legislation and regulations 31 Testing in production
  30. 30. Testing during selection YOUR Operational Profile Performance testing Security testing Testing for manageability Load Testing Availability and continuity testing Functional testing YOUR Operational Profile PLUS ACTUAL MOMENT 32 Migration testing Testing caused by legislation and regulations Testing in production
  31. 31. Testing during selection Performance testing Load and stress. Security testing Testing for manageability Elasticity Availability and continuity testing Functional testing Migration testing Load and elasticity. 33 Testing caused by legislation and regulations Testing in production
  32. 32. load test – ‘up’ load test – ‘down’ 101 100 boundary values 99 load path test extend? no yes 200 charged 34 100 charged boundary values ‘up’ tc 1: use=99, pay 100 tc 2: use=100, pay 100 tc 3: use=101, pay 200 ‘down’ tc1: use=101, pay 200 tc2: use=100, pay 100 tc3: use=99, pay 100
  33. 33. Testing during selection Multiplatform testing. Performance testing Security testing Testing for manageability Any device – any platform Availability and continuity testing Functional testing Migration testing Multiplatform testing. 35 Testing caused by legislation and regulations Testing in production
  34. 34. 3997 distinct Android devices http://opensignal.com/reports/fragmentation.php 36
  35. 35. Internet Explorer 7 Windows XP Internet Explorer 8 Windows Vista Firefox 3.6 Windows 7 Firefox 4 Browsers Windows 2003 Server Safari 4 Safari 5 Windows 8 Chrome11 Windows CE Opera11 Linux Operating systems SUN Computer Unix Mac OS Lion Mac OS Snow Leopard PC Macintosh iPhone ... Multi-platform testing iOS Samsung … Mobile phones NOKIA … Android ASUS ... Windows Mobile Tablet Devices 37 Blackberry … MOTOROLA …
  36. 36. Testing during selection Performance testing Incidental testing. Security testing Legislation + Regulations = Test basis Testing for manageability Availability and continuity testing Functional testing Migration testing Compliancy testing. 38 Testing caused by legislation and regulations Testing in production
  37. 37. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 39 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  38. 38. Testing during selection Continuous End-to-End Test Performance testing Security testing Testing for manageability Availability and continuity testing Functionals and non-functionals 40 Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  39. 39. Standards Cyber crime Check Continuity Interview Privacy Legislation Proof of concept Trial Multi platform Impact organisation Intake
  40. 40. Performance risks Security risks Availability and continuity risks Testing during selection Performance testing Security testing Architecture for manageability Testing starts early: in selection Testing Functionality risks Availability and continuity testing From “individual”widened Scope of testing Functional testing is risks Maintainability risks to Migration testing Legislation and regulations “individual” test measuresby Testing continues in production Testing caused risks 42 Suppliers and outsourcing risks legislation and regulations Testing in production
  41. 41. ISBN 978-1-937538-38-5 43
  42. 42. Thanks for listening! Go to www.eurostarconferences.com for more information @esconfs #esconfs www.eurostarconferences.com

×