Download to read offline
Uploaded byTEST Huddle
Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
The document discusses the testing of cloud services, focusing on a risk-based approach to ensure performance, security, and compliance. It outlines essential characteristics of cloud services, different deployment and service models, and emphasizes the importance of rigorous testing throughout the selection and implementation processes. Additionally, it addresses various risks associated with cloud operations, the need for continual testing, and the complexities of managing risks in a multi-platform environment.
More Related Content
Similar to Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
- 1. Testing of CloudServices The Approach: From Risks to Test Measures Kees Blokland and Jeroen Mengerink, Polteq www.eurostarconferences.com @esconfs #esconfs
- 2. Testing of CloudServices The Approach: From Risks to Test Measures Kees Blokland Jeroen Mengerink Polteq Test Services BV The Netherlands
- 4. searching, recording, accounting,paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmi t ting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meet ing, gambl ing, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, denying, talking, designing, making, verifying, measuring
- 5. 5 Email Surf Transfer Develop and Test Operate and Manage Store
- 6. 6 Email Surf Transfer Develop and Test redundancy, proliferation limitations storage claim 80% unused environmentally unfriendly Operate and Manage Store
- 7. 7 Email Surf Transfer Develop and Test internet technology virtualization SOA standard software bandwidth Operate and Manage Store
- 8. searching, recording, accounting,paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, Develop and Test transmi t ting, learning, controlling, Email Surf purchasing, testing, alarming, changing, Transfer updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meet ing, gambl ing, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, Operate and Manage enhancing, creating, growing, Store checking in, checking out, finding out, reaching, denying, talking, 8 designing, making, verifying, measuring
- 10. Essential characteristics On-demandservice Self service provisioning, pay-per-use No human interaction US: National Institute of Standards and Technology http://www.nist.gov
- 11. Essential characteristics On-demandservice Broad network access Standard mechanisms over networks US: National Institute of Standards and Technology http://www.nist.gov “Any” client
- 12. Essential characteristics On-demandservice Broad network access Resource pooling US: National Institute of Standards and Technology http://www.nist.gov Multi-tenant Storage, processing, memory, virtual machines, … Location independent
- 13. Essential characteristics On-demandservice Broad network access Resource pooling US: National Institute of Standards and Technology http://www.nist.gov Rapid elasticity Rapid scale in and out “Any quantity” at any time
- 14. Essential characteristics On-demandservice Broad network access Resource pooling US: National Institute of Standards and Technology http://www.nist.gov Rapid elasticity Measured service Controlled resource use Transparency, pay-per-use
- 15. Essential characteristics On-demandservice Broad network access Resource pooling US: National Institute of Standards and Technology http://www.nist.gov Rapid elasticity Measured service Deployment models – private cloud – community cloud – public cloud – hybrid cloud Service Models Software as a Service Platform as a Service Infrastructure as a Service
- 16. What is “done”in the cloud? 16 >500 Private Hybride Community IaaS, PaaS, DaaS, SaaS Taas *aaS Data Centre Data Management Business processes Consumer Public SaaS Surf and mail Apps Social media Dropbox Google services Spotify Picasa Games …………… <500, SME Public *aaS Mail Storage Infrastructure CRM Finance Business processes
- 17. Continuity Privacy Multiplatform Legislation Cyber crime Impact organisation Standards 143
- 18. Performance Standards Continuïty Privacy Security Availability & Continuity Functionality Manageability Multi platform Legislation Cyber crime Legislation & Regulations Impact organisation Suppliers & Outsourcing R i s k s
- 19. 19 YOUR OperationalProfile Other customers YOUR Operational Profile PLUS Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 20. 20 The idea: “it’s safe” Everything over the web Home ground for hackers Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 21. 21 No freechoice of device. Bring Your Own Device Endless possibilities. Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 22. 22 Taken careof. Backup and recovery Who will support me? Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 23. 23 Planned and controlled Updates, patches, fixes, … Do I have a choice? Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 24. 24 In house. Where is my data? And is that OK? Somewhere… Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 25. 25 Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 26. Testing? 26 Interview Check Intake Trial Proof of concept
- 27. Testing! 27 Interview Check Intake Trial Proof of concept Proof ofI nctoenrvcieepwt Proef Intake Testen
- 28. 28 Testing duringSelection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Proof ofI nctoenrvcieepwt Proef Intake Testen
- 29. 29 Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 30. 30 Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 31. 31 Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 32. 32 Testing duringSelection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Architecture From “individual” risks to “individual” test measures
- 33. 33 Selection Implementation Production Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 34. 34 Testing duringSelection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 35. 35 Selection Criteria Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 36. 36 Proof ofConcept Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 37. 37 Testing duringSelection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 38. 38 Known measures tuned and tweaked New measures developed Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 39. 39 YOUR OperationalProfile Load Testing YOUR Operational Profile PLUS ACTUAL MOMENT Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 40. 40 Online –Offline Use case testing. Global testing. Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 41. 41 Multiplatform testing. Any device – any platform Multiplatform testing. Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 42. 42 Internet Explorer6 Internet Explorer 7 Internet Explorer 8 Firefox 3.5 Firefox 3.6 Firefox 4 Safari 4 Safari 5 Chrome11 Opera11 Windows XP Windows Vista Windows 7 Windows 2003 server Windows 8 Windows CE Linux Unix Mac OS Lion Mac OS Snowleopard iOS Android Operating Systems Browsers Multiplatform Devices Computer Mobile Tablet PC SUN Macintosh Samsung … NOKIA … Windows Mobile iPhone .. Xxx … ASUS.. Blackberry… MOTOROLA… Xxx …
- 43. 43 Multiplatform testing. Any device – any platform Multiplatform testing. Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 44. 44 Incidental testing. Legislation + Regulations = Test basis Compliancy testing. Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 45. 45 Testing duringSelection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 46. 46 Continuous End-to-EndTest Functionals and non-functionals Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 47. Continuity Privacy Interview Multi platform Legislation Cyber crime Impact organisation Standards Check Intake Trial Proof of concept
- 48. Continuity Privacy Interview Multi platform Legislation Cyber crime Impact organisation Standards Check Intake Trial Proof of concept
- 49. 49 Testing duringSelection Performance Testing Security Testing Manageability Testing Test starts earlier Availability & Continuity Testing Test scope is widened Test will never stop Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Architecture From “individual” risks to “individual” test measures
- 50. 50 Testing duringSelection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Questions?
- 51. 51 Testing duringSelection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Thank you!