Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
•
0 likes•397 views
EuroSTAR Software Testing Conference 2012 presentation on Testing Cloud Services by Blokland & Mengerink. See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/
Recommended
More Related Content
Viewers also liked
Similar to Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
Similar to Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012 (20)
More from TEST Huddle
More from TEST Huddle (20)
Recently uploaded
Recently uploaded (20)
Blokland & Mengerink - Testing Cloud Services - EuroSTAR 2012
- 1. Testing of Cloud Services The Approach: From Risks to Test Measures Kees Blokland and Jeroen Mengerink, Polteq www.eurostarconferences.com @esconfs #esconfs
- 2. Testing of Cloud Services The Approach: From Risks to Test Measures Kees Blokland Jeroen Mengerink Polteq Test Services BV The Netherlands
- 4. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmi t ting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meet ing, gambl ing, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, denying, talking, designing, making, verifying, measuring
- 5. 5 Email Surf Transfer Develop and Test Operate and Manage Store
- 6. 6 Email Surf Transfer Develop and Test redundancy, proliferation limitations storage claim 80% unused environmentally unfriendly Operate and Manage Store
- 7. 7 Email Surf Transfer Develop and Test internet technology virtualization SOA standard software bandwidth Operate and Manage Store
- 8. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, Develop and Test transmi t ting, learning, controlling, Email Surf purchasing, testing, alarming, changing, Transfer updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meet ing, gambl ing, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, Operate and Manage enhancing, creating, growing, Store checking in, checking out, finding out, reaching, denying, talking, 8 designing, making, verifying, measuring
- 10. Essential characteristics On-demand service Self service provisioning, pay-per-use No human interaction US: National Institute of Standards and Technology http://www.nist.gov
- 11. Essential characteristics On-demand service Broad network access Standard mechanisms over networks US: National Institute of Standards and Technology http://www.nist.gov “Any” client
- 12. Essential characteristics On-demand service Broad network access Resource pooling US: National Institute of Standards and Technology http://www.nist.gov Multi-tenant Storage, processing, memory, virtual machines, … Location independent
- 13. Essential characteristics On-demand service Broad network access Resource pooling US: National Institute of Standards and Technology http://www.nist.gov Rapid elasticity Rapid scale in and out “Any quantity” at any time
- 14. Essential characteristics On-demand service Broad network access Resource pooling US: National Institute of Standards and Technology http://www.nist.gov Rapid elasticity Measured service Controlled resource use Transparency, pay-per-use
- 15. Essential characteristics On-demand service Broad network access Resource pooling US: National Institute of Standards and Technology http://www.nist.gov Rapid elasticity Measured service Deployment models – private cloud – community cloud – public cloud – hybrid cloud Service Models Software as a Service Platform as a Service Infrastructure as a Service
- 16. What is “done” in the cloud? 16 >500 Private Hybride Community IaaS, PaaS, DaaS, SaaS Taas *aaS Data Centre Data Management Business processes Consumer Public SaaS Surf and mail Apps Social media Dropbox Google services Spotify Picasa Games …………… <500, SME Public *aaS Mail Storage Infrastructure CRM Finance Business processes
- 17. Continuity Privacy Multi platform Legislation Cyber crime Impact organisation Standards 143
- 18. Performance Standards Continuïty Privacy Security Availability & Continuity Functionality Manageability Multi platform Legislation Cyber crime Legislation & Regulations Impact organisation Suppliers & Outsourcing R i s k s
- 19. 19 YOUR Operational Profile Other customers YOUR Operational Profile PLUS Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 20. 20 The idea: “it’s safe” Everything over the web Home ground for hackers Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 21. 21 No free choice of device. Bring Your Own Device Endless possibilities. Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 22. 22 Taken care of. Backup and recovery Who will support me? Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 23. 23 Planned and controlled Updates, patches, fixes, … Do I have a choice? Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 24. 24 In house. Where is my data? And is that OK? Somewhere… Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 25. 25 Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 26. Testing? 26 Interview Check Intake Trial Proof of concept
- 27. Testing! 27 Interview Check Intake Trial Proof of concept Proof ofI nctoenrvcieepwt Proef Intake Testen
- 28. 28 Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Proof ofI nctoenrvcieepwt Proef Intake Testen
- 29. 29 Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 30. 30 Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 31. 31 Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 32. 32 Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Architecture From “individual” risks to “individual” test measures
- 33. 33 Selection Implementation Production Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 34. 34 Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 35. 35 Selection Criteria Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 36. 36 Proof of Concept Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 37. 37 Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 38. 38 Known measures tuned and tweaked New measures developed Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 39. 39 YOUR Operational Profile Load Testing YOUR Operational Profile PLUS ACTUAL MOMENT Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 40. 40 Online – Offline Use case testing. Global testing. Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 41. 41 Multiplatform testing. Any device – any platform Multiplatform testing. Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 42. 42 Internet Explorer 6 Internet Explorer 7 Internet Explorer 8 Firefox 3.5 Firefox 3.6 Firefox 4 Safari 4 Safari 5 Chrome11 Opera11 Windows XP Windows Vista Windows 7 Windows 2003 server Windows 8 Windows CE Linux Unix Mac OS Lion Mac OS Snowleopard iOS Android Operating Systems Browsers Multiplatform Devices Computer Mobile Tablet PC SUN Macintosh Samsung … NOKIA … Windows Mobile iPhone .. Xxx … ASUS.. Blackberry… MOTOROLA… Xxx …
- 43. 43 Multiplatform testing. Any device – any platform Multiplatform testing. Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 44. 44 Incidental testing. Legislation + Regulations = Test basis Compliancy testing. Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 45. 45 Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s
- 46. 46 Continuous End-to-End Test Functionals and non-functionals Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures
- 47. Continuity Privacy Interview Multi platform Legislation Cyber crime Impact organisation Standards Check Intake Trial Proof of concept
- 48. Continuity Privacy Interview Multi platform Legislation Cyber crime Impact organisation Standards Check Intake Trial Proof of concept
- 49. 49 Testing during Selection Performance Testing Security Testing Manageability Testing Test starts earlier Availability & Continuity Testing Test scope is widened Test will never stop Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Architecture From “individual” risks to “individual” test measures
- 50. 50 Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Questions?
- 51. 51 Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations Testing in Production Test Measures Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Suppliers & Outsourcing R i s k s Thank you!