• Save
Testing cloud services - EuroSTAR
Upcoming SlideShare
Loading in...5
×
 

Testing cloud services - EuroSTAR

on

  • 209 views

Presentation at EuroSTAR on how to test when cloud computing is involved.

Presentation at EuroSTAR on how to test when cloud computing is involved.

Statistics

Views

Total Views
209
Views on SlideShare
206
Embed Views
3

Actions

Likes
0
Downloads
0
Comments
0

2 Embeds 3

http://www.linkedin.com 2
https://www.linkedin.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Testing cloud services - EuroSTAR Testing cloud services - EuroSTAR Presentation Transcript

  • Testing of Cloud ServicesThe Approach: From Risks to Test Measures Kees Blokland and Jeroen Mengerink, Polteq @esconfs www.eurostarconferences.com #esconfs
  • Testing of Cloud ServicesThe Approach: From Risks to Test Measures Kees Blokland Jeroen Mengerink Polteq Test Services BV The Netherlands
  • searching, recording, accounting, paying, writing,reviewing, tracking, calculating, developing, listening,analyzing, transmitting, learning, controlling,purchasing, testing, alarming, changing, updating,deleting, accessing, rejecting, correcting, studying,booking, receiving, tracing, protecting, deciding,managing, teaching, facilitating, identifying, copying,removing, demonstrating, checking, showing,selecting, subscribing, unsubscribing, sharing,mailing, communicating, reading, playing, working,meeting, gambling, shopping, storing, crosschecking, retrieving, configuring, sketching, saving,accelerating, enhancing, creating, growing, checkingin, checking out, finding out, reaching, denying,talking, designing, making, verifying, measuring
  • Develop and Test Email Surf Transfer Operate and Manage Store5
  • Develop and Test Email Surf Transfer redundancy limitations 80% unused storage claim environmentally unfriendly Operate and Manage Store6
  • Develop and Test Email Surf Transfer SOA internet technology virtualization standard software bandwidth Operate and Manage Store7
  • searching, recording, accounting, paying, writing,reviewing, tracking, calculating, developing, listening,analyzing, Test Develop and transmitting, learning, controlling, Email Surfpurchasing, testing, alarming, changing, updating, Transferdeleting, accessing, rejecting, correcting, studying,booking, receiving, tracing, protecting, deciding,managing, teaching, facilitating, identifying, copying,removing, demonstrating, checking, showing,selecting, subscribing, unsubscribing, sharing,mailing, communicating, reading, playing, working,meeting, gambling, shopping, storing, crosschecking, retrieving, configuring, sketching, saving,accelerating, enhancing, creating, growing,Store Operate and Manage checkingin, checking out, finding out, reaching, denying,talking, designing, making, verifying, measuring8
  • Essential characteristics On-demand service  Self service provisioning, pay-per-use  No human interactionUS: National Institute of Standards and Technology http://www.nist.gov
  • Essential characteristics On-demand service Broad network access  Standard mechanisms over networks  “Any” clientUS: National Institute of Standards and Technology http://www.nist.gov
  • Essential characteristics On-demand service Broad network access Resource pooling  Multi-tenant  Storage, processing, memory, virtual machines, …  Location independentUS: National Institute of Standards and Technology http://www.nist.gov
  • Essential characteristics On-demand service Broad network access Resource pooling Rapid elasticity  Rapid scale in and out  “Any quantity” at any timeUS: National Institute of Standards and Technology http://www.nist.gov
  • Essential characteristics On-demand service Broad network access Resource pooling Rapid elasticity Measured service  Controlled resource use  Transparency, pay-per-useUS: National Institute of Standards and Technology http://www.nist.gov
  • Essential characteristics On-demand service Broad network access Deployment models Resource pooling – private cloud – community cloud Rapid elasticity – public cloud Measured service – hybrid cloud Service Models Software as a Service Platform as a Service Infrastructure as a ServiceUS: National Institute of Standards and Technology http://www.nist.gov
  • Standards Cyber crime Continuity Privacy LegislationMulti platform Impact organisation 143
  • Performance Standards Security Cyber crime Continuïty Availability & Continuity Functionality Privacy Legislation Manageability Multi platform Legislation & RegulationsRisks Impact organisation Suppliers & Outsourcing
  • Performance YOUR Operational Profile Security Availability & Continuity Functionality Other customers Manageability Legislation & RegulationsRisks YOUR Operational Profile Suppliers & Outsourcing PLUS19
  • Performance The idea: “it’s safe” Security Availability & Continuity Functionality Everything over the web Manageability Legislation & RegulationsRisks Home ground for hackers20 Suppliers & Outsourcing
  • Performance No free choice of device. Security Availability & Continuity Functionality Bring Your Own Device Manageability Legislation & RegulationsRisks Endless possibilities.21 Suppliers & Outsourcing
  • Performance Taken care of. Security Availability & Continuity Functionality Backup and recovery Manageability Legislation & RegulationsRisks Who will support me?22 Suppliers & Outsourcing
  • Performance Planned and controlled Security Availability & Continuity Functionality Updates, patches, fixes, … Manageability Legislation & RegulationsRisks Do I have a choice?23 Suppliers & Outsourcing
  • Performance In house. Security Availability & Continuity Where is my data? Functionality Is it OK? Manageability Legislation & RegulationsRisks Somewhere…24 Suppliers & Outsourcing
  • Performance Security Availability & Continuity Functionality Manageability Legislation & RegulationsRisks25 Suppliers & Outsourcing
  • Testing? Interview Check Trial Proof of concept Intake26
  • Testing! Interview Check Trial Proof of concept Proof ofInterview Proef concept Testen Intake Intake27
  • Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Proof ofInterview Proef concept Testen Functional Testing Intake Migration Testing Testing caused by Legislation & Regulations28 Testing in Production
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations29 Suppliers & Outsourcing Testing in Production
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations30 Suppliers & Outsourcing Testing in Production
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations31 Suppliers & Outsourcing Testing in Production
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Architecture Manageability Testing Availability & Continuity Functionality Testing From “individual” risks Functional Testing Manageability to “individual” test measures Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations32 Suppliers & Outsourcing Testing in Production
  • Te s t M e a s u r e s Testing during Selection Performance Testing Selection Security Testing Manageability Testing Availability & Continuity Implementation Testing Functional Testing Migration Testing Production Testing caused by Legislation & Regulations33 Testing in Production
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations34 Suppliers & Outsourcing Testing in Production
  • Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Selection Criteria Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations35 Testing in Production
  • Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Proof of Concept Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations36 Testing in Production
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations37 Suppliers & Outsourcing Testing in Production
  • Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Known measures Manageability Testing tuned and tweaked Availability & Continuity Testing Functional Testing New measures developed Migration Testing Testing caused by Legislation & Regulations38 Testing in Production
  • Te s t M e a s u r e s Testing during Selection YOUR Operational Profile Performance Testing Security Testing Manageability Testing Availability & Continuity Load Testing Testing Functional Testing Migration Testing YOUR Testing caused by Operational Profile Legislation & Regulations PLUS39 ACTUAL MOMENT Testing in Production
  • Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Online – Offline Testing Functional Testing Migration Testing Testing caused by Use case testing. Legislation & Regulations Global testing.40 Testing in Production
  • Te s t M e a s u r e s Testing during Selection Multiplatform testing. Performance Testing Security Testing Manageability Testing Availability & Continuity Any device – any platform Testing Functional Testing Migration Testing Testing caused by Multiplatform Legislation & Regulations testing.41 Testing in Production
  • Windows XP Internet Explorer 6 Internet Explorer 7 Windows Vista Internet Explorer 8 Windows 7 Firefox 3.5 Windows 2003 server Firefox 3.6 Windows 8 Browsers Firefox 4 Safari 4 Windows CE Safari 5 Linux Operating Systems Chrome11 Unix Opera11 Mac OS Lion Multiplatform PC Mac OS Snowleopard SUN iOS Computer Macintosh Android iPhone .. Windows Mobile Samsung … Devices Mobile NOKIA … Xxx … ASUS.. Blackberry… Tablet MOTOROLA… Xxx …42
  • Te s t M e a s u r e s Testing during Selection Multiplatform testing. Performance Testing Security Testing Manageability Testing Availability & Continuity Any device – any platform Testing Functional Testing Migration Testing Testing caused by Multiplatform Legislation & Regulations testing.43 Testing in Production
  • Te s t M e a s u r e s Testing during Selection Incidental testing. Performance Testing Security Testing Manageability Testing Legislation + Regulations Availability & Continuity = Testing Test basis Functional Testing Migration Testing Testing caused by Legislation & Regulations Compliancy testing.44 Testing in Production
  • European Commissioner Kroes, Sept 27• Strategy document to promote cloud computing• 2,5 million jobs, 160 billion Euros• Major barriers: – Many different standards – Contract issues – Many different rules and policies• Privacy legislation: differences in 27(!) EU-countries45
  • Te s t M e a s u r e s Testing during Selection Incidental testing. Performance Testing Security Testing Manageability Testing Legislation + Regulations Availability & Continuity = Testing Test basis Functional Testing Migration Testing Testing caused by Legislation & Regulations Compliancy testing.46 Testing in Production
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations47 Suppliers & Outsourcing Testing in Production
  • Te s t M e a s u r e s Testing during Selection Performance Testing Continuous Security Testing End-to-End Test Manageability Testing Availability & Continuity Testing Functionals Functional Testing and non-functionals Migration Testing Testing caused by Legislation & Regulations48 Testing in Production
  • Standards Cyber crime Check Continuity Interview Privacy LegislationTrial Proof of concept Multi platform Intake Impact organisation
  • Standards Cyber crime Check Continuity Interview Privacy LegislationTrial Proof of concept Multi platform Intake Impact organisation
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Architecture Manageability Testing Functionality starts earlier Test Availability & Continuity Testing From “individual” risks Test scope is widened Functional Testing Test will never stop Manageability to “individual” test measures Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations51 Suppliers & Outsourcing Testing in Production
  • 52
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Questions? Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations53 Suppliers & Outsourcing Testing in Production
  • Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Thank you! Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused byRisks Legislation & Regulations54 Suppliers & Outsourcing Testing in Production