Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The Boss Chose the Cloud: What Does that Mean for You?

101 views

Published on

Although most test managers and testing staff know how to cope with new and difficult testing challenges, Martin Pol and Jeroen Mengerink maintain that the cloud phenomenon requires special attention. Testing must evolve and innovate to address the newly introduced risks combined with the changing emphasis for classical quality requirements. How do you test resource elasticity and the “bring your own device” philosophy with their cloud-specific security and performance risks? How do you understand and then cope with local and international privacy legislation for the storage and processing of data? After a brief introduction to cloud computing, Martin and Jeroen discuss the test management efforts needed in different phases of a cloud project. The focus of testing cloud services is not confined to implementation but broadens to include data selection and testing in production. For each phase, Martin and Jeroen describe risks and test measures that need to be addressed, including how to use the cloud itself for testing.

Published in: Software
  • I’ve personally never heard of companies who can produce a paper for you until word got around among my college groupmates. My professor asked me to write a research paper based on a field I have no idea about. My research skills are also very poor. So, I thought I’d give it a try. I chose a writer who matched my writing style and fulfilled every requirement I proposed. I turned my paper in and I actually got a good grade. I highly recommend ⇒ www.WritePaper.info ⇐
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • You can ask here for a help. They helped me a lot an i`m highly satisfied with quality of work done. I can promise you 100% un-plagiarized text and good experts there. Use with pleasure! ⇒ www.HelpWriting.net ⇐
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

The Boss Chose the Cloud: What Does that Mean for You?

  1. 1. T16   Cloud  Testing   10/6/16  13:30   The  Boss  Chose  the  Cloud:  What  Does   that  Mean  for  You?   Presented  by:   Martin    Pol  & Jeroen Mengerink Polteq  Testing  Services  B.V.   Brought  to  you  by:     350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073     888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  info@techwell.com  -­‐  http://www.starwest.techwell.com/  
  2. 2.     Martin    Pol   Polteq  Testing  Services  B.V.     Martin  Pol  has  played  a  significant  role  in  raising  the  awareness  and  improving  the   performance  of  testing  worldwide.  Martin  is  experienced  in  managing  testing   processes  and  implementing  and  improving  structured  testing  in  many   organizations.  He  was  responsible  for  creating  the  structured  testing  approach   TMap¨  (Test  Management  Approach)  and  TPI¨Ê  (Test  Process  Improvement),  which   have  both  become  world  standards.  As  the  architect  of  the  method,  Martin  recently   coauthored  Testing  Cloud  Services.  A  highly  regarded  presenter  at  conferences  and   training  sessions  on  five  continents,  he  remains  active  in  the  practice  of  testing   every  day.  
  3. 3. The Boss Chose the Cloud: What Does that Mean for You? Martin Pol Jeroen Mengerink www.polteq.com
  4. 4. Topics • The Cloud • You! • Risks • Measures • Cases • Q & A Traditional New “Cloud related” Ways to test Ways to help reduce the risks
  5. 5. In the cloud?
  6. 6. Email Surf Transfer Develop and Test Operate and Manage Store
  7. 7. Email Surf Transfer Develop and Test Operate and Manage Store storage claim 80% unused redundancy limitations ecological unfriendly
  8. 8. Email Surf Transfer Develop and Test Operate and Manage Store standard software bandwidth internet technologySOA virtualization
  9. 9. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, denying, talking, designing, making Email Surf Transfer Develop and Test Operate and Manage Store
  10. 10. NIST Working Definition of Cloud Computing Essential characteristics  On-demand service  Broad network access  Resource pooling  Rapid elasticity  Measured service Deployment models – private cloud – community cloud – public cloud – hybrid cloud Service Models Software as a Service Platform as a Service Infrastructure as a Service The Cloud?
  11. 11. What is “done” in the cloud? Application, Audit Back office, Billing Communications Desktop, Data Email, Environment File transfer Governance Hardware Infrastructure, IT, ID JAVA Knowledge base Learning Music AaaS BaaS CaaS DaaS EaaS FaaS GaaS HaaS IaaS JaaS KaaS LaaS MaaS Network Operations Platform QA R&D Storage, Software Testing User management V&V Windows, Workspace Anything/Everything Youtube, Yum Zenoss, Zscaler NaaS OaaS PaaS QaaS RaaS SaaS TaaS UaaS VaaS WaaS XaaS Yaas ZaaS
  12. 12. Customer Business oriented Supplier IT oriented QA and Test Test manager Test engineer Selection Introduction Integration E2E test Transformation Production Project manager Business analyst Operations Product owner Sales Project manager Business analyst Operations Product owner Purchasing Marketing Development Research Releasing Beta tests Infrastructure Test management Risk analysis “Testing” Reporting The Boss Chose the Cloud: What Does that Mean for You?
  13. 13. How to test Cloud Services? • As we always did: – Bridging risks to measures – By using – Your skills – Your peers – Heuristics – The Book • New Risks • New Measures • Testing during Selection • Continuous (E2E) Testing in Production and
  14. 14. Security Continuity Privacy Multi platform Impact organisation Standards 143 Cloud related Risks?
  15. 15. Testing? Check Review Monitor Interview Proof of concept Test measures
  16. 16. Cloud related Risks Test measures Security Continuity Privacy Multi platform Impact organisation Standards Check Review Monitor Interview Proof of concept
  17. 17. Practical grouping of Cloud related Risks • Performance • Security • Availability & Continuity • Functionality • Maintainability • Legislation & Regulations • Suppliers & Outsourcing Security Continuity Privacy Multi platform Impact organisation Standards
  18. 18. Wider Scope of Testing • Selection • Implementation • Production
  19. 19. Testing during Selection • Fighting in • Selection criteria • Completeness • Controllability • ……………
  20. 20. Testing in Production • Continuous change • Continuous End-to-End Testing
  21. 21. Performance • Risk: Service might not perform well due to other (unknown) users • Problem: You don’t know the load of the other users • Solution: Perform your tests at the time that the scenarios are relevant • Payroll systems usually have more load at the end of the month. Execute your load test in that period. The other customers of the service will have their peak load at that point in time.
  22. 22. Security • Risk: The system is as secure as its weakest part • Problem: People connect their (personal) devices to the cloud service(s) • Solution: Create a policy that allows only certain kinds of devices • Solution: Enforce encryption on the connected devices • Solution: Have an external company audit the security • Solution: Look at security at multiple parts of the system Beware that the weakest link of your system is usually the user
  23. 23. Availability & Continuity • Risk: Service provider files for bankruptcy • Problem: How to get your data • Solution: Define the divorce before the marriage
  24. 24. Storage in the cloud • As a growing company, we would like to store our data in the cloud, so that all our employees have easy access to it. • Some employees already used Dropbox, so we just started using it. • But what are the risks? • Performance: How much data will we put there and will it be fast enough? • Security: Can nobody else access our data? • Availability & Continuity: Can we always get access to our data? • Functionality: Does it work everywhere in the world? • Maintainability: Who do we contact when we have a problem? • Legislation & Regulations: What laws apply to our data and are we allowed to store it online? • Suppliers & Outsourcing: What is in the terms and conditions of Dropbox?
  25. 25. Storage in the cloud – Security • Problem: Users can share links to data • Solution: – Test authentication and authorization and check what can be configured – Dropbox: Not configurable, only option is to select another service – Currently transitioning to OneDrive
  26. 26. Storage in the cloud – Functionality • Problem: In China, Dropbox behaved strange • Solution: – Test the software at the places where you want it to work – Create test scenarios (think of online vs offline scenarios) – Execute them at different (global) locations
  27. 27. Storage in the cloud – Functionality • Problem: Can every employee connect his device(s) • Solution: – Multi platform testing – Use a device analysis to test with the proper devices – Make use of device labs
  28. 28. Storage in the cloud – Functionality: 3997 distinct Android devices in 2012 http://opensignal.com/reports/fragmentation.php
  29. 29. Storage in the cloud – Functionality: 18796 distinct Android devices in 2014 http://opensignal.com/reports/2014/android-fragmentation/
  30. 30. Storage in the cloud – Maintainability • Problem: – One connected account had ransomware. – Ransomed files got synced to all other connected accounts • Solution: – Verify that there is a way to get in contact with the provider – Check that documentation on the use of the service is present (and up-to-date) – Dropbox help center provided useful information – Dropbox employees helped to restore our data
  31. 31. Storage in the cloud – Suppliers & Outsourcing Compliance with Laws and Law Enforcement Requests; Protection of Dropbox's Rights. We may disclose to parties outside Dropbox files stored in your Dropbox and information about you that we collect when we have a good faith belief that disclosure is reasonably necessary to (a) comply with a law, regulation or compulsory legal request; (b) protect the safety of any person from death or serious bodily injury; (c) prevent fraud or abuse of Dropbox or its users; or (d) to protect Dropbox’s property rights. If we provide your Dropbox files to a law enforcement agency as set forth above, we will remove Dropbox’s encryption from the files before providing them to law enforcement. However, Dropbox will not be able to decrypt any files that you encrypted prior to storing them on Dropbox. • Solution: Read the terms and conditions before selecting a service
  32. 32. Continuity Privacy Multi platform Legislation Impact organisation Standards Check Intake Monitor Interview Proof of concept Summarizing
  33. 33. How to test Cloud Services? • As we always did: – Bridging risks to measures – By using – Your skills – Your peers – Heuristics – The Book • New Risks • New Measures • Testing during Selection • Continuous (E2E) Testing in Production and
  34. 34. Questions? martin.pol@polteq.com jeroen.mengerink@polteq.com info@polteq.com www.polteq.com
  35. 35. Thank you! martin.pol@polteq.com jeroen.mengerink@polteq.com info@polteq.com www.polteq.com

×