EuroSTAR presentation: What's in the cloud for testing, the sky is the limit
•Download as PPTX, PDF•
0 likes•764 views
The cloud has already had a high impact on software testing and this impact will continue to grow hugely. The cloud allows test teams to avoid high infrastructure costs by using cloud-based test tools that enable global, scalable testing on demand. Cloud testing services also change expectations around quality and require different testing approaches focused on areas like security, compliance, availability and cost modeling. The cloud is enabling testing as a service and shifting testing to be more results-driven through metrics and service level agreements.
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to EuroSTAR presentation: What's in the cloud for testing, the sky is the limit
Similar to EuroSTAR presentation: What's in the cloud for testing, the sky is the limit (20)
Recently uploaded
Recently uploaded (20)
EuroSTAR presentation: What's in the cloud for testing, the sky is the limit
- 1. What’s in the cloud for testing? The sky is the limit Edwin van Loon, Valid www.eurostarconferences.com @esconfs #esconfs
- 2. Introduction Edwin van Loon • ISEB Practitioner • Lean Six sigma green belt • Almost 15 years of experience within different testing roles • Living in Belgium • Working in the Netherlands edwinvanloon Edloon Edwin.van.loon@valid.nl
- 3. Cloud Introduction of the Euro coin Millennium change Agile manifesto ISO SQuaRE (25010) Web based development Regulatory compliance Model based testing Risk based testing Test Certification
- 4. Vote: What will be the impact of the cloud on our testing profession? URL: http://piepe.co
- 5. Agenda • The cloud in general • The cloud and testing • The cloud and it‟s possibilities • Testing the cloud What’s in the cloud for testing
- 6. Cloud layers Applications Runtime Security Databases Servers Network Storage Hardware Virtualization Cloud General Testing the Cloud CloudCloud Possibilities and Testing
- 7. Cloud layers Applications Runtime Security Databases Servers Network Storage Hardware Virtualization Cloud General Testing the Cloud CloudCloud Possibilities and Testing
- 8. Cloud layers Applications Runtime Security Databases Servers Network Storage Hardware Virtualization Cloud General Testing the Cloud CloudCloud Possibilities and Testing
- 9. History of the Cloud 16.3% compound annual growth rate through Early SaaS adaptors 1997 2000 2002 2004 Cloud General Testing the Cloud CloudCloud Possibilities and Testing 2006 2008 2010 2012 -2015
- 10. “In the last 7 years, do you know how many times I have lost any personal data? Zero. Announcement Cloud in 1997 Do you know how many times I have backed up my computer? Zero… I have computers at Apple, at NeXT, at Pixar, and at home. I walk up at any of them and log in as myself, it goes over the network, finds my home directory on a server, and I got my stuff where ever I am… Carrying around these non-connected computers or computers with tons of data and state in them is Byzantine by comparison.” Triple A: Any time, Any place, Any device, (Any data) Steve jobs at WWDC 1997 (Apples Worldwide Developers Conference) (http://www.youtube.com/watch?v=3LEXae1j6EY) Cloud General Testing the Cloud CloudCloud Possibilities and Testing
- 11. Advantages 1. Time to market 2. Scalability 3. Reduction of IT-costs Cloud General Testing the Cloud CloudCloud Possibilities and Testing
- 12. Cloud testing • a form of software testing in which web applications use cloud computing environments to simulate real-world user traffic. en.wikipedia.org/wiki/Cloud_testing • allows you to use simulated web traffic to „load test‟ a website or web application with a flexible, scalable and affordable testing environment. www.iseb-istqbsoftwaretesting.co.uk/video-introduction-to-cloud-testing CloudCloud Possibilities and Testing Cloud General Testing the Cloud
- 13. Cloud test tools Test tools: - Functional and Performance testing - Cross browser testing - Test management Runtime Security Databases Servers Network Storage Hardware Virtualization CloudCloud Possibilities and Testing Cloud General Testing the Cloud
- 14. History of the Cloud 16.3% compound annual growth rate through Early SaaS adaptors 1997 2000 2002 2004 CloudCloud Possibilities and Testing Cloud General Testing the Cloud 2006 2008 2010 2012 -2015
- 15. Advantages cloud test tools • Accessible at Any place, Any time, Any device • Scalability • No infrastructural constraints • No geographical constraints • Low time to market • Temporary contract / low costs • No installation • Availability • Usability • Possibilites for endurance testing • ……… CloudCloud Possibilities and Testing Cloud General Testing the Cloud
- 16. Demo CloudCloud Possibilities and Testing Cloud General Testing the Cloud
- 17. CloudCloud Possibilities and Testing Cloud General Testing the Cloud
- 18. Test layers Testing as a Service Test tools Test portal Templates Standards KPI‟s Virtual testmachines Test servers Network types (latency) Cloud General Testing the Cloud CloudCloud Possibilities and Testing
- 19. TaaS (or Quality as a Service) Customer Tools Operational Data Software and Processes Process Data Test machines Infrastructure Test tools Test results Portal On Premise Software Metrics / KPI‟s Test machines Test Employees and Processes Service provider Off Premise Software
- 20. Test Service Level agreement • Effort driven: • Number of test cycles per period (including peak and off-peak) • Through put time (test execution, test preparation, etc.) • Test or QA activities in general • Creation of Reports (operational and tactical) • Result driven: • Test coverage (quality level) or effort • Defect detection percentage (DDP) Cloud General Testing the Cloud CloudCloud Possibilities and Testing
- 21. Testing the cloud • • • • • • • • • Compliancy statement Security testing Availability Test of cost models Test of migration Fixed release dates Connectivity testing of hybrid clouds. Juridical aspects of the cloud Availability of cloud solutions: • Test of vendors (Cloudsleuth) • Two internet providers • Two instances / multi-region Cloud General Testing the Cloud CloudCloud Possibilities and Testing
- 22. Resume • The cloud is a TaaS enabler • The cloud will change the expectation of users regarding quality • Cloud services require different test approach • Cloud test tools allow test teams to: • avoid high costs on investments • execute test global tests • The cloud allows the test community to cooperate and connect The cloud has a already a high impact on Software Testing …….. and the impact will become huge
- 23. Stay Ahead
Editor's Notes
- Op een laag pitje – At low ebb
- Richter magnitude scale representing the energy scale of an earthquake 0 – 6: Micro to Moderate -> Happens often and no or less impact/damageLow impact. Perhaps a small change in specific testing approach, but nothing to worry about.6,1 – 9: Strong -> Happens a few times per year. Damage within a local area. Impact but not killing. High impact. It offers opportunities to optimize our way of testing and our test tooling. Changes will occur but no change in image or fundaments.9,1 – 10: Huge impact, happens a few times in a working-life time. Killing impact on software testing Huge impact. It will change the fundaments and image of the testing profession, like the millennium change did.Regularity -> conformance to standards, policies or law
- - What’s the cloud in general – What is the history of the cloud- The cloud and testing – What’s is the cloud currently offering to testing What are the possibilities of the cloud for our testing profession according to me. At last providing some special attention points on testing of cloud solutions.
- Layers also called (article Chris Poelker in Computerworld 24 May 2011);Infrastructure cloud (abstracts applications from servers and servers from storage)Content cloud; -> Abstracts data from applicationsInformation cloud ->Abstracts access from clients to data
- After the internet bubble Amazon modernized their data centers, because they were only using 10% of the total capacity at any one time.Also triggered by the extending of computer networks to meet the Black Friday peak load.First SaaS solutions were CRM related (like SalesForce.com, Inntact and Salesnet)Amazon S3 (Simple Storage Service)-> first publicly available web serviceGoogle apps (2006 – Gmail) – 2008 site creationMicrosoft Azure (2009) -> SQL Azure Relational Database / Since june 2012 Azure also offers additional services on infrastructural level (like secure site to site network connectitvity)Gartner 2008 -> "organizations are switching from company-owned hardware and software assets to per-use service-based models" Compound annual growth of number of licenses – average growth over a certain period meaning 2012 – 2015 a real growth of almost 50% (and from 2007 of 400%)
- In 1960 John McCarty (an americ computer scientist) opined that computing may someday be organized as public utility
- Terremarkdatacenter at Schiphol – 2500 square-meterIBM 576.000 square meter facility Langfang China (6.5 times the size of the RAI building)Yahoo green data center inspired on Chicken Coops - 40 percent less energy than typical data centers- Cost example … about 60 euro per month (2880 euro for 48 months) (Storage, Database, Transactions and Bandwidth …. Average server -> (1500 – 8000 euro) 4500 euro + 2100 euro power for 48 months = 6700 euro
- Pricing practitestfrom 15 – 45 dollar per month per userSpiraTest – 260 dollar for 20 concurrent users per monthLoadstorm one load test of 5,000 concurrent users – 199 dollar – 700000 dollar for loadrunner forVuserinhouselicenseand controller for 1 year(In-house Controller and 15K VUD’s = £60k)
- Simulation of real conditions—from thousands of local users to millions of concurrent and geographically dispersed users.
- Layersalsocalled (article Chris Poelker in Computerworld 24 May 2011);Infrastructturecloud (abstracts applicationsfrom servers and servers from storage)Content cloud; Abstracts data fromapplications)Information cloudl Abstracts access fromclientsto data)
- Multi tennent -> Oplossingen voor meerdere klanten.
- Windows Azurelaunchedinfrastructureas a Service for support of migrations.Juridical: Patriot: Any data which is housed, stored or processed by a company, which is a U.S. based company or is wholly owned by a U.S. parent company, is vulnerable to interception and inspection by U.S. authorities. Compliancy: Payment Card Industry Data Security Standard (PCI DSS)Good Automated Manufacturing Practice (GAMP) 5SOx (Sarbanes Oxley – after Enron)SAS 70auditing standard