White paper on testing in cloud


Published on

This is a paper which will outline the benefits of moving the cloud from traditional in house to cloud,type of testing ,approach Test team/companies need to performed if they are adopting cloud solution .
This solution is generic in nature and it applies for all business who want to use Cloud Offering from different vendors like Microsoft, Amazon, Google, IBM, Salesforce

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

White paper on testing in cloud

  1. 1. An Overview of Testing In CloudKulamani Sahoo
  2. 2. IntroductionIn traditional on premises testing scenario’s, most of the small-medium business(SMB) orlarger organization are much more focus on setting up infrastructure for testing followed bymaintaining them for longer periodIt’s an overhead for them in putting lot of money oninfrastructure. Cloud computing is the new age solution which helps organizations or ServiceIndustries to focus on their core business rather than worrying about the setting up andmaintenance of their IT infrastructure in advance which incur them a huge CapitalExpenditure(Cap-Ex) . Resources or Services are available to be accessed from the cloud atany time, and from anywhere in the world via the internet. Cloud computing provide ahosting environment that is immediate scaling (in/Out), available on demand, flexible whilehelping Organization to plan, install, configure and validate complex test environments whileimproving the quality of testing in quick time. Cloud computing demands ubiquity,efficiency, security, and trustworthiness. Cloud computing is the trending topics in the ITindustry as a model that provides computing resources on demand with reducedadministration costs. There are still few challenges or concerns in the areas like security,privacy, availability, performance and integrity in the cloud. Its requires a dedicated planningand rigorous testing effort of any cloud offering to satisfy the business need of the end userup to great extent.Benefit of Cloud TestingCloud testing helps business in like setting and maintain the environments,On-demandservices, lower cost, elimination of capital expenditure in advance, resource pooling, andbroader network access, rapid elasticity and most importantly reduction in cycle reductiontime for different business offering in this dynamic and fast going services and IT industry.Below are the some of the key benefits with regards to Testing in cloudRapid provision of Test environment(s) - In case of traditional testing methodologies(on-premises/intranet), companies used to spend huge amount of money on settingup the dedicated infrastructure in advance. Due to the dynamic nature of the realworld application in terms of Requirements and user in short period of time, it’s verydifficult for companies to set up the infrastructure for testing use which mirrors theproduction environments. With the Help of Cloud, it’s Just a matter of seconds for theorganization to turn up the testing environments/servers to fulfill project time lines.
  3. 3. Business/users can simulate the test replica of production environment which helpstesting team to validate the business scenarios and finding bugs at earliest.Reduced capital expense or Cheaper Cost in setting infrastructure–On average thereare 30 to 50% of servers are dedicated to testing purpose in IT world. Most of themare underutilized as testing is a periodically activities and once the phase is over theyremain idle for rest of the time. Because of the huge Investment up front on dedicatedservers companies used to get very less Return on investment(ROI) Cloud will take carefor setting up for the testing infrastructure as when needed by the organization anddecommission all the set up /servers once the testing is done which helps companiesto save their money. This helps companies to get the work done in a lower price ascompared to earlier as there is no cost associated with them in setting up all thoseinfrastructure in advance.Rapid customization of hardware resources -As Companies are allowing cloudenvironment for their testing use due to the dynamic nature applications which arecomplex and distributed in the industry ,It’s easy for organization to simulate theproduction scenarios(which was a challenge in earlier Models as it requires hugeamount of cost and resource’s associated ) to verify the Load , performance testing,verifying the scenarios in different environment with multiple browser in differentoperating system (different combination of memory, CPU and hard disk capacity)andlatest versions available in market.Support Green computing and Reducing Carbon foot Print-Green Computing is thestudy and practice of using computing resources efficiently. The global use ofcomputing resources, both servers and desktops, continues to grow dramatically dueto huge IT market and different industries. As most of the companies are adoptingcloud strategy which provides infrastructure on demand basis, cloud solution enablescompanies to become more environmentally friendly.Effective use of Resources-As Companies are moving most of the frequently usedservices, Tools, applications, infrastructure, Testing, Development and support into thecloud, it will allow companies to use the resources (people, money, time) on the corecompetencies which helps them growing faster in terms of their Goal and enablesthem to earn more money. There is no need of setting environment in advance orkeep maintaining it till next cycle. Cloud will take care of all business need as and when
  4. 4. required .By using cloud server efficiency and utilization has been drastically improvedthrough the even distribution of workload. Testing in the cloud leverages the existingcloud computing infrastructure provided by the vendor which helps in reducing thecost of computing to a great extent with increasing testing effectiveness in the process.Type of Testing to be performed in CloudTesting in cloud is different than out traditional on premise testing where enterprise has toset up, maintain and verify the scenarios from end to end prospective in all aspects. Beloware some of the testing required to perform once application is moved to cloudpremises.System integration testing (SIT) - Testing performed to verify that the cloud solutionwill work within the current infrastructure and environments, proving that theimplementation of a cloud solution does not impact any existing systems.User acceptance Testing (UAT) -Testing is done to verify the current provided cloudsolution from the vendor meets the business needs of the organization.Security Testing-Ensure that all sensitive and important information which are going tobe stored in the cloud will be highly secure in nature. Asprivacy also a key area incloud from the user point of view, it’s important to verify the privacy of theapplication users and associated information whenmaintained incloud.Performance testing-Testing technique that measures the system performances incloud. Verify the network latency and response time, Load balancing, peakrequestcount by hosting subscription in different data center across the globe. Adding tothese,traditional load and stress testing are required to validate business scenarios inthe cloud model in terms of varying dynamic load and stress on the application.Disaster recovery testing-Verify the time it’s takes to recover from disaster in differentscenario (system crashes under high load/volume of data, hardware failures,systemfailures, Network outrage, insufficient bandwidth) as per SLA.Also verify is thereany data loss in this process and time takes to report failure.
  5. 5. Availability testing-Cloud offering should be available 24*7 for the enterprise or enduser. It’s the key responsibilities of the provider to maintain as per the SLA.Scalability testing-Ensure cloud provider is offering scale in/out functionality as perthe demand from the user/organization.Multi tenancy Testing-The concept of multi tenancy is to provide solution/offeringfrom a single instance to multiple tenants(user/clients) .Cloud offering should bevalidated when more than one client is using the same instance in terms of securityand DataInteroperability Testing-verify moving application from one cloud to alternate cloudprovider should have the flexibility to run successfully. Basically there should not beany issue if business/user is migrating from one infrastructure to another oneAccessibility Testing -Verify user groups across different geographic location areaccessible to the cloud at any point of time without any delay.Automation testing-Ensure that the existing automation suitecan be run with minimalchanges in the cloud. Basically UI Automation code will not be much different for anapplication hosted in cloud.There are three different service/delivery models (Saas,PaaS,IaaS)which helpsorganization in adopting the right one as per their business/testing requirement. Thereare three deployment model available i.e. public cloud, private cloud,and hybridcloud.Organization will choose the right set of delivery and deployment model as per theirbusiness needs for testing.Key Consideration before moving to cloud Testing
  6. 6. The important thing before moving the application into the cloud is to choose rightvendor which provides a wide range of services and as per the business needs of theorganization with right set of SLA (service level Agreement). First of all organizationsmust should evaluate the risk, conduct some POC to fully explore the benefits ofmoving their existing or new application for cloud testing.Also they need properevaluation of testing tools,hardware,software,server,storage,bandwidth, time frame etc.before building test bed. As most of the legacy applications are tightly coupled andcomplexity is too high among the modules, there should be a thorough discussionamong the team before taking a strategic move to cloud (What is the cost, time factorand resourceusage involved applications are moved to cloud?) If the application is aHLB, mission critical Application it’s required to evaluate all the parameter startingfrom Vendor capability, internal IT/Industry regulation, compliance before migratingit.Skill sets of tester is much required before start testing on cloud. Learning andawareness of cloud for all the team members by attending seminars, some of the bestprecise in cloud testing, webinar, workshops are good source to get requiredknowledge. It’s also required to monitor the test results from time to time forperformances and operational cost of application for the cloud usage.Challenge’s in Testing in cloudSecurity in public cloud is the top most concern for the Business and end user andencryption techniques are still considered insufficient. There are no industry standardto integrate public cloud resources with the in premises data center resources. Publiccloud vendor is having their own standard architecture, different pricing chart and notflexible operating model which results difficulties in interoperability.Complexity of theapplication makes difficult for the organization to evaluate the testing effort andstrategies.Cloud vendor should provide transparent pricing model to the customers,enterprises for better cost estimation, capacity planning and strategicupfront.Performance is another areas of concern in private cloud. As the application isin private cloud,it’s shared by many users simultaneously which results a latency issue.Conclusion
  7. 7. According to Leading Analyst such as Gartner, Most of the companies will adopt cloudsolution in place for their application in the next 5 years. Moving testing in to cloudhelp organization to get the latest tools, much more security, on demand resources,not worrying about managing infrastructure, licensing at a very low cost .Pushingtesting into cloud is a win-win situation and gain significant changes to organization inso many ways. So Organization should take steps in changing the testing strategiesand procedures for the same. For a better cloud testing experience, test team shouldadopt a robust strategy which caters to their business needs.Cloud computing isgrowing at a rapid rate in the global industry because of its scalability, availability,robustness and the lower cost for service that attracts small medium businesscompanies to a great extent. Hybrid cloud(mix of both public and private clouds) canbe deployed together to leverage the best of both cloud computing which helpsorganization keep secured data in the private cloud and other data’s in publiccloud.Third party monitoring services helps customer are getting the best service inthe industry once they use cloud environment for their applications