• Save
Neev Independent Testing Services
 

Neev Independent Testing Services

on

  • 528 views

Where Neev can help? A few Use Cases ...

Where Neev can help? A few Use Cases
Why Neev as an Independent Testing Partner?
Capabilities
Functional Testing (Web / Mobile / Cloud)
Non-Functional Testing
Testing Tools (Web / Mobile)
Agile Testing Expertise
Case Studies

Statistics

Views

Total Views
528
Views on SlideShare
528
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Neev Independent Testing Services Neev Independent Testing Services Presentation Transcript

  • Neev Independent Testing Services Seeing the Forest and the Trees
  • The Agenda • Where Neev can help? A few Use Cases • Why Neev as an Independent Testing Partner? • Capabilities I. Functional Testing (Web / Mobile / Cloud) II. Non-Functional Testing III. Testing Tools (Web / Mobile) • Agile Testing Expertise • Case Studies • About Neev • Summary
  • Where Neev can help? A few Scenarios • • • • • • Pre-Release Testing: Have a release coming up in a month? Would you like an Independent Testing Team to test the application/product thoroughly and come back with suggestions? Agile Test Partner: Looking for an independent testing partner that can rigorously test your sprint increments, Sprint by Sprint, and maintain an automated test suite at a test coverage of over 70%? Pre-Launch Multi-Platform Mobile App Testing: Looking for a Testing partner who understands the nuances of the Mobile Ecosystem and get your Apps store-ready? Long Term Testing Partner: Looking for a Testing partner that can help you get your Regression Tests on the Cloud and run them on-demand? Pre-Release Scale Testing: Want to test if the application can scale as per your expectations. Tool Centered Testing : Looking for a Testing partner specializing in tools. Neev – A Partner for your Everyday & Mission-Critical Testing Needs
  • Why Neev as an Independent Testing Partner? • • • • • • Fast Go-to-market: Hundreds of start ups have worked with Neev to go live with their version 1.0 of their product., eg., InMobi, Redbus, Apalya Myplex.tv Wide Expertise in Tech Ecosystems: Neev understands the Web, Mobile, Cloud ecosystem in a way that few companies do. Process Orientation: Strong in Agile, Scrum processes – Sprint planning, retrospectives, product backlog grooming, etc. Tools & Test Automation: Comprehensive experience in Test Automation and Load Test Tools. Strong Partnerships – A strong ecosystem of partners – Amazon Web Services, AppDynamics, Splunk, Sauce Labs. Strong Domain Expertise: Neev has expertise in handling Testing projects across multiple domains - eCommerce, Mobility, Education, Healthcare, Social Media. All Round Expertise with excellent Tools / Partners ecosystem
  • Perform ance Testing Automa tion Testing Regression Tests followed by Sanity Testing Neev Testing Capabilities
  • Functional Testing Capabilities at a Glance Automated & Regression Testing Interface & Usability Testing SDK Testing User Acceptance Testing Component Testing Manual Testing Black Box and White box Testing Automation/Tool based Testing Unit Testing Smoke/Sanity Testing System Testing Integration Testing Installation Testing Pre User Acceptance Testing Experience across diverse Testing needs.
  • Non-Functional Testing Capabilities at a Glance Experience across diverse Testing needs.
  • Tools Expertise for Web Application Testing QA Activity Tools Used Test Management Visual Studio 2010, Fitnesse, RedMine, Test Link Test Automation Tools (Open Source) Selenium RC, WebDriver, Watir, Watij, SauceLabs, Sahi, Canoo Functional Testing Tools (Open Fit, FitNesse, Cucumber, RSpec Source) Unit Testing Frameworks JUnit, NUnit, SpringUnit, GrailsUnit Test, PHPUnit Issue Tracking BugZilla, RedMine, TRAC, JIRA Code Management CVS, Git, SVN, VSS, TFS Build Automation Continuum, Maven, Make, Ant, Cruise Control, Cruise Control.NET Performance Test Tool Apache JMeter, WebLoad Expertise in Best-in-class Testing tools
  • Tools Expertise for Mobile Application Testing QA Activity Tools Used Test Management Redmine, testlink Test Automation Tools Robotium, Appium, monkeyrunner Unit Testing Frameworks JUnit, OCUnit Issue Tracking BugZilla, JIRA, Trac Code Management SVN, GIT Build Automation Hudson, ANT Performance Test Tool Apache JMeter, LoadRunner, memory profiling through xcode Expertise in Best-in-class Testing tools
  • Key Challenges & Best Practices for Mobile Testing Key challenges Best practices followed •Write unit test cases Device diversity •Early testing using emulators •Create acceptance environment by prioritizing the target OS & devices •Create automated test scripts for smoke & regression testing •Use of paid services such as “deviceanywhere” OS fragmentation •Create continuous integration system •Perform testing using various devices Network environment •Perform testing using WiFi, 3G network •Perform usability testing •Perform security testing •Perform random testing Mobile Testing Best Practices distilled
  • Agile Testing Expertise
  • Agile Testing Best Practices • • • • • • Test Driven Development : Use of Rspec, Cucumber, Selenium, Sauce Labs, Unit Test frameworks (jUnit, TestNG, spork and watchr) to make the code more maintainable, robust and bug free. Continuous Integration: – Use of Teamcity CI server to help prevent integration problems. – Git for source control Code Metrics and Performance benchmarks: – Measure quality of code to provide better insights into the code quality. – Use of tools like rubocop, rails_best_practices, metric_fu,mini_profiler and brakeman to benchmark the page loads and optimize them to the fullest. Agile Project Management Tools: – Use of Agile project management tools like Redmine to track and manage our agile projects and ensure delivery. – Follow Scrum practices. UI Test Automation: Use of Selenium / Sauce based Test Automation frameworks to automate end user testing Cloud best practices: AWS Consulting partner with a great understanding of cost drivers on the Cloud. Agile is in our DNA
  • Agile Testing Process Agile is in our DNA
  • Progressive Regression Regression suite development cycle will always be one step behind the product development cycle and it will ensure that existing product features are not impacted by the current development. Agile is in our DNA
  • A Typical QA Environment Development QA Sandbox •Unit Testing Manual testing of •Features •Bug fixes •Patches •Hotfixes Regression & Load Test Regression test •Features •Components •Functionalities Detailed Load Test Security Test Pre-production environment Regression test with •Existing configuration •Existing data Minimal Load Test Isolation of Test Environments and Well-defined Gates Production
  • Tools / Technologies QA Activity Tools Used Test Management Mercury Test Director, Rational Test Manager, Visual Studio 2010, Borland Caliber RM, Quality Center, StarTeam. Test Automation Tools (Std / Commercial) QTP, WinRunner, LoadRunner, Visual Studio Tests, SilkTest, Rational Test Test Automation Tools (open source) Selenium, Watir Functional Testing Tools (open source) Fit, FitNesse, Cucumber Unit Testing Frameworks JUnit, NUnit, SpringUnit, GrailsUnit Test, PHPUnit Issue Tracking BugZilla, Rational ClearQuest, JIRA, Visual Studio TFS Code Management CVS, PVCS, SVN, Rational ClearCase, VSS, MS TFS, Git, Perforce Build Automation Continuum, Maven, Make, Ant, Cruise Control, Nant, Cruise Control.NET, Visual Studio TFS Performance Test Tool Apache JMeter, LoadRunner, Visual Studio Load Testing, WebLoad, SilkPerformer, OpenSTA
  • Automated Testing using Selenium and other Innovative Frameworks
  • Selenium Automation Experience • Actively deployed Selenium as automation tool of choice across 75% of our • • • • EDCs.(Extended Development Centers) Strong Java/J2EE based test automation experience. Developed our own Selenium-based automation framework using Selenium, TestNG, jUnit, ANT integrating all best practices. Java Developer resources assigned to Selenium development with experience in OOAD, Agile development, etc. Integrated Selenium into: • Continuous Integration servers • Build, QA and Release processes. • Daily email alerts and notification system. We have developed our own Selenium-based automation framework
  • Selenium + TestNG Based Automation - Key Highlights • Modularized Test Suites and Test • • • • Scripts with automated test bed set up. Backed by Selenium RC Server for Test scripting in standard languages like Java, Python, Ruby. Integrated with TestNG, Junit for easy grouping of test suites and test scripts. Integration for automated build of the entire Test Automation Project. Automated generation and mailing of the HTML reports. Automation with Selenium + TestNG Release Candidate
  • Innovative Testing Framework using Fitnesse, Xebium & Monkeytalk • The idea was to create an environment where a Business Analyst can understand what a Test Engineer is testing and so can the customer. To create an environment where customers or Business Analysts should be able to create their own acceptance test cases with little or no help from the test engineer. • We found out that most of the components were already in place and just needed a glue to fit them together. Fitnesse, Xebium and Monkeytalk were what we bumped into. • More information in our blog here. Automation with Fitnesse, Xebium & Monkeytalk Release Candidate
  • Comprehensive Independent Testing Capabilities We have invested in People, Processes, Tools & Partnerships to provide comprehensive, ROI-oriented, Independent Testing Services that meets your stakeholder needs
  • Case Studies
  • Case Study – AppDynamics EDC An Application Performance Management Product • AppDynamics is an application performance measurement tool, monitoring JVM's(Java) and CLRs(.NET) in production. • Supports applications across a wide range of technologies and platforms. • The solution helps to reduce mean-time-to-resolution by up to 90%. • Started in 2008 in California, AppDynamics is a funded start-up.
  • AppDynamics EDC - The Customer Need Performance Testing Functional Testing • The Product's one of the many USP's is the very low overhead(2%). Measurement of the performance of any new build is immensely important. • The product has to support applications on a combination of technologies. Each and every functionality need to be tested before the release. Automation Framework Development • A large pool of test cases has been created till date. An automation framework has to be developed that will incorporate testing on these test cases. Proof of Concept Applications • To gain confidence of the customer, a proof of concept demonstrating the capabilities of the product has to be created.
  • AppDynamics EDC - The Solution … (1) Performance Testing • The Product's one of the many USP's is the very low overhead it has(2%). Measurement of the performance of any new build is immensely important. Automation Framework Development • The product has to support applications on a combination of technologies. Each and every functionality need to be tested before the release. Neev created an automation framework that is used to obtain the •overhead addedtestagents has been created till date. An A large pool of by cases running on JVM’s and CLR’s. automation framework has to be developed that will incorporate testing on these test cases. Proof of Concept Applications • To gain confidence of the customer, a proof of concept demonstrating the capabilities of the product has to be created. Functional Testing
  • AppDynamics EDC -The Solution …. (2) Performance Testing Functional Testing • The Product's one of the many USP's is the very low overhead it has(2%). Measurement of the performance of any new build is immensely important. • The product has to support applications on a combination of technologies. Each and every functionality need to be tested before the release. • A large pool of test cases has been created till date. An Neev applications a Automation Framework created test framework has using developed that will to be combination automation of technologies. These applications Development incorporate testing on these test cases. are employed on a daily basis to perform a rigorous test on the product features. For instance, an To gain confidence ofJava customer, a proof of concept • application to test the Messaging Proof of Concept Service, which would run onthe capabilities of the product has to be demonstrating Jboss with Cassandra Applications back-end created. as
  • AppDynamics EDC - The Solution …. (3) • The Product's one of the many USP's is the very low A section focused on overhead Performance Testing of Neev teamitishas(2%). Measurement of the performance building a framework, which iswould of any new build immensely important. facilitate the automation of test cases. This brought down the sanity & • The product has to support applications on a regression testing period significantly. combination of technologies. Each and every Functional Testing functionality need to be tested before the release. Automation Framework Development • A large pool of test cases has been created till date. An automation framework has to be developed that will incorporate testing on these test cases. Proof of Concept Applications • To gain confidence of the customer, a proof of concept demonstrating the capabilities of the product has to be created.
  • AppDynamics EDC - The Solution …. (4) Performance Testing • The Product's one of the many USP's is the very low overhead it has(2%). Measurement of the performance of any new build is immensely important. Neev develops an application specific to a potential • The product has to support applications on a customer. The idea is to simulate the combination of technologies. Each Functional Testing production environment of the and every customer, functionality need to be tested before the release. and then demonstrate the product's prowess and capabilities in that environment. of test cases has Automation Framework • A large pool framework has tobeen created till date. An automation be developed that will Development incorporate testing on these test cases. Proof of Concept Applications • To gain confidence of the customer, a proof of concept demonstrating the capabilities of the product has to be created.
  • AppDynamics EDC - A typical day for the Neev team Performance Testing POCs as & when required Automation Testing Regression Tests followed by Sanity Testing
  • AppDynamics EDC - Our journey so far …
  • Case Study – eMids Selenium Automation Intervention eMids was looking for QA partner to automate Regression Tests for an application which they were developing for a reputed health-care organization.  Constraints – Cost, Improve Coverage, Reduce turnaround time, Predictable build quality, Scalable framework, Reliable regression test runs.  Neev deployed its Selenium framework with Java / TestNG for automation which was completely Open Source compared to other solutions which were License based.   Neev covered all the 7 modules of the application by automating more than 300 test cases.  In the process of automation Neev uncovered more than 30 new bugs. The process improved the turn around time of QA and in return improved the productivity by 60%.  No. Of Modules No. of Test Cases Time to Automate Duration of Automated Test Run 7 300+ 4 weeks 50 mins
  • eMids EDC Team Structure Offshore Onsite Project Sponsor (Client) Project Manager Onsite Project Coordinator QA Lead QA 1 (Selenium) QA 3 (Selenium) QA 2 (Selenium) QA 4 (Selenium)
  • Case Study – eMids Key Challenges • Short Term Intervention Program   Application was in production. No major feature changes were expected. Customer wanted to reduce the periodic regression test cycle time by at least 50%.  • Focused Short Term Regression Test Automation intervention program. 7 key modules were identified. Close to 300 test cases were automated within a short period of time. No documentation   • Detailed Documentation of the application feature description was not available. For the 7 modules identified as candidates for automation, the team performed a thorough analysis and documented all key test cases. The test cases and scenarios were signed off by the customer. Zero Prior Automation  As there were no automated cases, the team started by developing an Automation Framework using Selenium and jUnit, that can be flexible, extensible and maintainable.  Test Cases were organized into a comprehensive suite which can be triggered using an ANT target during build time. Thus, every time a new build was generated, the entire automation suite was executed and the results were recorded and analyzed.
  • Cloud-based Mobile Testing for Tripflick Solution Highlights • 'TripFlick' is a Singapore-based tourist information services company aspiring to become a global leader in the information services market for the tourism industry. • Perfecto Mobile is a global provider of cloudbased testing, automation and monitoring solutions for mobile applications and websites utilizing a wide selection of REAL and emulated mobile devices. • The mobile market is extremely fragmented and dynamic. At any point in time, there are dozens of devices which are relevant to the target market. Thus, we had to test on a number of devices. • Neev utilized services of Perfecto Mobile for its client 'TripFlick' to ensure the quality of their mobile app before launching. • Neev integrated services of Perfecto mobile for 'TripFlick' and tested Tripflick app in 30+ Devices.
  • Testing a Data Encryption Software to Perfection Solution Highlights • The client, based in the US, is a provider of data encryption solutions for customer-sensitive data. It has provided security solutions to many Fortune 1000 companies. • The encryption software was complex and had multiple features and ran on multiple versions of databases and operating systems. Comprehensive, efficient and “streamlined” automation test scripts were required for debugging. • 11 different flavors of Microsoft Windows OS, more than 30 versions of SQL, FoxPro, MSAccess Databases and 8 different algorithms were used by Neev in the rigorous testing of the encryption software. These scenarios were then translated into automation test scripts which simulate actual user experience. Neev modified the test scripts so that the dynamic parameters were isolated in a separate script and the actual functionality retained in the main script.
  • About Neev Web Mobile Magento eCommerce SaaS Applications Video Streaming Portals Rich Internet Apps Custom Development iPhone Android Windows Phone 7 HTML5 Apps Cloud AWS Consulting Partner Rackspace Joyent Heroku Google App Engine Key Company Highlights 250+ team with experience in managing offshore, distributed development. Neev Technologies established in Jan ’05 User Interface Design and User Experience Design VC Funding in 2009 By Basil Partners Performance Consulting Practices Part of Publicis Groupe Quality Assurance & Testing Outsourced Product Development Member of NASSCOM. Offices at Bangalore and Pune.
  • Neev Project Methodology Project Management Tools Redmine Jira/Trac Deployment Tools Jenkins Emma/Cobertura QA Tools Selenium Jmock Knowledge Capture Tools Neev Hub QA to Staging to Production environments Daily Stand-ups
  • The Neev Edge • End-to-end consultative approach for software solutions through needs assessment, process consulting and strategic advice. • Internal QMS are ISO 9001-2008 certified and CMM level 3 compliant. • Continuous process and service level improvements through deployment of best-ofbreed processes and technologies. • International Standards and best practices on Project Management including PMI, ISO and Prince-2. • Proven EDC Model of delivery to provide predictable results. • Scrum based Agile development methodology.
  • A few Clients
  • Partnerships
  • sales@neevtech.com Neev Information Technologies Pvt. Ltd. India - Bangalore India - Pune The Estate, # 121,6th Floor, #13 L’Square, 3rd Floor Dickenson Road Parihar Chowk, Aundh, Bangalore-560042 Pune – 411007. Phone :+91 80 25594416 Phone : +91-64103338 For more info on our offerings, visit www.neevtech.com