Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Leveraging HPE ALM & QuerySurge to test HPE Vertica

7,786 views

Published on

Are you using HPE ALM or Quality Center (QC) for your requirements gathering and test management?

RTTS, an alliance partner of HPE and a member of HPE’s Big Data community, can show you how to use ALM/QC and RTTS’ QuerySurge to effectively manage your data validation & testing of Vertica (or any data warehouse).

In this webinar video you will see:
- a custom view of ALM to store source-to-target mappings
- data validation tests in QuerySurge
- the execution of QuerySurge tests from ALM
- the results of data validation tests stored in ALM
- custom ALM reports that show data validation coverage of Vertica
how we improve your data quality while reducing your costs & risks

Presented by:

Bill Hayduk, Founder & CEO of RTTS, the developers of QuerySurge
Chris Thompson, Senior Domain Expert, Big Data testing

To learn more about QuerySurge, visit www.QuerySurge.com

Published in: Software
  • Be the first to comment

  • Be the first to like this

Leveraging HPE ALM & QuerySurge to test HPE Vertica

  1. 1. WEBINAR Leveraging ALM & QuerySurge to test Vertica Bill Hayduk Founder & CEO RTTS Chris Thompson Senior Domain Expert data quality & testing QuerySurge™ a software division of
  2. 2. • a custom view of ALM to store source-to-target mappings • data validation tests in QuerySurge • The execution of QuerySurge tests from ALM • The results of data validation tests stored in ALM • custom ALM reports that show data validation coverage of Vertica • how we improve your data quality while reducing your costs & risks QuerySurge™ a software division of WEBINAR Here is what you will see:
  3. 3. QuerySurge™ About FACTS Founded: 1996 Location: New York, NY Software Division: QuerySurge Customer profile: • Fortune 1000 • 700+ customers Alliance Partners: IBM, Microsoft, HPE, Oracle, Teradata, HortonWorks, Cloudera, MongoDB RTTS is the parent company of QuerySurge and is the premier software & services firm in the QA & Testing space that specializes in test automation a software division of
  4. 4. Testing a Data Warehouse QuerySurge™ a software division of
  5. 5. Business Intelligence & Analytics CxOs are using Business Intelligence & Analytics to make critical business decisions – with the assumption that the underlying data is fine. “The average organization loses $14.2 million annually through poor Data Quality.” - Gartner ETL Data Architecture BUSINESS CASE: Executive Office & Critical Data potential problem areas Mainframe ETL
  6. 6. Extract Data Warehouse & the ETL process Source Data ETL Process Target Data Warehouse/ Data Mart Transform Load Mainframe QuerySurge™ a software division of
  7. 7. Which Data Goes Where? Source-to-Target Mapping doc Elements of Mapping Document • Attributes of original source data (table name, column name, source type) • Attributes of the target data store (table name, column name, source type) • Transformation rules, if any (aggregation, combining records, etc.) Definition: Source-to-Target Mapping • Specification or requirements doc that shows how data in one system is mapped to another system • Typically created and stored in Word or Excel QuerySurge™ a software division of Issues with Mapping Document & Testing • No easy way to link mappings to tests for tracability • No easy way to store test results • No easy way to report on data testing coverage
  8. 8. Data Process: Developer & Tester Developer: Codes data movement based on Mapping Requirements Tester: Tests data movement based on Mapping Requirements Data Mart ETL Source Data ETL Process Target DWH Mainframe ETL ETL Process
  9. 9. About… Application Lifecycle Management QuerySurge™
  10. 10. About HPEVertica HPE Vertica is one of the most advanced SQL database analytics portfolio built from the very first line of code to address the most demanding Big Data analytics initiatives. Vertica's column-oriented storage approach significantly increases query performance in data warehouses About HPE ALM Application Lifecycle Management (ALM) is the industry standard for modern quality management. It is a centralized management system that provides reporting and traceability throughout the application delivery lifecycle.
  11. 11. is the leading Data Testing solution for automated testing & validation of Big Data and Data Warehouses QuerySurge Use Cases About QuerySurge
  12. 12. QuerySurge™ Automate the entire testing cycle  Automate the launch, tests, comparison, auto-emailed results Query Wizards - no coding needed  Query Wizards can automate about 80% of your tests Test across different platforms  EDWH, Hadoop, NoSQL, database, flat file, XML, mainframe Analyze & Collaborate  Data Health dashboard, shared tests & auto-emailed reports Verify more data & do it quickly  verifies up to 100% of all data up to 1,000 x faster Integrate for Continuous Delivery (DevOps)  Integrates with most Build, ETL & QA management software a software division of the QuerySurge advantage
  13. 13. Web-based… Installs on... Linux Connects to… …and any JDBC compliant data source QuerySurge™ QuerySurge Controller QuerySurge Server QuerySurge Agents Flat Files a software division of QuerySurge Architecture
  14. 14. SQL HQL SQL HQL SQL SQL  QS pulls data from data sources  QS pulls data from target data store  QS compares data quickly  QS generates reports, auto-emails Reports, Data Health Dashboard, auto emails Source Data • Databases • Data Warehouses • Data Marts Flat Files • Fixed Width • Delimited • Excel Mainframe Target Data Big Data stores • Hadoop • NoSQL Data Warehouses How QuerySurge Works
  15. 15. QuerySurge™ QuerySurge Modules Design Library SchedulingRun Dashboard Deep-Dive Reporting Data Health Dashboard Query Wizards a software division of
  16. 16. Fast and Easy. No programming needed. QuerySurge™ • Perform 80% of all data tests with no SQL coding • Opens up testing to novices & non-technical members • Speeds up testing for skilled coders • provides a huge Return-On-Investment a software division of QuerySurge Modules
  17. 17. QuerySurge™ a software division of QuerySurge Modules
  18. 18. Design Library • Create custom Query Pairs (source & target SQLs for tests that have transformations) Scheduling  Build groups of Query Pairs  Schedule Test Runs • Run immediately • Run at set date/time • Have event kick it off ™ a software division of QuerySurge Modules
  19. 19. Deep-Dive Reporting  Examine and automatically email test results Run Dashboard  View real-time execution  Analyze real-time results ™ a software division of QuerySurge Modules
  20. 20. QuerySurge™ • view data reliability & pass rate • add, move, filter, zoom-in on any data widget & underlying data • verify build success or failure a software division of QuerySurge Modules
  21. 21. QuerySurge™  Drive QuerySurge execution from your Test Management Solution  See QuerySurge Pass/Fail results in your Test Management solution  Click link to drill into detailed results in QuerySurge Integration with leading Test Management Solutions • HPE ALM (Quality Center) • Microsoft Team Foundation Server • IBM Rational Quality Manager a software division of QuerySurge Test Management Connectors
  22. 22. QuerySurge & DevOps: Continuous Integration QuerySurge™ Automated Testing Automated Reporting Automated Launch Data Integration/ ETL solutions QuerySurge™ and many others… email report and many others… QuerySurge™ Build/Configuration solutions email report Test Management solutions QuerySurge™ email report a software division of
  23. 23. USE CASE QuerySurge™ Testing VERTICA using ALM & QuerySurge a software division of
  24. 24. USE CASE: Data Process for Developer & Tester Developer: Codes data movement based on Mapping Requirements Tester: Tests data movement based on Mapping Requirements ETL Source Data ETL Process Target DWH
  25. 25. Target Data ALM Custom-built Mapping Requirements SQL SQL SQL SQL SQL SQL Schedule ALM to kick off QuerySurge through our API QuerySurge automatically reports back all data failures ALM Custom-built Issue Tracking & Coverage reports QuerySurge runs unattended • executing all tests • comparing all data • compiling reports Testing VERTICA using ALM & QuerySurge Source Data
  26. 26. Custom-built Source-to-Target Data Mapping report Target HP VerticaSource MySQL
  27. 27. Custom-built Data Mappings Module
  28. 28. Custom-built Data Mapping Info tab: Data Specification details Source MySQL Target HP Vertica
  29. 29. Custom-built Mapping Summary Coverage by Table
  30. 30. 2/9/2017 30 Custom-built Mapping Summary Coverage by Status
  31. 31. Demonstration built by QuerySurge™ Chris Thompson Senior Domain Expert data quality & testing a software division of Want to see the video of the webinar? Go to: https://youtu.be/bKtUPtva9cE QuerySurge™

×