Skip to main content
UploadLanguage (EN)Support
BusinessMobileSocial MediaMarketingTechnologyArt & PhotosCareerDesignEducationPresentations & Public SpeakingGovernment & NonprofitHealthcareInternetLawLeadership & ManagementAutomotiveEngineeringSoftwareRecruiting & HRRetailSalesServicesScienceSmall Business & EntrepreneurshipFoodEnvironmentEconomy & FinanceData & AnalyticsInvestor RelationsSportsSpiritualNews & PoliticsTravelSelf ImprovementReal EstateEntertainment & HumorHealth & MedicineDevices & HardwareLifestyle
RTTS' QuerySurge Software Division, profile picture
Uploaded byRTTS' QuerySurge Software Division
1,501,655 views

QuerySurge AI webinar

QuerySurge is an AI-powered data testing solution designed to improve data quality amidst rising data complexity, addressing the significant costs associated with poor data management. It facilitates automated mapping and testing processes, allowing organizations to validate and analyze large volumes of data more efficiently. The integration of AI reduces the time and skill level required for data testing, promising substantial cost savings for businesses dealing with extensive data mappings.

Software◦
Related topics:
Generative AI•Automated Testing•Test Automation Tools•
Downloaded 35 times
QuerySurge™ the smart Data Testing solution powered by AI QuerySurgeTM ™ Bill Hayduk CEO Mike Calabrese Senior Solutions Architect Webinar Chris Thompson Senior Solutions Architect
A.I. Artificial Intelligence Definition: computer systems able to perform tasks that normally require human intelligence
A.I. Artificial Intelligence Definition: computer systems able to perform tasks that normally require human intelligence
5 Artificial Intelligence in the News QuerySurge Launches Generative AI Solution
We now live in a Data & Analytics economy #Shift-Happens QuerySurge™ a software division of
“Poor data quality now costs organizations an average of $14 million annually” - Gartner #Bad-Data QuerySurge™ a software division of
a software division of QuerySurge™ “79% of organizations have more than 100 data sources with 30% using more than 1,000 sources.” - IDC #Data-Is-Growing-Exponentially
a software division of QuerySurge™ “AI is a tool. The choice about how it gets deployed is ours.” - Oren Etzioni founding CEO of the Allen Institute for Artificial Intelligence #AI-amplifies-software
QuerySurge™ a software division of QuerySurgeTM
Data Warehouse ETL Data Warehouse ETL Mainframe Business Intelligence & Analytics C-level Executives are using BI & Analytics to make critical business decisions ETL Typical data issue areas The Executive Office and Critical Data
QuerySurge connects to any 2 points at one time Compares every data set to find anomalies …and provides Data Validation Analytics How QuerySurgeTM Works Source Data Target Data • Databases • Data Warehouses • Flat Files & Excel • JSON files • Web Services • Mainframe files • Data Warehouses • Big Data Stores (Hadoop & NoSQL) • Business Intelligence reports Source Data Target Data
Skill Level Test Strategy Design Effort Business Rules Intermediate create with SQL Moderate medium /fast ETL Logic & Transformations Intermediate/ Advanced create with SQL Moderate/ Difficult time-consuming Table-to-Table & Column-to-Column Compares Basic Minimal incredibly fast Row Count Compares Basic Minimal incredibly fast Test Design Strategy
14 QuerySurge™ a software division of Integrating AI into QuerySurge
What is a Mapping Document? • Also known as a Source-to-Target Map • It’s THE critical element required to efficiently plan data movement • Defines the Extract, Transform, Load (ETL) process It Captures: ✓ Business rules ✓ Data flow mapping ✓ Data movement requirements It Specifies: ▪ Source input definition ▪ Target/output details ▪ Business & data transformation rules ▪ Absolute & Optional data quality requirements 15 Data Mappings Schema Mapping Doc What is Data Mapping? It’s the process of matching fields from one database to another
Roles Tasks Timeline Data Analyst Data Architect ETL Developer Data / ETL Tester Models and builds target data store Reviews Mapping Document Maintains Target data Store Creates 2 tests for each mapping w/SQL editor Reviews Mapping Document Dumps results of tests to 2 Excel files Compares Excel files by eye Executes tests Determines Requirements Creates & maintains Mapping Document iterate iterate Reviews Mapping Document Extracts & Loads data or Extracts, Transforms & Loads data into new store Builds data movement logic where QuerySurge™ typically fits Typical Data Movement Process (without automated solution) 16
Consensus: • 81% said their teams use formal mapping documents • 78% of those teams with mappings store them in Excel (the next highest answer was a 3rd party vendor tool at 14%) 1st Question: Does your team use formal mapping documents and if yes, in what form do you store the information? 1Poll conducted by RTTS on targeted LinkedIn groups We conducted a survey1 on Linkedin of 380+ Data Analysts, Data Architects & ETL Developers and asked 2 questions about mappings: 2nd question: Approximately how many mappings are in your typical Data Warehouse project? Consensus: • 68% have more than 250 mappings • 14% have between 100 and 250 mappings 17 Survey of Data Experts
Test Process without automated ETL testing solution Test Process with QuerySurge + QuerySurge AI Test process with automated ETL testing solution Integrating with QuerySurge AI Skilled resource creates 2 SQL tests for each mapping (only DB to DB compares) Dump results of tests to 2 Excel files Compare Excel files by eye & create reports Execute tests Testing solution compares results faster & provides reports Execute tests Skilled resource creates 2 SQL tests for each mapping QuerySurge compares results up to 1,000x faster & provides Data Intelligence reports Execute tests Any resource converts all mappings in minutes Time Sinkhole Time Sinkhole Time Sinkhole Time Savings Immense Time Savings Immense Time Savings
19 QuerySurge™ a software division of QuerySurge Survey & ROI Metrics: • A data mapping of average complexity ≈ 1 hour of time to create data tests • To create data tests for 1,000 mappings ≈ 1,000 hours • 1,000 hours * $75/hour = $75,000 • QuerySurge AI can translate 200 mappings in 1 hour or 1,000 mappings in 5 hours • 5 hours * $75/hour = $375 Survey of 530 QuerySurge prospects and customers: • 20% have > 1,000 mappings • 10% have > 5,000 mappings
20 QuerySurge™ a software division of Integrating QuerySurge AI 2 Use Cases 1)Initial mapping upload: Bulk upload of 100’s of mappings at once 2) Incremental mapping uploads: One or more mappings at a time
21 QuerySurge™ a software division of Mapping Uploads: Initial & Incremental Initial Mapping Document (100s of source-to-target data requirements) QuerySurge QueryPairs (SQL tests pulling data from source & target data stores for comparison) Incremental Mapping Upload (single source-to-target data requirement) QuerySurge AI Pulls mappings into AI model, converts to SQL and injects into QuerySurge
22 Release date: 22 ROI: • Dramatic time savings • Reduced skillset requirements Private Demo: Proof of Concept:
QuerySurgeTM a software division of