Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Virdatint Distributed Data Virtualization Basics_2.6

310 views

Published on

Virdatint’s unique comprehensive Distributed Data Virtualization, Integration, Analytics and Security platform, bridges the gap between customer-facing operational systems and MDM, CRM, BPM, BI and analytics in near real-time, to grow revenue and decrease costs. Because it leverages existing architectures and systems, leaves data in-place, and offers a unique approach to indexing, link mapping and analysis, implementation is rapid and the resulting operational costs are low.

Published in: Data & Analytics
  • Be the first to comment

  • Be the first to like this

Virdatint Distributed Data Virtualization Basics_2.6

  1. 1. Virtual distributed data virtualization, integration, analytics and security platform Revision 2.6 Copyright 2015 Virdatint, Inc. 1 Distributed Data Virtualization Platform (DDVP) Basics and Options September 2015 (Best viewed in slideshow mode)
  2. 2. Virtual distributed data virtualization, integration, analytics and security platform “It’s all about the data” and “Data has a life!” “ and Virdatint takes a highly data-driven approach: Revision 2.6 Copyright 2015 Virdatint, Inc. 2 Virtual data virtualization Virtual data federation Virtual data integration
  3. 3. Virtual distributed data virtualization, integration, analytics and security platform What is Virdatint, Inc.? • Recently formed 100% owned subsidiary of WhamTech, Inc., which has been around for over 15 years −Privately held and US-based −Unique technologies • Virtual data integration and analytics platform for enterprise and any other data, Big Data, cybersecurity, data security and MDM • WhamTech past DoD and intel work for large government system integrators, e.g., BAH, Boeing, Lockheed Martin and Northrop Grumman • WhamTech past commercial work for EMC and others • Virdatint recent and current work for CSC and others, with a focus on healthcare and financial services Revision 2.6 Copyright 2015 Virdatint, Inc. 3
  4. 4. Virtual distributed data virtualization, integration, analytics and security platform Virdatint takes a highly data-driven approach Discovery Source – almost any Profiling Classification/categorization Quality and standardization Indexing and query processing Virtualization Federation Link mapping/Link Indexes™ Event processing Event correlation Security Master data management Integration Interoperability BI and analytics Link analytics Standard drivers and SQL Revision 2.6 Copyright 2015 Virdatint, Inc. 4 Key Differentiators Real-time to batch and automated (as much as possible) virtual data:
  5. 5. Virtual distributed data virtualization, integration, analytics and security platform Virdatint key differentiators expanded (1 of 2) 1. Data remains in sources – not copied or moved 2. Any data source – mainframes, legacy, databases, office documents, Web, social media, streaming, Hadoop, structured, unstructured, semi-structured, etc. 3. Automation as much as possible – detect new devices, and discover data sources and data, e.g., for IoT and networks 4. Data quality addressed before any data access – cleansed, transformed and standardized indexes, and results 5. Own indexes, indexed views and query processing, as part of adapters to multiple data sources – parallel distributed processing – linearly scalable – maintained in real-time using changed data capture, incrementally and batch 6. Event processing (partner with Oracle®) Revision 2.6 Copyright 2015 Virdatint, Inc. 5
  6. 6. Virtual distributed data virtualization, integration, analytics and security platform Virdatint key differentiators expanded (2 of 2) 7. Link mapping finds relationships between entities within and across data sources and captures them in Link Indexes™ using (i) exact, (ii) fuzzy and (iii) composite weighted probability matches 8. Link Indexes used to (i) locate and read entities for master data, (ii) execute degrees of separation queries, (iii) accelerate joins, (iv) represent ontological/semantic models and (v) perform link analytics 9. Seamless combination of master data with operational, other enterprise and external data systems, and of use by any application 10.Link analytics for single customer/patient views, network visualization, fraud detection, de-bottlenecking, social media analysis, etc. 11.Highly interactive browser-based query, results and link visualization tool 12.New support for active CRM, BPM, individual analytics and machine learning Revision 2.6 Copyright 2015 Virdatint, Inc. 6
  7. 7. Virtual distributed data virtualization, integration, analytics and security platform Revision 2.6 Copyright 2015 Virdatint, Inc. 7 Created Stored Copied Quality/improved Stored Copied Quality/improvedStored Copied Quality/improved Stored Indexed Related Reported Analyzed Acted on Operational Data Store (ODS) Data Warehouse (ETL and DW) Data Mart (DM)/ Analytics Database/ Link Analysis- Graph Database Log/Transaction System Indexed Indexed Discarded/retained Conventional data life-cycle Data copied multiple times
  8. 8. Virtual distributed data virtualization, integration, analytics and security platform Revision 2.6 Copyright 2015 Virdatint, Inc. 8 Created Stored Quality/improved Stored Quality/improvedStored Quality/improved Stored Indexed Related Reported Analyzed Acted on Big Data Lake/Reservoir (similar to ODS) Big Data Refinery (similar to ETL) Analytics Database/ Link Analysis- Graph Database Log/Transaction System Indexed Indexed Discarded/retained Big Data life-cycle (similar to a conventional data life-cycle) Copied Copied Copied Data copied multiple times
  9. 9. Virtual distributed data virtualization, integration, analytics and security platform Revision 2.6 Copyright 2015 Virdatint, Inc. 9 Created Stored Copied Quality/improved Stored Copied Quality/improvedStored Copied Quality/improved Stored Indexed Related Reported Analyzed Acted on Indexed Indexed Discarded/retained Created Stored Reported Analyzed Acted on Discarded/retained Quality/improved Indexed Related Virdatint Distributed Data Virtualization Platform Discarded/retained Virdatint eliminates most conventional data life-cycle stages Capabilities at the DDVP support applications
  10. 10. Virtual distributed data virtualization, integration, analytics and security platform Revision 2.6 Copyright 2015 Virdatint, Inc. 10 Device/host discovery Data source discovery Data quality/ transformation Query processing Reported Analyzed Acted on Discarded/retained Virdatint DDVP data processes Data discovery and profiling Data and link indexing Results retrieval (Results data quality/ transformation) Note: Data not copied or moved - only results retrieved
  11. 11. Virtual distributed data virtualization, integration, analytics and security platform Solutions to seven challenging problems in one platform Revision 2.6 Copyright 2015 Virdatint, Inc. 11 Virtual Interactive Link Analysis and Visualization Virtual BI/ Analytics Distributed Data Virtualization (and Federation, Integration and Interoperability) Platform Virtual MDM Virtual Cybersecurity Virtual Data Security Virtual Event Processing Applications Basic Product Optional Modules Click on and off the darker blue graphics to view descriptions or click elsewhere to advance presentation Automated device, data source and data discovery, profiling, quality, mapping, indexing, virtualization, federation, integration and interoperability as basis for capability support modules and applications Track significant changes occurring in data Seamlessly combine with operational/transactional data and maintain in near real-time Defend and protect data of value (i) as it is created, (ii) at rest in the source, (iii) in transit, (iv) at the recipient and (v) after no longer needed Virtual and materialized real-time updateable hierarchical indexed views, text analytics including entity extraction, and locally executed algorithms Indexed federated log and other data source access, including automated anomaly detection and automated event correlation Link analysis/graph database for almost any type of analytics, including virtual MDM (master patient index), cybersecurity and data security
  12. 12. Virtual distributed data virtualization, integration, analytics and security platform Solutions to seven challenging problems in one platform Revision 2.6 Copyright 2015 Virdatint, Inc. 12 Virtual Interactive Link Analysis and Visualization Virtual BI/ Analytics Distributed Data Virtualization (and Federation, Integration and Interoperability) Platform Virtual MDM Virtual Cybersecurity Virtual Data Security Virtual Event Processing Applications Basic Product Optional Modules
  13. 13. Virtual distributed data virtualization, integration, analytics and security platform Seven solutions to challenging problems in one platform 1. DISTRIBUTED DATA VIRTUALIZATION PLATFORM (DDVP) for automated device, data source and data discovery, profiling, quality, mapping, indexing, virtualization, federation, integration and interoperability as basis for capability support modules and applications 2. EXTEND DDVP WITH EVENT PROCESSING to keep track of significant changes occurring in data 3. EXTEND DDVP WITH DISTRIBUTED (preferably HYBRID) MDM to seamlessly combine with operational/transactional data and maintain in near real-time 4. EXTEND DDVP WITH IMPROVED CYBERSECURITY through indexed federated log and other data source access, including automated anomaly detection and automated event correlation 5. EXTEND DDVP WITH VIRTUAL DATA SECURITY LAYER to defend and protect data of value (i) as it is created, (ii) at rest in the source, (iii) in transit, (iv) at the recipient and (v) after no longer needed 6. EXTEND DDVP WITH BI/ANALYTICS oriented virtual and materialized real-time updateable hierarchical indexed views, text analytics including entity extraction, and locally executed algorithms 7. EXTEND DDVP WITH LINK ANALYSIS (and OEM LINK VISUALIZATION) for link analysis/graph database for almost any type of analytics, including virtual MDM (master patient index), cybersecurity and data security Revision 2.6 Copyright 2015 Virdatint, Inc. 13
  14. 14. Virtual distributed data virtualization, integration, analytics and security platform Platform is decentralized/distributed and indefinitely scalable Revision 2.6 Copyright 2015 Virdatint, Inc. 14 Applications Data Source Data stays in sources - no copying or moving Data SourceData Source
  15. 15. Virtual distributed data virtualization, integration, analytics and security platform How do EIQ Adapters work? Revision 2.6 Copyright 2015 Virdatint, Inc. 15 EIQ Server (sub- Middleware) Data Source Application(s) Data Read, Transform/ clean-up (and Index) Index schema and names same as data source Twelve ways to build and maintain indexes Result-set pointers to data in source Results provided in almost any format Applications / middleware connect with standard drivers or Web Services and SQL*** EIQ Adapter* w/SDM** Multiple other data sources EIQ Indexes User-level access … … Middleware *EIQ SuperAdapter and EIQ TurboAdapter **Standard Data Model – future application-to- SDM query translation ***Future OQL, SPARQL and NoSQL options Data Discovery and raw index- based Data Profiling Develop and test Data Transforms using profiles Queries resolved in the EIQ Adapter and EIQ Indexes Raw results data transformed/cleaned-up from source Network Asset and Device Discovery Metadata Discovery and Semantic Mapping Data Source Discovery Distributed Network Asset, Data Source and Metadata Repository, incl. Data Governance EIQ Federation Server (sub- middleware) w/SDM EIQ Federation Server Indexes do not store data – only queryable representations … … …
  16. 16. Virtual distributed data virtualization, integration, analytics and security platform Example multiple data source configuration Revision 2.6 Copyright 2015 Virdatint, Inc. 16 FIREWALL FIREWALL EIQ Federation Server EIQ Federation Server Social Media Feed Indexes EIQ SuperAdapter EIQ Conventional Adapter 3rd Party AdapterSalesforce Hadoop Indexes EIQ SuperAdapter Mainframe Indexes EIQ SuperAdapter ERP System EIQ Federation Server Application(s) WhamTech JDBC Driver TCP / IP RDBMS Indexes EIQ SuperAdapter
  17. 17. Virtual distributed data virtualization, integration, analytics and security platform Revision 2.6 Copyright 2015 Virdatint, Inc. 17 Location agnostic
  18. 18. Virtual distributed data virtualization, integration, analytics and security platform Revision 2.6 Copyright 2015 Virdatint, Inc. 18 Configuration agnostic
  19. 19. Virtual distributed data virtualization, integration, analytics and security platform The End Revision 2.6 Copyright 2015 Virdatint, Inc. 19

×