Data Quality Technical Architecture

3,023 views

Published on

  • Be the first to comment

Data Quality Technical Architecture

  1. 1. Data Quality Technical Architecture Components
  2. 2. Contents <ul><li>Data Quality Best-in-Class Properties </li></ul><ul><li>Data Quality Technical Architecture </li></ul><ul><ul><li>Core Functional Components </li></ul></ul><ul><ul><li>Interfacing Components </li></ul></ul><ul><ul><li>Non-functional Components </li></ul></ul><ul><li>Data Quality Invocation Flow Example </li></ul><ul><li>Data Quality Technical Architecture Foundational Systems </li></ul><ul><li>Data Quality Technical Architecture Products / Technologies </li></ul><ul><li>Mapping of architecture concepts to Data Quality Technical Architecture </li></ul>
  3. 3. Data Quality Best-in-Class Properties <ul><li>High-performing </li></ul><ul><ul><li>Fast response times for human users and high throughput for non-human users within given service level agreements </li></ul></ul><ul><li>Reliable and recoverable </li></ul><ul><ul><li>All data and process changes are transactional secured and can be recovered to the last consistent state after any type of failure </li></ul></ul><ul><li>Uniform and consistent </li></ul><ul><ul><li>All similar processing is done in the same way and all processing leads to a consistent system state (including data and processes) </li></ul></ul><ul><li>Dynamically changeable and extensible </li></ul><ul><ul><li>Changes can be applied dynamically to accommodate new business as well as system requirements </li></ul></ul><ul><li>Minimal and simple </li></ul><ul><ul><li>As few as possible foundational systems and concepts as necessary to implement the overall functionality </li></ul></ul><ul><li>Conceptually sound </li></ul><ul><ul><li>All functionality is based on a conceptual model that reflects the business architecture goals and requirements </li></ul></ul>
  4. 4. Data Quality Architecture Concepts <ul><li>Architecture Concept </li></ul><ul><ul><li>Service </li></ul></ul><ul><ul><li>Workflow </li></ul></ul><ul><ul><li>Business and Data Rules </li></ul></ul><ul><ul><li>Data and Data Flow </li></ul></ul><ul><ul><li>External services and workflows </li></ul></ul><ul><ul><li>External Services </li></ul></ul><ul><li>Architecture Component </li></ul><ul><ul><li>Web Service Management </li></ul></ul><ul><ul><li>Workflow Management </li></ul></ul><ul><ul><li>Business Rule Management </li></ul></ul><ul><ul><li>Data Management </li></ul></ul><ul><ul><li>Packaged Application Management </li></ul></ul><ul><ul><li>External Invocation Management </li></ul></ul>The 1:1 relationship of architectural concepts and architectural components is intentional
  5. 5. DQ Technical Architecture – Core Functional Components Data Storage Data Replication Reference Data Data Flow Data Management Data Access Workflow Access Business Rule Access Packaged Application Management Service Definition Service Execution Service Choreography (Web) Service Management Service Registry Workflow Definition Workflow Execution Workflow Management Business Rule Definition Business Rule Automation Business Rule Management Gateway External Invocation Management Public Service Registry DQ External Interface Management Service Publication Case Management Policy Management
  6. 6. DQ Technical Architecture – Core Functional Components Data Storage Data Replication Reference Data Data Flow Data Management Data Access Workflow Access Business Rule Access Packaged Application Management Service Definition Service Execution Service Choreography (Web) Service Management Service Registry Workflow Definition Workflow Execution Workflow Management Business Rule Definition Business Rule Automation Business Rule Management Gateway External Invocation Management Public Service Registry DQ External Interface Management Service Publication Case Management Policy Management Fundamental Pillars of Production Systems
  7. 7. DQ Technical Architecture – Web Service Management System
  8. 8. DQ Technical Architecture – Workflow Management System
  9. 9. DQ Technical Architecture – Business Rule Management System
  10. 10. DQ Technical Architecture – Data Management System
  11. 11. DQ Technical Architecture – Packaged Application Management Integration of Crystal Report Software Integration of BO/DQ Software
  12. 12. DQ Technical Architecture – External Invocation Management
  13. 13. DQ Services - Components Member Provider Claim Subject Area: Other Service Area: Enrichment Profiling Other De-duping Data Area: Address Name Phone SSN Other TIN Tool Area: BO/DQ Project Crystal Report Other Rules Area: Mandated Rule Business Rule Technology Rule Industry Standard Rule Software Area: Shell Script JAVA Wrapper Other Method Area: Set() Throw() Get() Run()
  14. 14. DQ Rules – Mandated Rules <ul><li>At least one of member ids to access person id if the person id is related to more than one member id. </li></ul><ul><li>The valid coverage contract (policy holder) must be establish before any member added for coverage. </li></ul><ul><li>Provider can have only one license in a state. </li></ul><ul><li>Provider must have TIN. </li></ul><ul><li>If Paper Claim then Paper Claim = (Member) ID </li></ul>
  15. 15. DQ Rules – Business Rules <ul><li>Grievances are to be handled professionally and expeditiously to maintain member satisfaction </li></ul><ul><li>Provider can only be par if he has official agreement with Delta </li></ul><ul><li>If the coverage code changes from Family to Subscriber and Child (from some coverage code that includes spouse to one that eliminates the spouse), then the dropping of that spouse member should occur automatically with the termination date equal to the effective date for the new coverage. </li></ul>
  16. 16. DQ Rules – Technology Rules <ul><li>VSAM Structure as multiple occurrence of same record to accommodate record size can be one record in relational db. In short, duplicate record can stored as unique record in relational db. </li></ul><ul><li>History Cross-check (HCC) Rules are rules that define if a procedure has frequency limits within a specific time period. </li></ul>
  17. 17. DQ Rules – Industry Standard Rules <ul><li>Dental Service of Massachusetts, Inc., (DSM) defines the privacy practices to protect personal health information. </li></ul><ul><li>DSM is required by law to: </li></ul><ul><ul><li>Maintain the privacy of patient health information. </li></ul></ul><ul><ul><li>Provide this notice of company duties and privacy practices. </li></ul></ul><ul><ul><li>Abide by the terms of the notice currently in effect </li></ul></ul><ul><li>DSM Account Information is password-protected for patient privacy and security. </li></ul>
  18. 18. DQ Services – EEP E1 Invocation (As-is) requests executes using processes for has applies invokes invokes Conceptual Member Subject Area: Enrichment Service Area: Data Area: Address Method Area: Run() Tool Area: BO/DQ Project Tool End User Workspace Driver Rules Area: Mandated Rule Software Area: JAVA Wrapper Software Area: Shell Script
  19. 19. DQ Services – Address Standardization (To-be) Address standardization for member data to match zip code with city and state. Conceptual
  20. 20. DQ Services – Address Standardization (To-be) Address standardization for member data to match zip code with city and state. executes using processes for has applies requests invokes Conceptual Member Subject Area: Profiling Service Area: Data Area: Address Method Area: Get() Tool Area: Crystal Report Tool End User Workspace Driver Rules Area: Industry Standard Rule Software Area: Other (SQL)
  21. 21. DQ Services – Mixed Case (To-be) Convert all upper case name to mixed case name Conceptual Draft
  22. 22. DQ Services – Mixed Case (To-be) Convert all upper case name to mixed case name executes using processes for has applies requests invokes Conceptual Draft Provider Subject Area: Enrichment Service Area: Data Area: Name Method Area: Set() Tool Area: BO/DQ Project Tool End User Workspace Driver Rules Area: Business Rules Software Area: Shell/JAVA
  23. 23. DQ Services – Enrichment services <ul><li>Address – Street Address, City, State, Zip, Location </li></ul><ul><li>Contact – Name, Phone Number </li></ul><ul><li>Person – Last Name, First Name, Middle Name and Name Suffix, Social Security Number, TIN </li></ul><ul><li>Other – TBD </li></ul><ul><li>Data Cleansing </li></ul><ul><li>Data Normalization </li></ul>For
  24. 24. Data Acquisition Type – Member <ul><li>Web – B2C </li></ul><ul><li>EDI – B2C </li></ul>
  25. 25. DQ Services – Profiling services <ul><li>Exception Reporting </li></ul><ul><li>Pre Cleansing </li></ul><ul><li>Post Cleansing </li></ul>
  26. 26. DQ Services – De-duping services <ul><li>Address – Street Address, City, State, Zip, Location </li></ul><ul><li>Contact – Name, Phone Number </li></ul><ul><li>Person – Last Name, First Name, Middle Name and Name Suffix, Social Security Number, TIN, etc </li></ul><ul><li>Other – TBD </li></ul>

×