© COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
Unstructured Data and Analytics
MarkLogic Data Hub - Healthcare’s Best Data Integration & App Development Platform
Mohamad Thahir
Technologist, Healthcare
& Life Science
SLIDE: 2 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
Healthcare Data Challenges
• 1.2 Billion clinical documents are produced in US each year
• 60% of these contains valuable patient-care information trapped in unstructured format
• Multiple Structures
• Inconsistent/Variable definition
• Multiple Silos
• Technological Innovation – AI, Blockchain, IoT, Cyber Security
SLIDE: 3 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
50LOWER
Compared to other service &
insurance industries … leveraging
unstructured data
High Price, High Volume FFS
Procedures Most Impacted,
Shift to Value-Based Models
Healthcare $355 per record,
$158 avg in other industries
Healthcare Organization Data Challenges:
Retention, Security, Compliance, Growth & Innovation
20REDUCED
PAYMENTS
%MILLION PER
BREACH
$
4 %
SATISFACTION? ? ?
SLIDE: 4 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
60% OF TIME
By data scientists just
wrangling data
NYT
WASTED
In 2016 on data integration
software
Gartner
Of data warehouse projects
is on ETL
TDWI for Informatica
The Massive Cost of Using Traditional Tech with ETL
3.5BILLION IN
SPENDING
$% OF THE
COST80
SLIDE: 5 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
Credentialing
& Contracting
Finance
CM / DM / UM
Enrollment
Marketing
Products & Plans
Claims
Lines-of-
business
The “Next Gen” Solution
§ A flexible, scalable operational database is
critical for a real-time Data Centric
approach
§ Greater convergence between analysis and
operations is critically important to creating
actionable data and better engagement
§ The new Enterprise Pattern is the
Operational Data Hub
A NEW ENTERPRISE INTEGRATION PATTERN
SLIDE: 6 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
The MarkLogic Data Hub Solution
RELATIONAL
DATABASES
MAINFRAMES
FILE SYSTEMS
ANY OTHER
SOURCE
TRANSACTIONAL
APPLICATIONS
ANALYTICAL
APPLICATIONS
DOWNSTREAM
SYSTEMS
An Operational, Transactional & Analytical Enterprise “Next Gen” Data Platform
Bridging Silos with Better Agility, Speed and Governance With Lower Costs
FLEXIBLE DATA MODEL
UNSTRUCTURED & STRUCTURED DATA
FAST INGEST, INDEX, SEARCH & ALERTING
ENTERPRISE RELIABILITY
SLIDE: 7 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
The “Next Gen” Data Hub Tech Difference
AN OPERATIONAL AND TRANSACTIONAL ENTERPRISE NOSQL DATABASE
§ Data ingested as is (no ETL)
§ Structured and unstructured data
§ Data and metadata together
§ Adapts to changing data
and changing data structures
EASY TO
GET DATA IN
Flexible Data Model
§ Index once and query endlessly
§ Real-time and lightning fast
§ Query across JSON, XML, text,
geospatial, and semantic triples
in one database
EASY TO
GET DATA OUT
Ask Anything Universal Index
§ Reliable data and transactions
(100% ACID compliant)
§ Out-of-the-box automatic
failover, replication, and
backup/recovery
§ Enterprise-grade security and
Common Criteria certified
§ HIPAA Compliant
100%
TRUSTED
Enterprise Ready
SLIDE: 8 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
Load Data As Is
HOW MARKLOGIC DELIVERS
§ Load structured and unstructured data
§ Keep data and metadata together
§ Harmonize data in the database
§ Ability to skip:
– Upfront modeling
– ETL toolsOTHER METHODS
REST APIs, Java Client API, Node.js Client API, Java / .NET XCC
JSON
XML
SEMANTIC
DATA
GEOSPATIAL
DATA
MLCP
BINARY
SLIDE: 9 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
§ Variety of Interfaces – Modern programming
languages familiar to developers
§ Application Services – Simplifies architecture
and speeds up development
§ Developer Productivity – Tools and
frameworks to speed delivery
Developer and User
Access
HOW MARKLOGIC DELIVERS
SEARCH APPS
JAVASCRIPT
XQUERY
REST API
SPARQL
SQL
JAVA API
TRANSACTIONAL
APPS
ANALYTICAL
APPS
NODE.JS
SLIDE: 10 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
Platform for running your business, analytics and building apps
Operational Data Hub Solution – Next Gen Enterprise Integration Pattern
§ Convergent: Operational & Analytical. Provides 2-
way interaction between users and data
§ Contextual: Data harmonized with semantic
metadata
§ Data-centric: Integrates at the data level, not just
functionally
§ Cost-effective: Minimizes ETL, data copying,
business silos, technical silos and people-centric
integration
§ Secure: Provides a platform for rich data governance
§ Complementary: Leverages existing assets and
patterns
OPERATIONAL
APPLICATIONS
MULTI-CHANNEL
DISTRIBUTION
BIDIRECTIONAL
ANALYSIS
OF ALL DATA
SSD, DAS, SAN, NAS,
S3, Hadoop/HDFS
JSON
XML
Data-Centric
Architectural
Pattern
CONFIDENTIAL – Proprietary Information – Do not disclose or distribute to third parties
SLIDE: 11 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
MarkLogic Data Hub
HARMONIZE
INGEST
Enveloped
Documents
(Entity 1)
SERVE
Enveloped
Documents
(Entity 2)
RDBMS
Source 1
Documents
Message Bus
Content Feed
Staging Final
Source
Systems
Consuming
Applications
Source 2
Documents
Source N
Documents
… …
Enveloped
Documents
(Entity N)
Operational Apps
Analysis/BI
Data Feeds
Indexes, Query, Scripts Indexes, Query, Scripts
Data Flow
SLIDE: 12 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
Enterprise Data Integration Challenges: Solved
Enterprise Data Hubs
Consumer360, Medicaid, Operational
Data, Metadata, Structured &
Unstructured Data, Real-time Delivery
at Scale … and Centers of Excellence
Data Services Hub & App Dev
Platform for Real-Time Enrollment
“The largest personal data integration
government project in the history of the
Republic.”
- STEPHEN PARENTE, PHD, MPH, MS
Dynamic Content Delivery at Scale
Integrated Data, Multi-Device Delivery
Global Trade Store
Integrated Data, Integrated Post-Trade
Processing
3 Top 10 Payers
SLIDE: 13 © COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.
Popular Healthcare “Next Gen” Data Projects
FLEXIBLE DATA MODEL
UNSTRUCTURED & STRUCTURED DATA
FAST INGEST, INDEX, SEARCH & ALERTING
ENTERPRISE RELIABILITY
Enterprise
Data Hub
IT Initiatives Business Initiatives
§ Master Data Management
§ Data Governance &
Compliance / Security
§ Cybersecurity
§ Metadata / Search
§ Hadoop “Complement”
§ Hadoop Alternative
§ Data Enrichment /
Semantics
§ Building Apps
§ Mergers & Acquisitions
§ Engagement & Service
§ 360⁰ View of “Anything”
§ Search “Anything”
§ Communications &
Social Media
§ Payment Reform
§ ACO, MACRA, FWA
§ Quality & Outcomes
§ STARS, HEDIS, etc
§ Real-time “Anything”
§ Product / Plan Management

Himss DC meet mark logic

  • 1.
    © COPYRIGHT 2017MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. Unstructured Data and Analytics MarkLogic Data Hub - Healthcare’s Best Data Integration & App Development Platform Mohamad Thahir Technologist, Healthcare & Life Science
  • 2.
    SLIDE: 2 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. Healthcare Data Challenges • 1.2 Billion clinical documents are produced in US each year • 60% of these contains valuable patient-care information trapped in unstructured format • Multiple Structures • Inconsistent/Variable definition • Multiple Silos • Technological Innovation – AI, Blockchain, IoT, Cyber Security
  • 3.
    SLIDE: 3 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. 50LOWER Compared to other service & insurance industries … leveraging unstructured data High Price, High Volume FFS Procedures Most Impacted, Shift to Value-Based Models Healthcare $355 per record, $158 avg in other industries Healthcare Organization Data Challenges: Retention, Security, Compliance, Growth & Innovation 20REDUCED PAYMENTS %MILLION PER BREACH $ 4 % SATISFACTION? ? ?
  • 4.
    SLIDE: 4 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. 60% OF TIME By data scientists just wrangling data NYT WASTED In 2016 on data integration software Gartner Of data warehouse projects is on ETL TDWI for Informatica The Massive Cost of Using Traditional Tech with ETL 3.5BILLION IN SPENDING $% OF THE COST80
  • 5.
    SLIDE: 5 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. Credentialing & Contracting Finance CM / DM / UM Enrollment Marketing Products & Plans Claims Lines-of- business The “Next Gen” Solution § A flexible, scalable operational database is critical for a real-time Data Centric approach § Greater convergence between analysis and operations is critically important to creating actionable data and better engagement § The new Enterprise Pattern is the Operational Data Hub A NEW ENTERPRISE INTEGRATION PATTERN
  • 6.
    SLIDE: 6 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. The MarkLogic Data Hub Solution RELATIONAL DATABASES MAINFRAMES FILE SYSTEMS ANY OTHER SOURCE TRANSACTIONAL APPLICATIONS ANALYTICAL APPLICATIONS DOWNSTREAM SYSTEMS An Operational, Transactional & Analytical Enterprise “Next Gen” Data Platform Bridging Silos with Better Agility, Speed and Governance With Lower Costs FLEXIBLE DATA MODEL UNSTRUCTURED & STRUCTURED DATA FAST INGEST, INDEX, SEARCH & ALERTING ENTERPRISE RELIABILITY
  • 7.
    SLIDE: 7 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. The “Next Gen” Data Hub Tech Difference AN OPERATIONAL AND TRANSACTIONAL ENTERPRISE NOSQL DATABASE § Data ingested as is (no ETL) § Structured and unstructured data § Data and metadata together § Adapts to changing data and changing data structures EASY TO GET DATA IN Flexible Data Model § Index once and query endlessly § Real-time and lightning fast § Query across JSON, XML, text, geospatial, and semantic triples in one database EASY TO GET DATA OUT Ask Anything Universal Index § Reliable data and transactions (100% ACID compliant) § Out-of-the-box automatic failover, replication, and backup/recovery § Enterprise-grade security and Common Criteria certified § HIPAA Compliant 100% TRUSTED Enterprise Ready
  • 8.
    SLIDE: 8 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. Load Data As Is HOW MARKLOGIC DELIVERS § Load structured and unstructured data § Keep data and metadata together § Harmonize data in the database § Ability to skip: – Upfront modeling – ETL toolsOTHER METHODS REST APIs, Java Client API, Node.js Client API, Java / .NET XCC JSON XML SEMANTIC DATA GEOSPATIAL DATA MLCP BINARY
  • 9.
    SLIDE: 9 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. § Variety of Interfaces – Modern programming languages familiar to developers § Application Services – Simplifies architecture and speeds up development § Developer Productivity – Tools and frameworks to speed delivery Developer and User Access HOW MARKLOGIC DELIVERS SEARCH APPS JAVASCRIPT XQUERY REST API SPARQL SQL JAVA API TRANSACTIONAL APPS ANALYTICAL APPS NODE.JS
  • 10.
    SLIDE: 10 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. Platform for running your business, analytics and building apps Operational Data Hub Solution – Next Gen Enterprise Integration Pattern § Convergent: Operational & Analytical. Provides 2- way interaction between users and data § Contextual: Data harmonized with semantic metadata § Data-centric: Integrates at the data level, not just functionally § Cost-effective: Minimizes ETL, data copying, business silos, technical silos and people-centric integration § Secure: Provides a platform for rich data governance § Complementary: Leverages existing assets and patterns OPERATIONAL APPLICATIONS MULTI-CHANNEL DISTRIBUTION BIDIRECTIONAL ANALYSIS OF ALL DATA SSD, DAS, SAN, NAS, S3, Hadoop/HDFS JSON XML Data-Centric Architectural Pattern CONFIDENTIAL – Proprietary Information – Do not disclose or distribute to third parties
  • 11.
    SLIDE: 11 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. MarkLogic Data Hub HARMONIZE INGEST Enveloped Documents (Entity 1) SERVE Enveloped Documents (Entity 2) RDBMS Source 1 Documents Message Bus Content Feed Staging Final Source Systems Consuming Applications Source 2 Documents Source N Documents … … Enveloped Documents (Entity N) Operational Apps Analysis/BI Data Feeds Indexes, Query, Scripts Indexes, Query, Scripts Data Flow
  • 12.
    SLIDE: 12 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. Enterprise Data Integration Challenges: Solved Enterprise Data Hubs Consumer360, Medicaid, Operational Data, Metadata, Structured & Unstructured Data, Real-time Delivery at Scale … and Centers of Excellence Data Services Hub & App Dev Platform for Real-Time Enrollment “The largest personal data integration government project in the history of the Republic.” - STEPHEN PARENTE, PHD, MPH, MS Dynamic Content Delivery at Scale Integrated Data, Multi-Device Delivery Global Trade Store Integrated Data, Integrated Post-Trade Processing 3 Top 10 Payers
  • 13.
    SLIDE: 13 ©COPYRIGHT 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. Popular Healthcare “Next Gen” Data Projects FLEXIBLE DATA MODEL UNSTRUCTURED & STRUCTURED DATA FAST INGEST, INDEX, SEARCH & ALERTING ENTERPRISE RELIABILITY Enterprise Data Hub IT Initiatives Business Initiatives § Master Data Management § Data Governance & Compliance / Security § Cybersecurity § Metadata / Search § Hadoop “Complement” § Hadoop Alternative § Data Enrichment / Semantics § Building Apps § Mergers & Acquisitions § Engagement & Service § 360⁰ View of “Anything” § Search “Anything” § Communications & Social Media § Payment Reform § ACO, MACRA, FWA § Quality & Outcomes § STARS, HEDIS, etc § Real-time “Anything” § Product / Plan Management