Hadoop and Data Virtualization - A Case Study by VHA

© Hortonworks Inc. 2011 – 2015. All Rights Reserved
Hadoop and Data Virtualization: A Case Study by VHA
with Denodo, Hortonworks and VHA

Speakers
Richard Proctor
GM Healthcare
Hortonworks
Ravi Shankar
CMO
Denodo
Ben Blakeney
Architecture & Engineering Services
VHA

Shifting the Data Paradigm
• Reactive reporting
• 3 – 6 month delay
• Regulatory-centric
• Manual data review/collection
• Repressive data silo’s
• Not sure what data to store
• Expensive storage w/limited options
 All data types (structured, semi
structured, & Unstructured)
 Near real-time and predictive
 Organization & Patient centric
 Store everything
 Inexpensive storage w/lots options
Data as an independent business
process(Silo’s of data)
Reactive reporting
Data as a byproduct of patient care Prospective analysis
Primary audience – healthcare
organization
Secondary audience
Secondary audience
Primary audience – regulatory agencies
Current data process with latent architecture
Modern data Architecture with Hadoop

The problem: Current data architecture under pressureAPPLICATIONSDATASYSTEM
REPOSITORIES
SOURCES
Existing Sources
ADT, Patient Accounting, GL, Payroll,
Physician entry, Core measures, Patient Sat,
AHRQ, External benchmarks,, Clinical Systems
(ED, Radiology, PACS), Other Sources (Clinics,
home health, Ambulatory, LTAC’s)
RDBMS EDW MPP
Business
Analytics
Custom
Applications
Packaged
Applications
OLTP, ERP, CRM Systems
Unstructured documents, emails
Clickstream
Server logs
Sentiment, Web Data
Sensor. Machine Data
Geolocation
Value in New data sources
• Limited Application interaction
• Costly to Scale storage
• Silos of Data
• Inability to manage new data sources
• Schema on Write vs. Read

The “Empowered” Patient
Relationship Focused
(Values stable doctor’s
relationships)
Detests/suspicious of Gadgets
Serial Processor
(Email, basic model phone)
Loyalty to Brand
Health as a service
Access to Care
Patient (willing to wait)
Believes experts (not comfortable
seeking second opinions)
Goes for Best of Breed
(Network of Networks)
Super Connected
Parallel Processor-Integrated (State-
of-the-Art)
Loyalty to Value
Take care of Health
Health as a right
Impatient
Asks for Data (researches multiple self
enabled searches, demands second opinions)
My Parents My Children

Thank you for the diagram, Robert Wood
Johnson Foundation, 2014
Comprehensive Health
Management
6
80% of healthcare
determinants lie outside
the US healthcare delivery
system
Can healthcare systems
expand into these other
areas, and become true
public health systems?

Original 24 architects, developers, operators of Hadoop from Yahoo!
Hortonworks Company ProfileONLY
100open source
Apache Hadoop data platform
% Founded in 2011
HADOOP
1ST
provider to go public
IPO Fall 2014 (NASDAQ: HDP)
subscription
customers556 employees across
740+
countriestechnology partners
1350+ 17TM

Two great Use cases to realize a dramatic cost savings…
EDW Optimization Commodity Compute & Storage
✚
OPERATIONS
50%
ANALYTICS
20%
ETL PROCESS
30%
OPERATIONS
50% ANALYTICS
50%
Current Reality
EDW at capacity: some usage from
low value workloads
Older data archived, unavailable for
ongoing exploration
Source data often discarded
Augment w/ Hadoop
Free up EDW resources from
low value tasks
Keep 100% of source data and historical data
for ongoing exploration
Mine data for value after loading it because of
schema-on-read
MPP
SAN
Engineered System
NAS
HADOOP
Cloud Storage
$0 $20,000 $40,000 $60,000 $80,000 $180,000
Fully-loaded Cost Per Raw TB of Data (Min–Max Cost)
Hadoop Enables Scalable Compute &
Storage at a Compelling Cost Structure
Hadoop
Parse, Cleanse
Apply Structure, Transform
Storage Costs and licensing
reduction of latent systems
$500,000
5 times the amount of usable storage, plus processing power, for about
30% of the cost of traditional enterprise technologies,”

Monitor Patient Vitals in Real-Time with Sensor data
Problem
Managing The Volumes of System Sensor Data
• In a typical hospital setting, nurses do rounds and manually monitor patient vital signs.
They may visit each bed every few hours to measure and record vital signs but the
patient’s condition may decline between the time of scheduled visits.
• This means that caregivers often respond to problems reactively, in situations where
arriving earlier may have made a huge difference in the patient’s wellbeing.
Solution
Hadoop Empowers Healthcare by Converting High Volumes of Sensor Data into a
Manageable Set of Data
• New wireless sensors can capture and transmit patient vitals at much higher
frequencies, and these measurements can stream into a Hadoop cluster.
• Caregivers can use these signals for real-time alerts to respond more promptly to
unexpected changes.
• Over time, this data can go into algorithms that proactively predict the likelihood of an
emergency even before that could be detected with a bedside visit.
Benefits
Proactively Predict Events
rather than reactively
Real-time Alerts
Capture & Transmit Patient
Vitals at Much Higher
Frequencies
Improve Patient Satisfaction
Improve operational efficiency
Improved response times
Reduce adverse drug
response times
Healthcare

VHA Inc. Confidential information.
Hadoop and Data Virtualization
11 |

Since 1977 – when 30 hospital CEOs established VHA as the nation’s first membership
organization for acute care providers – the company has applied knowledge in
analytics, contracting, consulting and network development to help members achieve
their strategic objectives.
VHA is based in Irving, Texas, and has 11 regional offices. Our unique family of companies
brings industry-leading innovation and expertise to help organizations thrive in a dynamic
health care environment:
A legacy of innovation
As the first hospital membership organization, we were born of innovation.
We introduced the concept of supply networks, drawing on the power of collaboration to
achieve greater cost savings for health organizations.
We pioneered comparative data analysis and exchange as well as the industry’s first
committed contracting program and private label program, all of which continue to deliver
exceptional value today.
Who is VHA?
In 2013, VHA
delivered
$2.2 billion in savings
and additional value
to members.
12 |

At UHC, collaboration drives success.
For nearly 30 years, UHC has been a catalyzing force in:
Supporting academic medical centers in their efforts
Fostering new ideas
Building solid relationships that withstand the test of time
Our members have been agents of progress—driving the advancement of patient care,
medical knowledge, and fiscal acuity by coming together to candidly discuss their ideas and
vision.
UHC continually expands and strengthens services to offer insights and solutions to
members.
As the leader in providing relevant comparative data and as a single-source provider of
information and insights that promote change, UHC has created UHC Intelligence™, a
versatile suite of business tools that power performance improvement.
Who is UHC?
13 |
UHC offers
Transparency.

UHC and VHA have a track record of partnering successfully
History of Collaboration
14 |
1998 – Current
Novation was formed in 1998 and is a joint
venture between UHC and VHA.
1998 – 2011
A supply chain improvement company focused on
non-acute care market, Provista was formed in
1998 as a joint venture between UHC and VHA.
VHA acquired UHC’s minority interest in 2011.
2013 – Current
A subsidiary of Novation, aptitude is the health
care industry's first online direct contracting
marketplace.
UHC and VHA have formed the largest contracting services company
Since forming Novation in 1998, UHC and VHA have worked in partnership to grow Novation to the nation’s largest contracting services company, representing
more than $50 billion in purchasing volume and delivering more than
$1 billion in contract price savings for UHC and VHA members and other affiliate organizations over the past
five years.
We have continued to expand on this successful partnership. Our advanced shared analytic capabilities and innovative cost management tools have helped
purchasing through Novation to save an additional $1.4 billion, over the last
four years.

UHC and VHA Have Complementary Strengths Which When Combined
Create Enhanced Member Value
A Powerful Network
The Nation’s Leading Academic
Medical Centers and Community
Health Care Providers
Foundation
Supply
Chain
Management
Advisory
Services
Comprehensive Data
and Analytics
Core Capabilities
Targeted Solutions
Customized Insights
NewCo
15 |

Our new organization offers superior access to leading practices, networking and knowledge sharing for our
members, which includes the majority of this country’s preeminent academic medical centers and community-
based health systems.
The newly combined organization:
Serves more than 5,200 health system members and affiliates.
Provides services to nearly 30 percent of the nation’s hospitals, including virtually all the academic medical centers and
health systems.
Serves more than 118,000 non-acute health care customers.
Includes more than $50 billion in purchasing volume, the largest in the industry.
Provides services to all of the top 10 hospitals on the US News and World Reports annual list of America’s Top
Hospitals.
Delivers the industry’s most in-depth clinical data combined with the nation’s
most robust supply chain data to address cost and quality.
VHA and UHC Are Now the Largest Member-owned Health Care Company
16 |

Context
17 |

Move from silos to streamlined data processing….
18 |
DataInternal
External
Data
Logic
Apps
Internal External Internal External Internal External
Clinical Supply Academic
Process
Logic
Apps
Logic
Apps
Process Process
Data Data
Process
Logic
Clinical
Supply
Academic
Apps
Apps
Apps
Logic
Logic

ManagementAcquisition Delivery
Where we want to go…
19 |
Data
Lake
BusinessAccessLayer
Data Warehouse
Discovery Zone
Systems of Record
Oracle
SQL
Other
Exadata
Data Access Layer
Applications
Reports
Dashboards
DM
Queries
EDI
Future Capabilities
Data Gateway
LandingZone
HCO
XYZ
Data Aggregators
Raw Data Useful Information
Data Owners, Technical Support Data Stewards, Data SME/Scientist,
Analyst, Advisors
Advisors, Analysts, Members,
Collaboratives
DM
DM
Data Owners, Technical Support
Data Stewards, Data SME’s, Data Scientists, Analyst,
Advisors, Data QA
Collaboratives
Discovery Zone
Posts

Let’s get rolling…
20 |

ManagementAcquisition Delivery
Where we want to go…
21 |
Data
Lake
BusinessAccessLayer
Data Warehouse
Discovery Zone
Systems of Record
Oracle
SQL
Other
Exadata
Data Access Layer
Applications
Reports
Dashboards
DM
Queries
EDI
Future Capabilities
Data Gateway
LandingZone
HCO
XYZ
Data Aggregators
Raw Data Useful Information
Data Owners, Technical Support Data Stewards, Data SME/Scientist,
Analyst, Advisors
Collaboratives
DM
DM
Data Owners, Technical Support
Data Stewards, Data SME’s, Data Scientists, Analyst,
Advisors, Data QA
Collaboratives
Discovery Zone
Posts

Built on Hadoop
Hortonworks is the distribution
Business Need
Move to a modern data architecture
– Disparate data sources into a single data lake
– Flexibility of schema on read (not write)
– Ease of doing analysis on subsets of large data sets
– Capture all types of data (even data that might only have a future purpose)
– Lower cost to store large amounts of data
Data Lake
22 |
Data
Lake

Area to discover value from data
Access roles:
Data scientists and SMEs
Product Managers
Analysts
Data Stewards
Challenge
Business users have been trained to use SQL or CSV exports
Introduction of Hadoop will require training on PIG and HIVE for access
Possibility of slowing down adoption and deriving value from new solution
Data Discovery
23 |
Discovery Zone

Utilize data virtualization
“Data virtualization is an umbrella term used to describe any approach to data management that allows an
application to retrieve and manipulate data without requiring technical details about the data, such as how
it is formatted or where it is physically located” – Margaret Rouse, TechTarget.com
Our solution…
24 |
Data
Lake
Discovery Zone

Proven platform
Denodo is our DV platform
Successes in our company
Salesforce reporting environment (cloud based plug-in)
Physician dashboard (disparate data sources)
Data Virtualization
25 |

Discovery Zone
Utilize Denodo HDFS, HBase and Map Reduce custom wrappers
Abstract data from lake
– Protects data source asset
– Enhanced security
Simplified access for data discovery users
– Can use SQL to query
Easy to augment discovery process
– Can pull in other sources of data to DV view (Excel, PDF, Websites)
Data Virtualization for Discovery Zone
26 |

Discovery zone
presentation layer
Virtual data views
Data Lake
Systems of record
Architecture
27 |

Data Lake approach on Hadoop
Simplifies data management
reduces data costs
Scalable
Flexibility
Data Virtualization
Simplified data access
Less training for business users
Faster data discovery
Augmented discovery process (adding new sources)
Recommendation and Benefits
28 |

Data Virtualization
Ravi Shankar
Chief Marketing Officer

© 2015 Denodo Technologies
What is Data Virtualization?
Data Virtualization combines disparate data sources into a single “virtual” data
layer (aka information fabric abstraction) that provides unified access and
integrated data services to consuming applications in real-time (right-time).

Data Virtualization Capabilities
Data Virtualization
Logical abstraction &
decoupling
Data federation
Real-time, hybrid, cache
Semantic integration &
data quality-
structured &
unstructured
Agile data services
provisioning
Unified data
governance & security

Benefits of Data Virtualization
Better Quality Information
 Focus on Business Information Needs
 Include Web / Cloud, Big Data, Unstructured, Streaming
 Bigger volumes, richer/easier access to data
Lower Cost & Agility
 Lower Integration Costs by 80%
 Flexibility to Change
 Real-time (on-demand) Data Services
Fast Time to Solution
 Projects in 4-6 Weeks
 ROI in <6 months
 Adds New IT and Business Capabilities

Data Virtualization – Use Cases
Agile Business Intelligence
Big Data, Cloud Integration
Agile Single View Applications
Data Services
Data
Virtualization
Access new data sources 60% faster with change
requests met in just a few days with IT using
40% less analyst time to support.
Reduced back-office workload by more
than 50%. Increased First Call Resolution
rate to over 90% and customer
satisfaction to over 94%.
Improved asset performance and proactive
maintenance. Increased revenue from sale of
services and parts. Reduced warranty costs of
parts failure.
Reduced time to create and
provision data service from 180
hours to 8 hours.

About Denodo
Description Denodo is the leader in data virtualization offering the broadest access to structured and
unstructured data exceeding the performance needs of data-intensive organizations for both
analytical and operational use cases delivered in a much shorter timeframe than traditional data
integration tools.
Headquarters Palo Alto, CA. Offices in New York, London, Madrid, A Coruña, Chicago, Boise, Houston and Munich.
Worldwide sales network through partners.
Leadership Longest continuous focus on data virtualization and data services. Product leadership. Solutions
expertise.
Customers 250+ customers worldwide, including many F500 and G2000 companies across key verticals, such as
healthcare, life sciences, technology, media, telecommunications, insurance, financial services,
consumer/retail, energy and public sector.

Next Steps…
Download the Hortonworks Sandbox
Learn Hadoop
Build Your Analytic App
Try Hadoop
Learn more about our partnerships and VHA
www.denodo.com
http://vha.com
Download Denodo Express for Free
The fastest way to Data Virtualization
www.denodoexpress.com

Hadoop and Data Virtualization - A Case Study by VHA

More Related Content

What's hot

Similar to Hadoop and Data Virtualization - A Case Study by VHA

More from Denodo

Recently uploaded

Hadoop and Data Virtualization - A Case Study by VHA