This session will describe the use of Hadoop and HBase for handling very large repositories of data in the HealthCare arena. Explorys, founded in 2009 in partnership with the Cleveland Clinic, is one of the largest clinical repositories in the United States with 10 million lives under contract. The Explorys healthcare platform, based upon a massively parallel computing model centered around Hadoop and HBase and spanning billions of anonymized clinical records, enables subscribers to search and analyze patient populations, treatment protocols, and clinical outcomes, and provides a uniquely powerful and HIPAA compliant solution for accelerating lifesaving discovery.
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Hadoop World 2011: From Big Data to Lives Saved: HBase in HeathCare - Doug Meil & Charlie Lougheed - Explorys
1. From BIG Data to Lives Saved
Hadoop & HBase in Healthcare
Copyright 2010-2011, Explorys, Inc., All Rights Reserved
page 1 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
2. Charlie Lougheed Doug Meil
Cofounder, President & CTO Cofounder, Chief Software Architect
Email: charlie@explorys.com HBase Committer
Email: doug@explorys.com
page 2 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
3. How does BIG Data save a life?
page 3 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
4. page 4 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
5. Population Intelligence
Seeing the patterns and acting upon them
page 5 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
6. The State of Healthcare in the U.S.
page 6 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
7. Things could be 17.6% of GDP ($8,086) per person in ’09
better…
19.3% of GDP expected by 2019
Approximately 5% or $700B per year
goes to tests and procedures that do
not improve health outcomes --
Congressional Budget Office
Medicare spending grew 7.9% to
$502.3 billion in 2009
United States life expectancy is 42nd in
the world.
Source: CMS NHE Fact Sheet 2009
page 7 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
8. page 8 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
9. Data Source [1] (OECD Health Data 2009). Health care cost rise based on total expenditure on health as % of GDP.
page 9 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
10. “…that kind of a cost, compared with
the rest of the world, is like a
tapeworm eating at our economic
body.” – Warren Buffett, March 2010
page 10 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
12. The Data Curve
Healthcare is not on a path
to keep up.
page 12 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
13. Lessons from the Outside
page 13 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
14. page 14 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
15. page 15 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
16. Size Matters
Statistical Relevance in Healthcare Is Everything
page 16 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
17. Type II diabetics
&
occurrence of MI
&
Treatment X…
page 17 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
18. We need a little revolution
to get some evolution.
page 18 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
19. Private Cloud Computing
That meets the unique demand of Healthcare
30,000,000,000+
clinical, operational, and financial
BIG DATA
data facts, across 10 million patients
and 10+ years of data
aggregated | encrypted | curated | HIPAA compliant | efficient
page 19 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
20. About Explorys
Formed in 2009
Developed in conjunction with Cleveland Clinic
Formed by leaders in BIG DATA, security, and healthcare
page 20 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
21. Private Cloud Computing
That meets the unique demand of Healthcare
30,000,000,000+
clinical, operational, and financial
data facts, across 10 million patients
and 10+ years of data
aggregated | encrypted | curated | HIPAA compliant | efficient
page 21 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
23. Enterprise
Performance Management
Explore
For Healthcare
Index
Collect, aggregate, curate, and map all pertinent
clinical, operational, resources, financial, and
contractual data.
Index
Explore
Population, providers, treatments, and outcomes in
real-time.
Engage Measure
Measure
Processes, treatments, outcomes, and financial results
between providers, departments, and locations.
Engage
On holistic information to direct care and in a value-
based model.
page 23 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
24. How?
page 24 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
25. “In pioneer days they used oxen for heavy pulling,
and when one ox couldn't budge a log,
X
they didn't try to grow a larger ox. elephant
“We shouldn't be trying for bigger computers, but for
more systems of computers.”
Rear Admiral Grace Hopper, Inventor of COBOL Compiler
page 25 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
26. The Explorys Platform
Specialized cloud computing platform for healthcare and life sciences
A B C
Apps Databases Indexes
Explorys & On-demand data High speed access to
3rd Party marts, cubes, and standardized data
registries
Explorys DataGrid
Always On | Curated | Privacy Protected | Open Support for 3rd Party Apps & Marts
page 26 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
27. So How Did We Get Here?
In 2009, we knew we were going to need to
collect a lot of data
We needed to address both the storage and
the processing challenges.
page 27 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
28. A few stumbles along the
way
GC of Death
Lack of documented best practices when
we started (in 2009)
page 28 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
29. Works for us
page 29 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
30. BIG Data in Action…
page 30 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
32. Thank You!
Charlie Lougheed Doug Meil
Cofounder, President & CTO Cofounder, Chief Software Architect
Email: charlie@explorys.com HBase Committer
Email: doug@explorys.com
and we’re hiring!
page 32 | Copyright 2010-2011, Explorys, Inc., All Rights Reserved
Editor's Notes
STEVE and CHARLIE Both do quick intro ourselves (if not introduced by the moderator)
STEVE
STEVE
STEVE
STEVE
STEVELet’s talk about the challenges in healthcare…The path we are on is unsustainable
STEVEAnd our problems are just getting supersized, I mean literallyOur aging population combined with the growing epidemic of obesity in the US it just going to make our challenges greaterWith all but one state in the US having a 20% or more of it’s population obese, this is a problem that not only local and federal governments need to address, it also has a major impact our ability to control our deficit.This is a real problem that can be partially addressed more effective weigh management being driven by healthcare professionals.
STEVECompetitively, we’re practically off the charts; in a bad way. At nearly double the comparative GDP spend of our global competitors, it’s little wonder why our industries struggle to compete on cost.
STEVE- Case in point, Warren Buffett’s recent statements about our healthcare expense deficit…
STEVEAn it just keeps getting bigger. We need to get our ass back on the ground.
STEVEWe’ve gone from from simple fields, to unstructured notes, to videos, and soon genomicsIt’s a proliferation of data beyond what most IT vendors has planned for or enterprise IT groups are capable of responding to on their own.
CHARLIE
CHARLIEIf you’ve spent anytime in store lately, you know the length retailers have gone to understand customer behaviors, product positioning, and performance across venue of service, service line, and consumer profile.
CHARLIEAnd some would say that the healthcare industry could learn from how aviation leverages data-driven processes. Describe the paper by Lewis, et al…
STEVE (although ironic coming from him)
STEVE
CHARLIE
STEVE (although ironic coming from him)
CHARLIE
CHARLIE
CHARLIE
STEVE and CHARLIE Both do quick intro ourselves (if not introduced by the moderator)