On-Demand Service-Based Big Data Integration: Optimized for Researc...

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

1/23
Pradeeban Kathiravelu1,2
, Yiru Chen3
, Ashish Sharma4
,
Helena Galhardas1
, Peter Van Roy2
, Luís Veiga1
On-Demand S...

2/23
Introduction
●
Scale and diversity of big data are rising.
–
Geographically distributed data of exabytes.
–
Structure...

3/23
Challenges in Medical Research
for Big Data Integration
●
Multiple types of data.
–
Imaging, clinical, and genomic.
●...

4/23
A Story of Medical Data Researchers...A Story of Medical Data Researchers...

5/23
●
Jim is interested in the
effects of a medicine to
treat brain tumor in patients
of certain age groups.

6/23
Observation - 1
●
Various sources.
–
Service-based data access through APIs.
●
Thanks to specifications such as HL7 F...

7/23
●
Paula has overlapping
research interests with Jim.

8/23
Observation - 2
●
Load data only once per organization.
–
Bandwidth and storage efficiency.

9/23
●
Sharing the research data with researchers,
beyond organization boundaries.

10/23
Observation - 3
●
Do not duplicate data!
–
We ``own`` our interest; not the data.
●
Point to the data in the data so...

11/23
Problems
●
How to..
–
Load data from several service-based big data sources.
●
Avoid duplicate downloads and near du...

12/23
Óbidos
OOn-demand BBig Data IIntegration,
DDistribution, and OOrchestration SSystem
●
Researcher query →
Narrow down...

13/23
Óbidos Approach
●
Hybrid of virtual and materialized data integration
approaches.
–
Lazy load of metadata: Load the ...

14/23
Óbidos Architecture

15/23
Evaluation
●
Evaluation Data:
–
Clinical data and DICOM imaging collections of TCIA.
●
Benchmark Óbidos against eage...

16/23
Workload Characterization
Various Entries in Evaluated Collections

17/23
Data load time
Change in total data volume (Same query and same interest)
●
Observation:
–
Load time increases for e...

18/23
Change in studies of interest
(Same query and constant total data volume)
Data load time
●
Observation:
–
Load time ...

19/23
Query completion time
for the integrated data repository
●
Observation:
–
We assume the corresponding data is alread...

20/23
Efficiency in Sharing Medical Research Data
●
Observation:
–
A constant-size UID is sufficient, intra-organization.
...

21/23
Conclusion
●
Óbidos offers on-demand service-based big data integration.
–
Fast and resource-efficient data analysis...

22/23
Acknowledgements
●
NCI QIN grant (1U01CA187013, Resources for
Development and Validation Of Radiomic Analyses and
Ad...

23/23
Conclusion
●
Óbidos offers on-demand service-based big data integration.
–
Fast and resource-efficient data analysis...

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1035460 views
Storytelling For The Web: Integrate... by Chiara Aliotta 947335 views
Artificial Intelligence, Data and C... by OECD Directorate ... 869118 views
How to Leverage AI to Boost Employe... by SocialHRCamp 364901 views
2024 State of Marketing Report – by... by Marius Sescu 207323 views
Everything You Need To Know About C... by Expeed Software 227648 views

View on Slideshare

1 of 23 Ad

View on Slideshare

1 of 23 Ad