SlideShare a Scribd company logo
1 of 16
Download to read offline
Ecosystem	
  Challenges	
  Around	
  Data	
  Use	
  	
  
Leonid	
  Zhukov	
  
Ancestry.com	
  
2
•  World’s	
  largest	
  online	
  family	
  history	
  
resource	
  
•  Started	
  as	
  a	
  publishing	
  company	
  in	
  
1983,	
  online	
  from	
  1996	
  
•  2.7	
  million	
  worldwide	
  subscribers	
  
	
  
Data	
  at	
  Ancestry	
  
•  Historical	
  records	
  –	
  company	
  acquired	
  content	
  collecFons	
  
•  User	
  created	
  content:	
  
– Ancestor	
  profiles	
  and	
  family	
  trees	
  
– Uploaded	
  photographs	
  and	
  stories	
  
•  User	
  behavior	
  data	
  on	
  Ancestry.com	
  
•  Customer	
  DNA	
  data	
  
•  10	
  PB	
  of	
  structured	
  and	
  unstructured	
  data	
  
3
Historical	
  records	
  
•  Historical	
  Content	
  
– 14	
  billion	
  historical	
  records	
  going	
  back	
  to	
  17th	
  century	
  
– DigiFzed	
  and	
  searchable	
  
4
Historical	
  records	
  
5
•  More	
  than	
  30,000	
  content	
  collecFons	
  
User	
  family	
  trees	
  
6
•  Family	
  trees:	
  
– 60	
  million	
  family	
  trees	
  
– 6	
  billion	
  profiles	
  
Family	
  trees	
  
77
Power	
  law	
  distribuFon	
  
	
  tree	
  sizes	
  
500	
  nodes	
  
700	
  edges	
  
55	
  generaFons	
  	
  
	
  
Fme	
  
User	
  contributed	
  content	
  
– 200	
  million	
  uploaded	
  	
  family	
  photos	
  and	
  stories	
  
8
Person	
  and	
  record	
  search	
  
9
•  Search	
  query	
  
Record	
  linkage	
  
10
•  Record	
  linkage	
  –	
  finding	
  and	
  matching	
  records	
  in	
  mulFple	
  data	
  sets	
  	
  
with	
  non-­‐unique	
  idenFfiers	
  (data	
  matching,	
  	
  enFty	
  disambiguaFon,	
  
duplicate	
  detecFon	
  etc)	
  
•  Goal:	
  bring	
  together	
  informaFon	
  about	
  the	
  same	
  person	
  
•  Some	
  	
  non-­‐unique	
  idenFfiers:	
  
–  Names:	
  first	
  name,	
  last	
  name	
  (John	
  Smith	
  –	
  300,000	
  records)	
  
–  Dates:	
  	
  date	
  of	
  birth,	
  date	
  of	
  death	
  	
  	
  	
  
–  Places:	
  place	
  of	
  birth,	
  residence,	
  place	
  of	
  death	
  	
  
–  Extra:	
  family	
  members,	
  life	
  events	
  
•  Records	
  o_en	
  incomplete	
  and	
  contain	
  mistakes	
  
•  Other	
  industries:	
  banking,	
  insurance,	
  government	
  etc	
  
User	
  behavior	
  data	
  
•  User	
  behavior	
  data:	
  
– 75	
  mln	
  searches	
  daily	
  
– 10	
  mln	
  profiles	
  added	
  daily	
  
– 3.5	
  mln	
  records	
  aaached	
  daily	
  
11
DNA	
  Data	
  
•  Direct	
  to	
  consumer	
  DNA	
  test	
  
•  700,000	
  SNPs	
  per	
  sample	
  
•  400,000	
  DNA	
  samples	
  
•  No	
  medical	
  studies	
  
	
  
	
  
12
Ancestry	
  DNA	
  
	
   	
   	
   	
   	
   	
  	
  
•  GeneFc	
  ethnicity	
  
– Reference	
  panel	
  	
  
– 26	
  ethnic	
  regions,	
  3000	
  samples	
  
	
  
13
Ancestry	
  DNA	
  
14
•  GeneFc	
  inheritance	
  
– IdenFty-­‐by-­‐descent	
  
– Cousin	
  matching	
  	
  
	
  
Matching DNA
DNA	
  data:	
  privacy	
  and	
  research	
  
15
ding how
influence
nd the re-
atments is
communi-
ability of
e distribu-
ences and
ever, like
l informa-
ata are pri-
sensitive.
ed special
imination,
of insur-
r individu-
es (1, 2).
of these data poses
allenges.
differ in about 0.1%
es in their genomes
entific data has led to a search for new tech-
nologies. However, the hurdles may be
greater than had been suspected. For exam-
ple, one approach to protecting privacy is to
dustrial, or governmental r
agrees to our usage policies
of data access) (10). Althou
prevent data abuse, it pro
monitor usage.
Social concern
are intricately con
about benefits o
trustworthiness of
governmental ag
United States, the
Portability and Ac
of 1996 (HIPAA)
ed Privacy Rules o
erally forbid sha
data without p
However, they do
address use or di
for human genetic
bates in Iceland,
and elsewhere (1
range of views on
by genetic information. Th
may be at one end of this sp
izens seem to strongly desir
Whatever the setting, we rec
man Subject Privacy
Zhen Lin,1 Art B. Owen,2 Russ B.Altman1*
Privacy
Independent SNPs
Low
Medium
High
5 75 100 125 1000 2000 3000 4000
Insufficient for future genomic research
Insufficient for privacy protection
Needed to find genetic relationshops
Trade-offs between SNPs and privacy.
Z.	
  Lin,	
  A.	
  Owen,	
  R.	
  Altman,	
  Science,	
  vol	
  305,	
  2004	
  
Challenges	
  
•  Engineering	
  
– Scalability	
  
– Availability	
  
– Security	
  
•  Research	
  
– InformaFon	
  retrieval	
  	
  
– DNA	
  genomic	
  research	
  	
  
•  Privacy	
  
	
  
	
  16

More Related Content

Similar to Ecosystem challenges around data use

ICG-11 - genomic data projects around the world - nov 5 2016
ICG-11 - genomic data projects around the world - nov 5 2016ICG-11 - genomic data projects around the world - nov 5 2016
ICG-11 - genomic data projects around the world - nov 5 2016Fiona Nielsen
 
Genome data management
Genome data managementGenome data management
Genome data managementShareb Ismaeel
 
Data dialogue - Human Genomic Data Discovery
Data dialogue - Human Genomic Data DiscoveryData dialogue - Human Genomic Data Discovery
Data dialogue - Human Genomic Data DiscoveryFiona Nielsen
 
Data Landscapes: The Neuroscience Information Framework
Data Landscapes:  The Neuroscience Information FrameworkData Landscapes:  The Neuroscience Information Framework
Data Landscapes: The Neuroscience Information FrameworkMaryann Martone
 
Partnering on crop wild relative research at three scales: commonalities for ...
Partnering on crop wild relative research at three scales: commonalities for ...Partnering on crop wild relative research at three scales: commonalities for ...
Partnering on crop wild relative research at three scales: commonalities for ...CWRofUS
 
Partnering on CWR research at three scales: commonalities for success
Partnering on CWR research at three scales: commonalities for successPartnering on CWR research at three scales: commonalities for success
Partnering on CWR research at three scales: commonalities for successCWR Project
 
A Deep Survey of the Digital Resource Landscape: Perspectives from the Neuros...
A Deep Survey of the Digital Resource Landscape:Perspectives from the Neuros...A Deep Survey of the Digital Resource Landscape:Perspectives from the Neuros...
A Deep Survey of the Digital Resource Landscape: Perspectives from the Neuros...Maryann Martone
 
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK Cyndy Parr
 
Finding and accessing human genome data with Repositive
Finding and accessing human genome data with RepositiveFinding and accessing human genome data with Repositive
Finding and accessing human genome data with RepositiveManuel Corpas
 
Project Unity: The Way of the Future for Plant Breeding
Project Unity: The Way of the Future for Plant BreedingProject Unity: The Way of the Future for Plant Breeding
Project Unity: The Way of the Future for Plant BreedingPhenome Networks
 
Crowdsourcing the Analysis of Genomes
Crowdsourcing the Analysis of GenomesCrowdsourcing the Analysis of Genomes
Crowdsourcing the Analysis of GenomesBastian Greshake
 
SciDataCon - How to increase accessibility and reuse for clinical and persona...
SciDataCon - How to increase accessibility and reuse for clinical and persona...SciDataCon - How to increase accessibility and reuse for clinical and persona...
SciDataCon - How to increase accessibility and reuse for clinical and persona...Fiona Nielsen
 
How do we know what we don't know?  Exploring the data and knowledge space th...
How do we know what we don't know?  Exploring the data and knowledge space th...How do we know what we don't know?  Exploring the data and knowledge space th...
How do we know what we don't know?  Exploring the data and knowledge space th...Maryann Martone
 
De walt ecn_2012
De walt ecn_2012De walt ecn_2012
De walt ecn_2012ECNOfficer
 
Workshop finding and accessing data - fiona - lunteren april 18 2016
Workshop   finding and accessing data - fiona - lunteren april 18 2016Workshop   finding and accessing data - fiona - lunteren april 18 2016
Workshop finding and accessing data - fiona - lunteren april 18 2016Fiona Nielsen
 

Similar to Ecosystem challenges around data use (20)

ICG-11 - genomic data projects around the world - nov 5 2016
ICG-11 - genomic data projects around the world - nov 5 2016ICG-11 - genomic data projects around the world - nov 5 2016
ICG-11 - genomic data projects around the world - nov 5 2016
 
ICPSR at a Glance
ICPSR at a GlanceICPSR at a Glance
ICPSR at a Glance
 
Genome data management
Genome data managementGenome data management
Genome data management
 
Data dialogue - Human Genomic Data Discovery
Data dialogue - Human Genomic Data DiscoveryData dialogue - Human Genomic Data Discovery
Data dialogue - Human Genomic Data Discovery
 
Data Landscapes - Addiction
Data Landscapes - AddictionData Landscapes - Addiction
Data Landscapes - Addiction
 
Data Landscapes: The Neuroscience Information Framework
Data Landscapes:  The Neuroscience Information FrameworkData Landscapes:  The Neuroscience Information Framework
Data Landscapes: The Neuroscience Information Framework
 
A Deep Survey of the Digital Resource Landscape
A Deep Survey of the Digital Resource LandscapeA Deep Survey of the Digital Resource Landscape
A Deep Survey of the Digital Resource Landscape
 
Partnering on crop wild relative research at three scales: commonalities for ...
Partnering on crop wild relative research at three scales: commonalities for ...Partnering on crop wild relative research at three scales: commonalities for ...
Partnering on crop wild relative research at three scales: commonalities for ...
 
Partnering on CWR research at three scales: commonalities for success
Partnering on CWR research at three scales: commonalities for successPartnering on CWR research at three scales: commonalities for success
Partnering on CWR research at three scales: commonalities for success
 
GFII 2014 Big Data
GFII 2014 Big DataGFII 2014 Big Data
GFII 2014 Big Data
 
A Deep Survey of the Digital Resource Landscape: Perspectives from the Neuros...
A Deep Survey of the Digital Resource Landscape:Perspectives from the Neuros...A Deep Survey of the Digital Resource Landscape:Perspectives from the Neuros...
A Deep Survey of the Digital Resource Landscape: Perspectives from the Neuros...
 
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
 
Finding and accessing human genome data with Repositive
Finding and accessing human genome data with RepositiveFinding and accessing human genome data with Repositive
Finding and accessing human genome data with Repositive
 
Project Unity: The Way of the Future for Plant Breeding
Project Unity: The Way of the Future for Plant BreedingProject Unity: The Way of the Future for Plant Breeding
Project Unity: The Way of the Future for Plant Breeding
 
Crowdsourcing the Analysis of Genomes
Crowdsourcing the Analysis of GenomesCrowdsourcing the Analysis of Genomes
Crowdsourcing the Analysis of Genomes
 
SciDataCon - How to increase accessibility and reuse for clinical and persona...
SciDataCon - How to increase accessibility and reuse for clinical and persona...SciDataCon - How to increase accessibility and reuse for clinical and persona...
SciDataCon - How to increase accessibility and reuse for clinical and persona...
 
IRDiRC: progress and expectations
IRDiRC: progress and expectationsIRDiRC: progress and expectations
IRDiRC: progress and expectations
 
How do we know what we don't know?  Exploring the data and knowledge space th...
How do we know what we don't know?  Exploring the data and knowledge space th...How do we know what we don't know?  Exploring the data and knowledge space th...
How do we know what we don't know?  Exploring the data and knowledge space th...
 
De walt ecn_2012
De walt ecn_2012De walt ecn_2012
De walt ecn_2012
 
Workshop finding and accessing data - fiona - lunteren april 18 2016
Workshop   finding and accessing data - fiona - lunteren april 18 2016Workshop   finding and accessing data - fiona - lunteren april 18 2016
Workshop finding and accessing data - fiona - lunteren april 18 2016
 

More from Leonid Zhukov

Social Networks: from Micromotives to Macrobehavior
Social Networks: from Micromotives to MacrobehaviorSocial Networks: from Micromotives to Macrobehavior
Social Networks: from Micromotives to MacrobehaviorLeonid Zhukov
 
Russian Big Data Startups
Russian Big Data StartupsRussian Big Data Startups
Russian Big Data StartupsLeonid Zhukov
 
Революция Больших Данных
Революция Больших ДанныхРеволюция Больших Данных
Революция Больших ДанныхLeonid Zhukov
 
Профессия Data Scientist
 Профессия Data Scientist Профессия Data Scientist
Профессия Data ScientistLeonid Zhukov
 
Большие Данные
Большие ДанныеБольшие Данные
Большие ДанныеLeonid Zhukov
 
Business of Big Data
Business of Big DataBusiness of Big Data
Business of Big DataLeonid Zhukov
 
Information cascades
Information cascadesInformation cascades
Information cascadesLeonid Zhukov
 
Инфорамционные каскады
Инфорамционные каскадыИнфорамционные каскады
Инфорамционные каскадыLeonid Zhukov
 
Social Network Analysis
Social Network AnalysisSocial Network Analysis
Social Network AnalysisLeonid Zhukov
 
Numerical Linear Algebra for Data and Link Analysis.
Numerical Linear Algebra for Data and Link Analysis.Numerical Linear Algebra for Data and Link Analysis.
Numerical Linear Algebra for Data and Link Analysis.Leonid Zhukov
 
Numerical Linear Algebra for Data and Link Analysis
Numerical Linear Algebra for Data and Link AnalysisNumerical Linear Algebra for Data and Link Analysis
Numerical Linear Algebra for Data and Link AnalysisLeonid Zhukov
 
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRIOriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRILeonid Zhukov
 
Vis03 Workshop. DT-MRI Visualization
Vis03 Workshop. DT-MRI VisualizationVis03 Workshop. DT-MRI Visualization
Vis03 Workshop. DT-MRI VisualizationLeonid Zhukov
 

More from Leonid Zhukov (16)

Social Networks: from Micromotives to Macrobehavior
Social Networks: from Micromotives to MacrobehaviorSocial Networks: from Micromotives to Macrobehavior
Social Networks: from Micromotives to Macrobehavior
 
Data Scientists
 Data Scientists Data Scientists
Data Scientists
 
Russian Big Data Startups
Russian Big Data StartupsRussian Big Data Startups
Russian Big Data Startups
 
Революция Больших Данных
Революция Больших ДанныхРеволюция Больших Данных
Революция Больших Данных
 
Профессия Data Scientist
 Профессия Data Scientist Профессия Data Scientist
Профессия Data Scientist
 
Большие Данные
Большие ДанныеБольшие Данные
Большие Данные
 
Business of Big Data
Business of Big DataBusiness of Big Data
Business of Big Data
 
Information cascades
Information cascadesInformation cascades
Information cascades
 
Инфорамционные каскады
Инфорамционные каскадыИнфорамционные каскады
Инфорамционные каскады
 
Social Networks
Social NetworksSocial Networks
Social Networks
 
Social Network Analysis
Social Network AnalysisSocial Network Analysis
Social Network Analysis
 
Numerical Linear Algebra for Data and Link Analysis.
Numerical Linear Algebra for Data and Link Analysis.Numerical Linear Algebra for Data and Link Analysis.
Numerical Linear Algebra for Data and Link Analysis.
 
Numerical Linear Algebra for Data and Link Analysis
Numerical Linear Algebra for Data and Link AnalysisNumerical Linear Algebra for Data and Link Analysis
Numerical Linear Algebra for Data and Link Analysis
 
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRIOriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
 
Vis03 Workshop. DT-MRI Visualization
Vis03 Workshop. DT-MRI VisualizationVis03 Workshop. DT-MRI Visualization
Vis03 Workshop. DT-MRI Visualization
 
Monitorium DLP
Monitorium DLPMonitorium DLP
Monitorium DLP
 

Recently uploaded

Call Girls Alandi Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Alandi Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Alandi Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Alandi Call Me 7737669865 Budget Friendly No Advance Bookingroncy bisnoi
 
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)AkefAfaneh2
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.Nitya salvi
 
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...ssuser79fe74
 
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxPSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxSuji236384
 
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Monika Rani
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learninglevieagacer
 
Introduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptxIntroduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptxBhagirath Gogikar
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and ClassificationsAreesha Ahmad
 
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATIONSTS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATIONrouseeyyy
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bSérgio Sacani
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPirithiRaju
 
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedConnaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedDelhi Call girls
 
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flypumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flyPRADYUMMAURYA1
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY1301aanya
 
Unit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 oUnit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 oManavSingh202607
 
COST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptxCOST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptxFarihaAbdulRasheed
 
dkNET Webinar "Texera: A Scalable Cloud Computing Platform for Sharing Data a...
dkNET Webinar "Texera: A Scalable Cloud Computing Platform for Sharing Data a...dkNET Webinar "Texera: A Scalable Cloud Computing Platform for Sharing Data a...
dkNET Webinar "Texera: A Scalable Cloud Computing Platform for Sharing Data a...dkNET
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticssakshisoni2385
 

Recently uploaded (20)

Call Girls Alandi Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Alandi Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Alandi Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Alandi Call Me 7737669865 Budget Friendly No Advance Booking
 
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
 
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxPSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
 
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learning
 
Introduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptxIntroduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptx
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and Classifications
 
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATIONSTS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedConnaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
 
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flypumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
 
Unit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 oUnit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 o
 
COST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptxCOST ESTIMATION FOR A RESEARCH PROJECT.pptx
COST ESTIMATION FOR A RESEARCH PROJECT.pptx
 
dkNET Webinar "Texera: A Scalable Cloud Computing Platform for Sharing Data a...
dkNET Webinar "Texera: A Scalable Cloud Computing Platform for Sharing Data a...dkNET Webinar "Texera: A Scalable Cloud Computing Platform for Sharing Data a...
dkNET Webinar "Texera: A Scalable Cloud Computing Platform for Sharing Data a...
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
 

Ecosystem challenges around data use

  • 1. Ecosystem  Challenges  Around  Data  Use     Leonid  Zhukov  
  • 2. Ancestry.com   2 •  World’s  largest  online  family  history   resource   •  Started  as  a  publishing  company  in   1983,  online  from  1996   •  2.7  million  worldwide  subscribers    
  • 3. Data  at  Ancestry   •  Historical  records  –  company  acquired  content  collecFons   •  User  created  content:   – Ancestor  profiles  and  family  trees   – Uploaded  photographs  and  stories   •  User  behavior  data  on  Ancestry.com   •  Customer  DNA  data   •  10  PB  of  structured  and  unstructured  data   3
  • 4. Historical  records   •  Historical  Content   – 14  billion  historical  records  going  back  to  17th  century   – DigiFzed  and  searchable   4
  • 5. Historical  records   5 •  More  than  30,000  content  collecFons  
  • 6. User  family  trees   6 •  Family  trees:   – 60  million  family  trees   – 6  billion  profiles  
  • 7. Family  trees   77 Power  law  distribuFon    tree  sizes   500  nodes   700  edges   55  generaFons       Fme  
  • 8. User  contributed  content   – 200  million  uploaded    family  photos  and  stories   8
  • 9. Person  and  record  search   9 •  Search  query  
  • 10. Record  linkage   10 •  Record  linkage  –  finding  and  matching  records  in  mulFple  data  sets     with  non-­‐unique  idenFfiers  (data  matching,    enFty  disambiguaFon,   duplicate  detecFon  etc)   •  Goal:  bring  together  informaFon  about  the  same  person   •  Some    non-­‐unique  idenFfiers:   –  Names:  first  name,  last  name  (John  Smith  –  300,000  records)   –  Dates:    date  of  birth,  date  of  death         –  Places:  place  of  birth,  residence,  place  of  death     –  Extra:  family  members,  life  events   •  Records  o_en  incomplete  and  contain  mistakes   •  Other  industries:  banking,  insurance,  government  etc  
  • 11. User  behavior  data   •  User  behavior  data:   – 75  mln  searches  daily   – 10  mln  profiles  added  daily   – 3.5  mln  records  aaached  daily   11
  • 12. DNA  Data   •  Direct  to  consumer  DNA  test   •  700,000  SNPs  per  sample   •  400,000  DNA  samples   •  No  medical  studies       12
  • 13. Ancestry  DNA                 •  GeneFc  ethnicity   – Reference  panel     – 26  ethnic  regions,  3000  samples     13
  • 14. Ancestry  DNA   14 •  GeneFc  inheritance   – IdenFty-­‐by-­‐descent   – Cousin  matching       Matching DNA
  • 15. DNA  data:  privacy  and  research   15 ding how influence nd the re- atments is communi- ability of e distribu- ences and ever, like l informa- ata are pri- sensitive. ed special imination, of insur- r individu- es (1, 2). of these data poses allenges. differ in about 0.1% es in their genomes entific data has led to a search for new tech- nologies. However, the hurdles may be greater than had been suspected. For exam- ple, one approach to protecting privacy is to dustrial, or governmental r agrees to our usage policies of data access) (10). Althou prevent data abuse, it pro monitor usage. Social concern are intricately con about benefits o trustworthiness of governmental ag United States, the Portability and Ac of 1996 (HIPAA) ed Privacy Rules o erally forbid sha data without p However, they do address use or di for human genetic bates in Iceland, and elsewhere (1 range of views on by genetic information. Th may be at one end of this sp izens seem to strongly desir Whatever the setting, we rec man Subject Privacy Zhen Lin,1 Art B. Owen,2 Russ B.Altman1* Privacy Independent SNPs Low Medium High 5 75 100 125 1000 2000 3000 4000 Insufficient for future genomic research Insufficient for privacy protection Needed to find genetic relationshops Trade-offs between SNPs and privacy. Z.  Lin,  A.  Owen,  R.  Altman,  Science,  vol  305,  2004  
  • 16. Challenges   •  Engineering   – Scalability   – Availability   – Security   •  Research   – InformaFon  retrieval     – DNA  genomic  research     •  Privacy      16