Human Genome Project"
Collaborative project to sequence every single letter!
of the human genetic code.!
13 years and $billions to complete.!
Gigabyte scale datasets (transferred between sites on!
Beyond the Human Genome"
45+ species sequenced: mouse, rat, gorilla, rabbit, !
platypus, nematode, zebra ﬁsh...!
Compare genomes between species to identify!
biologically interesting areas of the genome.!
100Gb scale datasets. Increased computational
The Next Generation"
New sequencing instruments lead to a dramatic!
drop in cost and time required to sequence a genome.!
Sequence and compare genetic code of individuals to!
ﬁnd areas of variation. Much more interesting.!
Terabyte scale datasets. Signiﬁcant computational
The 1000 Genomes Projects"
Public/private consortium to build world’s largest!
collection of human genetic variation.!
Hugely important dataset to drive new insight into!
known genetic traits, and the identiﬁcation of new ones.!
Vast, complex data and computational resources required,
beyond reach of most research groups and hospitals.!
1000 Genomes in the Cloud"
The 1000 Genomes data made available to all on AWS.!
Stored for free as part of the Public Datasets program.!
200Tb. 1700 individual genomes. As much compute and
storage as required available to all.!
75% of users select"
movies based on"
More than 27 million users!
~ 30 million plays per day!
More than 40 billion events per day !
~ 4 million ratings per day!
~ 3 million searches per day!
Time of day and week (it now can verify that users watch more TV shows during
the week and more movies during the weekend)!
Metadata from third parties such as Nielsen!
Social media data from Facebook and Twitter!
Amazon Web Services
AZ AZ AZ
Durable, highly consistent storage replicates data
across three data centers (availability zones)
archive to S3
100s of terabytes
of events supports
in Hadoop or a
Inexpensive: $0.028 per million puts
• Tens of millions records/sec
• Multiple TB per hour
• 100,000s of sources
• Scale with the business
• Provide real-time alerting
• Improved auditing
Over 200 internal
Data staged in
Ad hoc query