8 mattwoodaws-intro-pdf-110411093115-phpapp01

Cloud Research Matt Wood T E C H N O L O G Y E VA N G E L I S T

Hello.

Thank you.

The Cloud by Example

Infrastructure services

On demand

Pay as you go

Pay for what you use

Elastic capacity

Capacity Estimated demand Time

Capacity Infrastructure Investment Estimated demand Time

Capacity Infrastructure Real demand Time

Capacity Elastic capacity Real demand Time

Agility

Faster toprototype

Faster toproduction

Undifferentiated heavy lifting

Tools foraccelerating research

300 225 150 75Q4 2006 Q4 2007 Q4 2008 0 Q4 2009 Q4 2010

The Cloud by Example

Data management

Biomarker Warehousepre-clinical, clinical, 3rd party data and publications ;<./5=>?6@ !)*(%"&& 23,341561789:1 !#%&$(%&&& +,-./01 !"#$%"&& 6178170 6A.7341 B817-135 Estimated cost: 10 TB warehouse over 3 years

Data processing

http://cyclecomputing.com

http://web.mit.edu/stardev/cluster/

sudo gem install cloud-crowd http://cyclecomputing.comhttp://wiki.github.com/documentcloud/cloud-crowd

http://www.rightscale.com

Amazon Elastic MapReduce Amazon EC2 Instances EndDeploy Application Hadoop Hadoop Hadoop Elastic Elastic MapReduce MapReduce Hadoop Hadoop Hadoop NotifyWeb Console, Command line tools Input output dataset results Input S3 Output S3 Get Results Input Data bucket bucket Amazon S3

Crossbow: Rapid whole genome SNP analysis Preprocessed reads Map: Bowtie Sort: Bin and partition Reduce: SoapSNP Langmead B, Schatz MC, Lin, J, Pop M, Salzberg SL. Genome Biol 10(11): R134.

CloudBurstCatalog k-mers Collect seeds End-to-end alignment http://cloudburst-bio.sourceforge.net; Bioinformatics 2009 25: 1363-1369

ASSEMBLING GENOMES 140 million 454 readsImage: Ma) Wood

BLAT @ U. PENNMap 100 million, 100 base paired end readsQuad core with 5 GB of RAM would take 16 days30 high-memory instances; 32 hours; $195

HEAVY-ION COLLISIONS @ RHICProblem: Quark physics conference imminentbut no compute resources handySolution: NIMBUS context broker allowedresearchers to provision 300 nodes and get thesimulations done

Collaboration

http://aws.amazon.com/publicdatasets/

http://www.cloudbiolinux.com/

http://usegalaxy.org/cloud

Applications and platforms

http://heroku.com

http://chempedia.com/

Security

Sharedresponsibility

Requirementbased access

Certiﬁcation

ISO 27001 +SAS 70 Type II

PCI DSS Level 1

Control objectivesSecurity organisation Employee lifecycle Logical security Secure data handling Physical security Environmental safeguardsChange management Incident handling Availability and Data integrity redundancy

Data access control

Identity and access

GeographicallyIndependent buildings Separate ﬂood zones separated Redundant Redundant Highly monitored power connectivity

Default deny ﬁrewall

Security groups

DDOSMan in the Middle IP spooﬁng

ResourceisolationVirtual Private Cloud

Customer’s isolated AWS resources Subnet 1 Subnet 2 VPN Gateway Router Secure VPN connection over the internet Subnet 3 Subnet 4Customer’s network Amazon Web Services infrastructure

DedicatedinstancesVirtual Private Cloud

aws.amazon.com/security

Data stays local

aws.amazon.com

Thank you!

Q U E S T I O N S + C O M M E N T Smatthew@amazon.com @mza O N T W I T T E R

8 mattwoodaws-intro-pdf-110411093115-phpapp01

by Carl Chesal

Accessibility

Categories

Upload Details

Usage Rights

Statistics

8 mattwoodaws-intro-pdf-110411093115-phpapp01 Presentation Transcript