SlideShare a Scribd company logo
Cloud BioLinux: pre-Configured and on-demand
computing for genomics independently of institutional,
        geographic or economic boundaries



                 Ntino Krampis, PhD
               JCVI-NIAID workshop 2011
                       S. Africa
Expensive sequencing and large organizations
                    Commodity sequencing and small labs

●
    large sequencing center, multi-million, broad-impact sequencing projects
●   dedicated bioinformatics department, coordination with other centers


●   small-factor, bench-top sequencer available: GS Junior by 454
●   sequencing as a standard technique in basic biology and genetics research
●   RNAseq and ChiPseq, and each biologist will be tackling a metagenome
Acquiring the sequence data is only the first step


●   downstream bioinformatics analysis for scientific discovery

●   many commonly-used bioinformatics tools are difficult to install

●   usually available only as source code - needs technical expertise

●   large-scale sequence data analysis requires high performance
    and expensive computing hardware
Alternative: computational capacity on the cloud


● Cloud Computing: large-scale, high
performance computers accessible
through the Internet

●Example: using Gmail, Google Docs,
Yahoo! Mail, FaceBook etc. you store and
access data on a remote computer

●Cloud Computing services - Amazon
EC2 (http://aws.amazon.com/ec2) rent high
computational and data storage capacity
on remote computers
How does Cloud Computing work ?

                                               remote Amazon EC2 Cloud Computing service
operating system, bioinformatics software
and data, are installed in a Virtual Machine           VM                VM                VM
(VM)

a VM is uploaded and executed on a cloud
computing service

run a practically unlimited number of VMs                              Internet
for large-scale sequence data analysis

access VM on a desktop computer through
the Internet

                                                       local desktop computers
Cloud BioLinux


●   Cloud BioLinux by leverages VM technology and the
    cloud, offering pre-configured bioinformatics computing

●   allow setting up a high-performance data analysis
    environment, without any technical expertise

●   researchers can perform large-scale data analysis, by
    simply using a desktop computer with Internet access

●   accessible without any institutional, economic or national
    boundaries
Launching Cloud BioLinux

1. sign up for an Amazon EC2 cloud account:
   http://aws.amazon.com/ec2

   Also can connect an existing account from the main Amazon.com website
   for the cloud usage charges. We have an account ready for you:

   Username: aws_nhgri@jcvi.org
   Password: Nhg4|CL0ud!

2. using the account credentials sign in to the EC2 cloud console
   (select EC2 in the dropdown menu below the sign-in button):
   http://aws.amazon.com/console

3. launch Cloud BioLinux through the cloud console wizard
Launching Cloud BioLinux




                                Click the
                                button :




http://aws.amazon.com/console
Launch instance wizard: steps 1 & 2

                                       1. specify the Cloud
                                      BioLinux identifier
                                      under “Community
                                          AMIs” tab




                                        2. computational
                                       capacity: memory,
                                      processor, CPU cores
Launch instance wizard: step 3

                                      3. specify a
                                 password for login for
                                  the Cloud BioLinux
                                 desktop, under “User
                                       Data” box



                                   4. remaining steps:
                                   all as default, keep
                                       clicking the
                                   “Continue” button
                                     until the wizard
                                  finishes and you are
                                   back to the console
Launching
    Cloud
  BioLinux


   back to the
 console after
 we completed
  the wizard

 Pick a running
instance, select
   with your
   mouse and
copy its “Public
DNS” address
     (Cloud
   BioLinux
 server address
  on the cloud)
While waiting for Cloud BioLinux to boot up...

●   examples of NCBI public datasets on EC2
●   bringing the data to the compute
Final step: connecting remotely to Cloud BioLinux
                       click the NX client icon on your computer's desktop




A. paste the DNS in the “Host” box           B. select “Unix”, “Gnome”, remote desktop size




  C. “ubuntu” is the default user Login
     “workshop” is the password we set
What if I want to
    share my
alignments with
a collaborator?

save your data as
   a new VM

  0.10$ / GB /
     month

at 15GB, it costs
  1.5$ / month
Cloud BioLinux
                                whole system snapshot exchange
share your analysis results: publicly or only with your
                     collaborators

authorized users can access the cloud VM/image with
       all the software, data, analysis results
Cloud BioLinux and Genomic Standards
                        whole system snapshot exchange



                start VM / image           share


                perform analysis           snapshot           researcher B
researcher A

                snapshot                   perform analysis


                share                      start VM / image
Acknowledgments & Credits
Brad Chapman      - development of the fabric scripts and community organizer
Tim Booth, Bela Tiwari, Dawn Field – BioLinux 6.0 development and EC2 documentation
Deepak Singh and AWS - education grant supporting ISMB / BOSC workshop
Justin Johnson    –   community and sponsorship of cloudbiolinux.com
J. Craig Venter Inst. - time allowed to work on an open-source project
D. Gomez, E. Navarro, J. Shao, I. Singh – JCVI technology innovation

Members of the Cloud Biolinux community:
Enis Afgan
Michael Heuer
Richard Holland
Mark Jensen                                        Thank you !
Dave Messina
Steffen Möller
Roman Valls

More Related Content

Viewers also liked

IVI Workshop Value Creation in European Pe
IVI Workshop Value Creation in European PeIVI Workshop Value Creation in European Pe
IVI Workshop Value Creation in European Pe
Thomas Nastas
 
Animals In Farm
Animals In FarmAnimals In Farm
Animals In Farm
mateca2
 
I Dream of Justice, I Dream of Change
I Dream of Justice, I Dream of ChangeI Dream of Justice, I Dream of Change
I Dream of Justice, I Dream of Change
ewingj33
 
iPhone offline webapps
iPhone offline webappsiPhone offline webapps
iPhone offline webapps
Home
 
AGENTS OF GOD
AGENTS OF GOD AGENTS OF GOD
Strabunicul meu - Mihai Dragan
Strabunicul meu - Mihai DraganStrabunicul meu - Mihai Dragan
Strabunicul meu - Mihai Dragan
GeekMeet
 
Force Majeure: a Time Bomb
Force Majeure: a Time BombForce Majeure: a Time Bomb
Force Majeure: a Time Bomb
Oboni Riskope Associates Inc.
 
Cinch Inch Loss Plan Testimonials
Cinch Inch Loss Plan TestimonialsCinch Inch Loss Plan Testimonials
Cinch Inch Loss Plan Testimonials
Johnine Bailey
 
Webinar: Measuring Online Brand Loyalty and Benchmarking websites: Cartier, G...
Webinar: Measuring Online Brand Loyalty and Benchmarking websites: Cartier, G...Webinar: Measuring Online Brand Loyalty and Benchmarking websites: Cartier, G...
Webinar: Measuring Online Brand Loyalty and Benchmarking websites: Cartier, G...
UserZoom
 
MOTIVATION
MOTIVATIONMOTIVATION
Glucose english
Glucose englishGlucose english
Glucose english
Karunadasa Hettiarachchi
 
Ieeej 2010
Ieeej 2010Ieeej 2010
Ieeej 2010
Debopriyo Roy
 
G4
G4G4
G4
katsen
 
Going the extra mile in designing for the web
Going the extra mile in designing for the webGoing the extra mile in designing for the web
Going the extra mile in designing for the web
Home
 
OWLED2009: A platform for distributing and reasoning with OWL-EL knowledge ba...
OWLED2009: A platform for distributing and reasoning with OWL-EL knowledge ba...OWLED2009: A platform for distributing and reasoning with OWL-EL knowledge ba...
OWLED2009: A platform for distributing and reasoning with OWL-EL knowledge ba...
Michel Dumontier
 
Cio Summit 2008
Cio Summit 2008Cio Summit 2008
Cio Summit 2008
Tomas Gregorio MBA
 
Catalogo tony tallarin
Catalogo tony tallarinCatalogo tony tallarin
Catalogo tony tallarinAndres Garces
 
Hopf anemia09
Hopf anemia09Hopf anemia09
Hopf anemia09
Harriet Hopf
 

Viewers also liked (20)

IVI Workshop Value Creation in European Pe
IVI Workshop Value Creation in European PeIVI Workshop Value Creation in European Pe
IVI Workshop Value Creation in European Pe
 
Animals In Farm
Animals In FarmAnimals In Farm
Animals In Farm
 
Burlata
BurlataBurlata
Burlata
 
I Dream of Justice, I Dream of Change
I Dream of Justice, I Dream of ChangeI Dream of Justice, I Dream of Change
I Dream of Justice, I Dream of Change
 
iPhone offline webapps
iPhone offline webappsiPhone offline webapps
iPhone offline webapps
 
AGENTS OF GOD
AGENTS OF GOD AGENTS OF GOD
AGENTS OF GOD
 
Strabunicul meu - Mihai Dragan
Strabunicul meu - Mihai DraganStrabunicul meu - Mihai Dragan
Strabunicul meu - Mihai Dragan
 
Force Majeure: a Time Bomb
Force Majeure: a Time BombForce Majeure: a Time Bomb
Force Majeure: a Time Bomb
 
Cinch Inch Loss Plan Testimonials
Cinch Inch Loss Plan TestimonialsCinch Inch Loss Plan Testimonials
Cinch Inch Loss Plan Testimonials
 
Stripgenerator
StripgeneratorStripgenerator
Stripgenerator
 
Webinar: Measuring Online Brand Loyalty and Benchmarking websites: Cartier, G...
Webinar: Measuring Online Brand Loyalty and Benchmarking websites: Cartier, G...Webinar: Measuring Online Brand Loyalty and Benchmarking websites: Cartier, G...
Webinar: Measuring Online Brand Loyalty and Benchmarking websites: Cartier, G...
 
MOTIVATION
MOTIVATIONMOTIVATION
MOTIVATION
 
Glucose english
Glucose englishGlucose english
Glucose english
 
Ieeej 2010
Ieeej 2010Ieeej 2010
Ieeej 2010
 
G4
G4G4
G4
 
Going the extra mile in designing for the web
Going the extra mile in designing for the webGoing the extra mile in designing for the web
Going the extra mile in designing for the web
 
OWLED2009: A platform for distributing and reasoning with OWL-EL knowledge ba...
OWLED2009: A platform for distributing and reasoning with OWL-EL knowledge ba...OWLED2009: A platform for distributing and reasoning with OWL-EL knowledge ba...
OWLED2009: A platform for distributing and reasoning with OWL-EL knowledge ba...
 
Cio Summit 2008
Cio Summit 2008Cio Summit 2008
Cio Summit 2008
 
Catalogo tony tallarin
Catalogo tony tallarinCatalogo tony tallarin
Catalogo tony tallarin
 
Hopf anemia09
Hopf anemia09Hopf anemia09
Hopf anemia09
 

Similar to Cloud ntino-krampis

CHPC Workshop Morning Session
CHPC Workshop Morning SessionCHPC Workshop Morning Session
CHPC Workshop Morning Session
Ntino Krampis
 
Ntino Krampis GSC 2011
Ntino Krampis GSC 2011Ntino Krampis GSC 2011
Ntino Krampis GSC 2011
Ntino Krampis
 
F02-Cloud-Cloud BioLinux
F02-Cloud-Cloud BioLinuxF02-Cloud-Cloud BioLinux
F02-Cloud-Cloud BioLinux
Bioinformatics Open Source Conference
 
Chi next gen-ntino-krampis
Chi next gen-ntino-krampisChi next gen-ntino-krampis
Chi next gen-ntino-krampis
Ntino Krampis
 
Bosc2011 ntino-krampis-full
Bosc2011 ntino-krampis-fullBosc2011 ntino-krampis-full
Bosc2011 ntino-krampis-full
Bioinformatics Open Source Conference
 
Machine Learning , Analytics & Cyber Security the Next Level Threat Analytics...
Machine Learning , Analytics & Cyber Security the Next Level Threat Analytics...Machine Learning , Analytics & Cyber Security the Next Level Threat Analytics...
Machine Learning , Analytics & Cyber Security the Next Level Threat Analytics...
PranavPatil822557
 
Amazon resource for bioinformatics
Amazon resource for bioinformaticsAmazon resource for bioinformatics
Amazon resource for bioinformatics
Brad Chapman
 
Volunteer Computing using BOINC
Volunteer Computing using BOINCVolunteer Computing using BOINC
Volunteer Computing using BOINC
Pooyan Mehrparvar
 
Understanding Kubernetes
Understanding KubernetesUnderstanding Kubernetes
Understanding Kubernetes
Tu Pham
 
The world of Docker and Kubernetes
The world of Docker and Kubernetes The world of Docker and Kubernetes
The world of Docker and Kubernetes
vty
 
Oscon 2017: Build your own container-based system with the Moby project
Oscon 2017: Build your own container-based system with the Moby projectOscon 2017: Build your own container-based system with the Moby project
Oscon 2017: Build your own container-based system with the Moby project
Patrick Chanezon
 
A Tale of Two Pizzas: Developer Tools at AWS - DevDay Los Angeles 2017
A Tale of Two Pizzas: Developer Tools at AWS - DevDay Los Angeles 2017A Tale of Two Pizzas: Developer Tools at AWS - DevDay Los Angeles 2017
A Tale of Two Pizzas: Developer Tools at AWS - DevDay Los Angeles 2017
Amazon Web Services
 
Raspberry pi x kubernetes x tensorflow
Raspberry pi x kubernetes x tensorflowRaspberry pi x kubernetes x tensorflow
Raspberry pi x kubernetes x tensorflow
霈萱 蔡
 
Shifting security to the left with kubernetes, azure, and istio
Shifting security to the left with kubernetes, azure, and istioShifting security to the left with kubernetes, azure, and istio
Shifting security to the left with kubernetes, azure, and istio
Christian Melendez
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the CloudHigh Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the Cloud
The UberCloud
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the CloudHigh Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the Cloud
Wolfgang Gentzsch
 
Docker Application to Scientific Computing
Docker Application to Scientific ComputingDocker Application to Scientific Computing
Docker Application to Scientific Computing
Peter Bryzgalov
 
.docker : How to deploy Digital Experience in a container, drinking a cup of ...
.docker : How to deploy Digital Experience in a container, drinking a cup of ....docker : How to deploy Digital Experience in a container, drinking a cup of ...
.docker : How to deploy Digital Experience in a container, drinking a cup of ...
ICON UK EVENTS Limited
 
Applied Security for Containers, OW2con'18, June 7-8, 2018, Paris
Applied Security for Containers, OW2con'18, June 7-8, 2018, ParisApplied Security for Containers, OW2con'18, June 7-8, 2018, Paris
Applied Security for Containers, OW2con'18, June 7-8, 2018, Paris
OW2
 
Ionic Native: Native-powered apps, without the hassle
Ionic Native: Native-powered apps, without the hassleIonic Native: Native-powered apps, without the hassle
Ionic Native: Native-powered apps, without the hassle
Ionic Framework
 

Similar to Cloud ntino-krampis (20)

CHPC Workshop Morning Session
CHPC Workshop Morning SessionCHPC Workshop Morning Session
CHPC Workshop Morning Session
 
Ntino Krampis GSC 2011
Ntino Krampis GSC 2011Ntino Krampis GSC 2011
Ntino Krampis GSC 2011
 
F02-Cloud-Cloud BioLinux
F02-Cloud-Cloud BioLinuxF02-Cloud-Cloud BioLinux
F02-Cloud-Cloud BioLinux
 
Chi next gen-ntino-krampis
Chi next gen-ntino-krampisChi next gen-ntino-krampis
Chi next gen-ntino-krampis
 
Bosc2011 ntino-krampis-full
Bosc2011 ntino-krampis-fullBosc2011 ntino-krampis-full
Bosc2011 ntino-krampis-full
 
Machine Learning , Analytics & Cyber Security the Next Level Threat Analytics...
Machine Learning , Analytics & Cyber Security the Next Level Threat Analytics...Machine Learning , Analytics & Cyber Security the Next Level Threat Analytics...
Machine Learning , Analytics & Cyber Security the Next Level Threat Analytics...
 
Amazon resource for bioinformatics
Amazon resource for bioinformaticsAmazon resource for bioinformatics
Amazon resource for bioinformatics
 
Volunteer Computing using BOINC
Volunteer Computing using BOINCVolunteer Computing using BOINC
Volunteer Computing using BOINC
 
Understanding Kubernetes
Understanding KubernetesUnderstanding Kubernetes
Understanding Kubernetes
 
The world of Docker and Kubernetes
The world of Docker and Kubernetes The world of Docker and Kubernetes
The world of Docker and Kubernetes
 
Oscon 2017: Build your own container-based system with the Moby project
Oscon 2017: Build your own container-based system with the Moby projectOscon 2017: Build your own container-based system with the Moby project
Oscon 2017: Build your own container-based system with the Moby project
 
A Tale of Two Pizzas: Developer Tools at AWS - DevDay Los Angeles 2017
A Tale of Two Pizzas: Developer Tools at AWS - DevDay Los Angeles 2017A Tale of Two Pizzas: Developer Tools at AWS - DevDay Los Angeles 2017
A Tale of Two Pizzas: Developer Tools at AWS - DevDay Los Angeles 2017
 
Raspberry pi x kubernetes x tensorflow
Raspberry pi x kubernetes x tensorflowRaspberry pi x kubernetes x tensorflow
Raspberry pi x kubernetes x tensorflow
 
Shifting security to the left with kubernetes, azure, and istio
Shifting security to the left with kubernetes, azure, and istioShifting security to the left with kubernetes, azure, and istio
Shifting security to the left with kubernetes, azure, and istio
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the CloudHigh Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the Cloud
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the CloudHigh Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the Cloud
 
Docker Application to Scientific Computing
Docker Application to Scientific ComputingDocker Application to Scientific Computing
Docker Application to Scientific Computing
 
.docker : How to deploy Digital Experience in a container, drinking a cup of ...
.docker : How to deploy Digital Experience in a container, drinking a cup of ....docker : How to deploy Digital Experience in a container, drinking a cup of ...
.docker : How to deploy Digital Experience in a container, drinking a cup of ...
 
Applied Security for Containers, OW2con'18, June 7-8, 2018, Paris
Applied Security for Containers, OW2con'18, June 7-8, 2018, ParisApplied Security for Containers, OW2con'18, June 7-8, 2018, Paris
Applied Security for Containers, OW2con'18, June 7-8, 2018, Paris
 
Ionic Native: Native-powered apps, without the hassle
Ionic Native: Native-powered apps, without the hassleIonic Native: Native-powered apps, without the hassle
Ionic Native: Native-powered apps, without the hassle
 

Recently uploaded

HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 

Recently uploaded (20)

HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 

Cloud ntino-krampis

  • 1. Cloud BioLinux: pre-Configured and on-demand computing for genomics independently of institutional, geographic or economic boundaries Ntino Krampis, PhD JCVI-NIAID workshop 2011 S. Africa
  • 2. Expensive sequencing and large organizations Commodity sequencing and small labs ● large sequencing center, multi-million, broad-impact sequencing projects ● dedicated bioinformatics department, coordination with other centers ● small-factor, bench-top sequencer available: GS Junior by 454 ● sequencing as a standard technique in basic biology and genetics research ● RNAseq and ChiPseq, and each biologist will be tackling a metagenome
  • 3. Acquiring the sequence data is only the first step ● downstream bioinformatics analysis for scientific discovery ● many commonly-used bioinformatics tools are difficult to install ● usually available only as source code - needs technical expertise ● large-scale sequence data analysis requires high performance and expensive computing hardware
  • 4. Alternative: computational capacity on the cloud ● Cloud Computing: large-scale, high performance computers accessible through the Internet ●Example: using Gmail, Google Docs, Yahoo! Mail, FaceBook etc. you store and access data on a remote computer ●Cloud Computing services - Amazon EC2 (http://aws.amazon.com/ec2) rent high computational and data storage capacity on remote computers
  • 5. How does Cloud Computing work ? remote Amazon EC2 Cloud Computing service operating system, bioinformatics software and data, are installed in a Virtual Machine VM VM VM (VM) a VM is uploaded and executed on a cloud computing service run a practically unlimited number of VMs Internet for large-scale sequence data analysis access VM on a desktop computer through the Internet local desktop computers
  • 6. Cloud BioLinux ● Cloud BioLinux by leverages VM technology and the cloud, offering pre-configured bioinformatics computing ● allow setting up a high-performance data analysis environment, without any technical expertise ● researchers can perform large-scale data analysis, by simply using a desktop computer with Internet access ● accessible without any institutional, economic or national boundaries
  • 7. Launching Cloud BioLinux 1. sign up for an Amazon EC2 cloud account: http://aws.amazon.com/ec2 Also can connect an existing account from the main Amazon.com website for the cloud usage charges. We have an account ready for you: Username: aws_nhgri@jcvi.org Password: Nhg4|CL0ud! 2. using the account credentials sign in to the EC2 cloud console (select EC2 in the dropdown menu below the sign-in button): http://aws.amazon.com/console 3. launch Cloud BioLinux through the cloud console wizard
  • 8. Launching Cloud BioLinux Click the button : http://aws.amazon.com/console
  • 9. Launch instance wizard: steps 1 & 2 1. specify the Cloud BioLinux identifier under “Community AMIs” tab 2. computational capacity: memory, processor, CPU cores
  • 10. Launch instance wizard: step 3 3. specify a password for login for the Cloud BioLinux desktop, under “User Data” box 4. remaining steps: all as default, keep clicking the “Continue” button until the wizard finishes and you are back to the console
  • 11. Launching Cloud BioLinux back to the console after we completed the wizard Pick a running instance, select with your mouse and copy its “Public DNS” address (Cloud BioLinux server address on the cloud)
  • 12. While waiting for Cloud BioLinux to boot up... ● examples of NCBI public datasets on EC2 ● bringing the data to the compute
  • 13. Final step: connecting remotely to Cloud BioLinux click the NX client icon on your computer's desktop A. paste the DNS in the “Host” box B. select “Unix”, “Gnome”, remote desktop size C. “ubuntu” is the default user Login “workshop” is the password we set
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27. What if I want to share my alignments with a collaborator? save your data as a new VM 0.10$ / GB / month at 15GB, it costs 1.5$ / month
  • 28. Cloud BioLinux whole system snapshot exchange share your analysis results: publicly or only with your collaborators authorized users can access the cloud VM/image with all the software, data, analysis results
  • 29. Cloud BioLinux and Genomic Standards whole system snapshot exchange start VM / image share perform analysis snapshot researcher B researcher A snapshot perform analysis share start VM / image
  • 30. Acknowledgments & Credits Brad Chapman - development of the fabric scripts and community organizer Tim Booth, Bela Tiwari, Dawn Field – BioLinux 6.0 development and EC2 documentation Deepak Singh and AWS - education grant supporting ISMB / BOSC workshop Justin Johnson – community and sponsorship of cloudbiolinux.com J. Craig Venter Inst. - time allowed to work on an open-source project D. Gomez, E. Navarro, J. Shao, I. Singh – JCVI technology innovation Members of the Cloud Biolinux community: Enis Afgan Michael Heuer Richard Holland Mark Jensen Thank you ! Dave Messina Steffen Möller Roman Valls