IFB cloud:
Integration of snakemake workflows in
an appliance designed for ChIP-seq analysis
Claire Rioualen
2015/10/28
French Institute of Bioinformatics (IFB)
● National service infrastructure in
bioinformatics
● 32 platforms grouped into regional
centers
● French node of the European
research infrastructure ELIXIR
French Institute of Bioinformatics (IFB)
● National service infrastructure in
bioinformatics
● 32 platforms grouped into regional
centers
● French node of the European
research infrastructure ELIXIR
● Provides services and infrastructures in bioinformatics for
scientists and engineers working in the field of life sciences
http://www.france-bioinformatique.fr
IFB cloud
● 200 computing cores
● 2 To of RAM
● 50 To of storage
By 2016
● 3,000 cores
● 500 To of storage
By 2017
● 10,000 cores
● 2 Po of storage
IFB cloud appliances
ChIP-seq appliance
● Base Ubuntu 14.04
Including ssh, rsync, git, python 2, python 3...
ChIP-seq appliance
● Base Ubuntu 14.04
Including ssh, rsync, git, python 2, python 3...
● Programming tools
snakemake, graphviz, pandas library...
ChIP-seq appliance
● Base Ubuntu 14.04
Including ssh, rsync, git, python 2, python 3...
● Programming tools
snakemake, graphviz, pandas library...
● NGS tools
ChIP-seq appliance
● Base Ubuntu 14.04
Including ssh, rsync, git, python 2, python 3...
● Programming tools
snakemake, graphviz, pandas library...
● NGS tools
● fg-chip-seq git repository
Including workflow examples (py + json)
Using the IFB cloud: request account
cloud.france-bioinformatique.fr
Request account
Using the IFB cloud: dashboard
cloud.france-bioinformatique.fr
Add ssh key
Create a virtual disk
Using the IFB cloud: vDisk
cloud.france-bioinformatique.fr
Size (Go)
Name
Using the IFB cloud: create instance
cloud.france-bioinformatique.fr
Choose appliance
Plug vDisk
Up to 8 CPU,
32GB RAM
Name
Using the IFB cloud: ssh connection
cloud.france-bioinformatique.fr
ssh connection
Using the IFB cloud: data
Using the IFB cloud: execute workflow
● Several example workflows already available &
adaptable in the git repository
● 1 config file (json) + 1 workflow file (py)
● Paths to data, genome & results directories
● Parameters
Using the IFB cloud: execute workflow
● Several example workflows already available &
adaptable in the git repository
● 1 config file (json) + 1 workflow file (py)
● Paths to data, genome & results directories
● Parameters
● Results are saved in the vDisk
Thank you!

IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis

  • 1.
    IFB cloud: Integration ofsnakemake workflows in an appliance designed for ChIP-seq analysis Claire Rioualen 2015/10/28
  • 2.
    French Institute ofBioinformatics (IFB) ● National service infrastructure in bioinformatics ● 32 platforms grouped into regional centers ● French node of the European research infrastructure ELIXIR
  • 3.
    French Institute ofBioinformatics (IFB) ● National service infrastructure in bioinformatics ● 32 platforms grouped into regional centers ● French node of the European research infrastructure ELIXIR ● Provides services and infrastructures in bioinformatics for scientists and engineers working in the field of life sciences http://www.france-bioinformatique.fr
  • 4.
    IFB cloud ● 200computing cores ● 2 To of RAM ● 50 To of storage By 2016 ● 3,000 cores ● 500 To of storage By 2017 ● 10,000 cores ● 2 Po of storage
  • 5.
  • 7.
    ChIP-seq appliance ● BaseUbuntu 14.04 Including ssh, rsync, git, python 2, python 3...
  • 8.
    ChIP-seq appliance ● BaseUbuntu 14.04 Including ssh, rsync, git, python 2, python 3... ● Programming tools snakemake, graphviz, pandas library...
  • 9.
    ChIP-seq appliance ● BaseUbuntu 14.04 Including ssh, rsync, git, python 2, python 3... ● Programming tools snakemake, graphviz, pandas library... ● NGS tools
  • 10.
    ChIP-seq appliance ● BaseUbuntu 14.04 Including ssh, rsync, git, python 2, python 3... ● Programming tools snakemake, graphviz, pandas library... ● NGS tools ● fg-chip-seq git repository Including workflow examples (py + json)
  • 11.
    Using the IFBcloud: request account cloud.france-bioinformatique.fr Request account
  • 12.
    Using the IFBcloud: dashboard cloud.france-bioinformatique.fr Add ssh key Create a virtual disk
  • 13.
    Using the IFBcloud: vDisk cloud.france-bioinformatique.fr Size (Go) Name
  • 14.
    Using the IFBcloud: create instance cloud.france-bioinformatique.fr Choose appliance Plug vDisk Up to 8 CPU, 32GB RAM Name
  • 15.
    Using the IFBcloud: ssh connection cloud.france-bioinformatique.fr ssh connection
  • 16.
    Using the IFBcloud: data
  • 17.
    Using the IFBcloud: execute workflow ● Several example workflows already available & adaptable in the git repository ● 1 config file (json) + 1 workflow file (py) ● Paths to data, genome & results directories ● Parameters
  • 18.
    Using the IFBcloud: execute workflow ● Several example workflows already available & adaptable in the git repository ● 1 config file (json) + 1 workflow file (py) ● Paths to data, genome & results directories ● Parameters ● Results are saved in the vDisk
  • 19.