SlideShare a Scribd company logo
1 of 17
usegalaxy.*
Global Galaxy for Everyone
Simon Gladman, 2018
Public Galaxy servers - In the beginning..
usegalaxy.org - Galaxy Main
● Run out of many
institutions in the USA
○ Penn State, Johns Hopkins,
Oregon Health and Science Uni.
○ TACC, JetStream, CyVerse,
Massive
● Many users
● Constantly large queue
Public Galaxy servers - In Australia..
● Galaxy-QLD
○ Set up for QLD but
globally public
● Galaxy-Mel
○ Set up for VIC but
globally public
● Galaxy-Tut
○ For workshops
● And many others!
Public Galaxy servers - In Australia..
Galaxy-QLD
+ Galaxy-Mel
+ Galaxy-Tut
=
Galaxy-Australia
usegalaxy.org.au
Public Galaxy servers - And the list grew..
● Different versions
● Different tools
● Different references
● User confusion
● Lots of duplication of effort
So we got together..
● At Galaxy Australasia Meeting 2017
○ Key people from US, Europe, Australia
including Galaxy PI.
○ Agreed to work together to support
publically available Galaxys
○ Do as much together as possible
And so usegalaxy.* was born
What is usegalaxy.*?
Group of public Galaxy servers
● Present a similar experience to
users no matter which they use
● Guarantee a minimum service
○ Tools & versions
○ Reference Data
○ Reproducibility
○ Training materials
● Starting with USA, Europe and
Australia, more welcome!
● Manage with community
assets/repositories
● Don’t prescribe hardware resources
usegalaxy.* servers
Community assets
usegalaxy.* - Tools
Shared repository of tool lists
● Minimum tools
○ Genomics and others
● Extra tools
○ Metagenomics
○ Proteomics
○ Metabolomics
● Curation/maintenance of tools and
versions
● Automatic upgrades and installation
of trusted tools
● Still allow local specialisations
usegalaxy.* - Reference Data/Indices
CVM-FS Tier 0
Reference
Data/Indices
usegalaxy.eu
usegalaxy.org.au
usegalaxy.org
CVM-FS Tier 1
Data/Indices
Cache
CVM-FS Tier 1
Data/Indices
Cache
Run by usegalaxy.org staff
● Genomic references
● Tool indices
Tier 1 uses smart caching
● On demand
● Local specialisation
usegalaxy.* - Look and Feel
usegalaxy.* servers should:
● Run the latest stable Galaxy release
● Present the user with similar tool list
layout
● Be able to run all of the Galaxy
Training Network’s core tutorials
● Have same testing/training datasets
available
usegalaxy.* - Future - Tools
Global repository of Tools in
containers
● Use CVMFS for smart distribution
similar to References
● Singularity containers
● Galaxy just uses appropriate container
● Much easier to manage tool lists and
versioning
CernVM-FS
Singularity containers
usegalaxy.* - Future - References
● Move to a
community based
model
● Improve metadata
availability
● Improve reference
data provenance
usegalaxy.eu
usegalaxy.org.au
usegalaxy.orgCVM-FS Tier 1
Data/Indices
Cache
CVM-FS Tier 1
Data/Indices
Cache
CVM-FS Tier 0
Reference
Data/Indices
usegalaxy.* - Proposed Global Architecture
Community Managed
Globally Distributed
Reference
Data/Indices
Tool Containers
usegalaxy.eu
usegalaxy.org.au
usegalaxy.org
usegalaxy.* - Future - BYOC
Trialling BYOC now in Australia and Europe
● Adding Melbourne/Sydney/Other resources to Galaxy Australia
● Adding Czech/Dutch and other resources to Galaxy Europe
Goal is to allow user/group to add their compute/storage
resources
Dynamic job allocation will know
● Where user is from
● What resources they can use
usegalaxy.* - Australian Architecture
usegalaxy.* - Ultimate goal - Single Sign-on
The ultimate goal!
● Sign on in Global
Galaxy WebServer!
● Job is run where-
ever your compute
and data is located!
Compute
Compute
Compute
Compute
Compute
Compute
Compute
It’s a big effort..
Gareth Price
Simon Gladman
Derek Benson
Anna Syme
Igor Makunin
Nuwan Goonasekera
Christina Hall
Helen van der Pol
Andrew Lonie
Björn Grüning
Helena Rasche
Bérénice Batut
Anika Erxleben
Torsten Houwaart
Joachim Wolff
Mehmet Tekman
Rolf Backofen
& Other Elixir Members
Nate Coraor
Enis Afgan
Anton Nekrutenko
James Taylor
John Chilton
Martin Čech
Dave Bouvier &
The Galaxy Project Team &
Galaxy Project Community

More Related Content

Similar to UseGalaxy.* Architecture

Introduction to the Globus SaaS (GlobusWorld Tour - STFC)
Introduction to the Globus SaaS (GlobusWorld Tour - STFC)Introduction to the Globus SaaS (GlobusWorld Tour - STFC)
Introduction to the Globus SaaS (GlobusWorld Tour - STFC)Globus
 
OpenStack 3rd Birthday Presentation
OpenStack 3rd Birthday PresentationOpenStack 3rd Birthday Presentation
OpenStack 3rd Birthday PresentationOpenStack Foundation
 
When a local project becomes beneficial for the whole community (and vice ver...
When a local project becomes beneficial for the whole community (and vice ver...When a local project becomes beneficial for the whole community (and vice ver...
When a local project becomes beneficial for the whole community (and vice ver...4Science
 
Translating Apereo Software: A Case Study using Sakai and Transifex
Translating Apereo Software:  A Case Study using Sakai and TransifexTranslating Apereo Software:  A Case Study using Sakai and Transifex
Translating Apereo Software: A Case Study using Sakai and Transifexyuji tokiwa
 
ResourceSync Tutorial from Open Repositories 2013
ResourceSync Tutorial from Open Repositories 2013ResourceSync Tutorial from Open Repositories 2013
ResourceSync Tutorial from Open Repositories 2013Simeon Warner
 
Horizontal scaling with Galaxy
Horizontal scaling with GalaxyHorizontal scaling with Galaxy
Horizontal scaling with GalaxyEnis Afgan
 
Rob Davidson at the G3 Workshop: Open Source - Tools for Reproducibility
Rob Davidson at the G3 Workshop: Open Source - Tools for ReproducibilityRob Davidson at the G3 Workshop: Open Source - Tools for Reproducibility
Rob Davidson at the G3 Workshop: Open Source - Tools for ReproducibilityGigaScience, BGI Hong Kong
 
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWS
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWSExperiences In Building Globus Genomics Using Galaxy, Globus Online and AWS
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWSEd Dodds
 
Rook: Storage for Containers in Containers – data://disrupted® 2020
Rook: Storage for Containers in Containers  – data://disrupted® 2020Rook: Storage for Containers in Containers  – data://disrupted® 2020
Rook: Storage for Containers in Containers – data://disrupted® 2020data://disrupted®
 
Developing on OpenStack Startup Edmonton
Developing on OpenStack Startup EdmontonDeveloping on OpenStack Startup Edmonton
Developing on OpenStack Startup Edmontonserverascode
 
Manila Project Onboarding - Denver Open Infrastructure Summit - May 2019
Manila Project Onboarding - Denver Open Infrastructure Summit - May 2019Manila Project Onboarding - Denver Open Infrastructure Summit - May 2019
Manila Project Onboarding - Denver Open Infrastructure Summit - May 2019TomBarron
 
Netflix Open Source Meetup Season 4 Episode 1
Netflix Open Source Meetup Season 4 Episode 1Netflix Open Source Meetup Season 4 Episode 1
Netflix Open Source Meetup Season 4 Episode 1aspyker
 
Northern Colorado BigData Meetup 15Jan2015
Northern Colorado BigData Meetup 15Jan2015Northern Colorado BigData Meetup 15Jan2015
Northern Colorado BigData Meetup 15Jan2015Bryan Gartner
 
Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015aspyker
 
OGF Introductory Overview - FAS* 2014
OGF Introductory Overview -  FAS* 2014OGF Introductory Overview -  FAS* 2014
OGF Introductory Overview - FAS* 2014Alan Sill
 
The Oxford Common File Layout
The Oxford Common File LayoutThe Oxford Common File Layout
The Oxford Common File LayoutStefano Cossu
 

Similar to UseGalaxy.* Architecture (20)

Introduction to the Globus SaaS (GlobusWorld Tour - STFC)
Introduction to the Globus SaaS (GlobusWorld Tour - STFC)Introduction to the Globus SaaS (GlobusWorld Tour - STFC)
Introduction to the Globus SaaS (GlobusWorld Tour - STFC)
 
OpenStack 3rd Birthday Presentation
OpenStack 3rd Birthday PresentationOpenStack 3rd Birthday Presentation
OpenStack 3rd Birthday Presentation
 
Building EUDOXUS with FOSS
Building EUDOXUS with FOSSBuilding EUDOXUS with FOSS
Building EUDOXUS with FOSS
 
When a local project becomes beneficial for the whole community (and vice ver...
When a local project becomes beneficial for the whole community (and vice ver...When a local project becomes beneficial for the whole community (and vice ver...
When a local project becomes beneficial for the whole community (and vice ver...
 
Translating Apereo Software: A Case Study using Sakai and Transifex
Translating Apereo Software:  A Case Study using Sakai and TransifexTranslating Apereo Software:  A Case Study using Sakai and Transifex
Translating Apereo Software: A Case Study using Sakai and Transifex
 
ResourceSync Tutorial from Open Repositories 2013
ResourceSync Tutorial from Open Repositories 2013ResourceSync Tutorial from Open Repositories 2013
ResourceSync Tutorial from Open Repositories 2013
 
C02-Visualization-Applying visual analytics
C02-Visualization-Applying visual analyticsC02-Visualization-Applying visual analytics
C02-Visualization-Applying visual analytics
 
Horizontal scaling with Galaxy
Horizontal scaling with GalaxyHorizontal scaling with Galaxy
Horizontal scaling with Galaxy
 
G3 talk rld_2
G3 talk rld_2G3 talk rld_2
G3 talk rld_2
 
Rob Davidson at the G3 Workshop: Open Source - Tools for Reproducibility
Rob Davidson at the G3 Workshop: Open Source - Tools for ReproducibilityRob Davidson at the G3 Workshop: Open Source - Tools for Reproducibility
Rob Davidson at the G3 Workshop: Open Source - Tools for Reproducibility
 
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWS
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWSExperiences In Building Globus Genomics Using Galaxy, Globus Online and AWS
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWS
 
Rook: Storage for Containers in Containers – data://disrupted® 2020
Rook: Storage for Containers in Containers  – data://disrupted® 2020Rook: Storage for Containers in Containers  – data://disrupted® 2020
Rook: Storage for Containers in Containers – data://disrupted® 2020
 
Developing on OpenStack Startup Edmonton
Developing on OpenStack Startup EdmontonDeveloping on OpenStack Startup Edmonton
Developing on OpenStack Startup Edmonton
 
vBACD - Distributed Petabyte-Scale Cloud Storage with GlusterFS - 2/28
vBACD - Distributed Petabyte-Scale Cloud Storage with GlusterFS - 2/28vBACD - Distributed Petabyte-Scale Cloud Storage with GlusterFS - 2/28
vBACD - Distributed Petabyte-Scale Cloud Storage with GlusterFS - 2/28
 
Manila Project Onboarding - Denver Open Infrastructure Summit - May 2019
Manila Project Onboarding - Denver Open Infrastructure Summit - May 2019Manila Project Onboarding - Denver Open Infrastructure Summit - May 2019
Manila Project Onboarding - Denver Open Infrastructure Summit - May 2019
 
Netflix Open Source Meetup Season 4 Episode 1
Netflix Open Source Meetup Season 4 Episode 1Netflix Open Source Meetup Season 4 Episode 1
Netflix Open Source Meetup Season 4 Episode 1
 
Northern Colorado BigData Meetup 15Jan2015
Northern Colorado BigData Meetup 15Jan2015Northern Colorado BigData Meetup 15Jan2015
Northern Colorado BigData Meetup 15Jan2015
 
Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015
 
OGF Introductory Overview - FAS* 2014
OGF Introductory Overview -  FAS* 2014OGF Introductory Overview -  FAS* 2014
OGF Introductory Overview - FAS* 2014
 
The Oxford Common File Layout
The Oxford Common File LayoutThe Oxford Common File Layout
The Oxford Common File Layout
 

Recently uploaded

Green chemistry and Sustainable development.pptx
Green chemistry  and Sustainable development.pptxGreen chemistry  and Sustainable development.pptx
Green chemistry and Sustainable development.pptxRajatChauhan518211
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...Sérgio Sacani
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...RohitNehra6
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PPRINCE C P
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bSérgio Sacani
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)Areesha Ahmad
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPirithiRaju
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticssakshisoni2385
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfSumit Kumar yadav
 
DIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN  BACK CROSS AND TEST CROSSDIFFERENCE IN  BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSSLeenakshiTyagi
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfSumit Kumar yadav
 
Natural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsNatural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsAArockiyaNisha
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)Areesha Ahmad
 
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Sérgio Sacani
 
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡anilsa9823
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...Sérgio Sacani
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )aarthirajkumar25
 
Isotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoIsotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoSérgio Sacani
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...ssifa0344
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxgindu3009
 

Recently uploaded (20)

Green chemistry and Sustainable development.pptx
Green chemistry  and Sustainable development.pptxGreen chemistry  and Sustainable development.pptx
Green chemistry and Sustainable development.pptx
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdf
 
DIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN  BACK CROSS AND TEST CROSSDIFFERENCE IN  BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSS
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdf
 
Natural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsNatural Polymer Based Nanomaterials
Natural Polymer Based Nanomaterials
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
 
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
 
Isotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoIsotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on Io
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 

UseGalaxy.* Architecture

  • 1. usegalaxy.* Global Galaxy for Everyone Simon Gladman, 2018
  • 2. Public Galaxy servers - In the beginning.. usegalaxy.org - Galaxy Main ● Run out of many institutions in the USA ○ Penn State, Johns Hopkins, Oregon Health and Science Uni. ○ TACC, JetStream, CyVerse, Massive ● Many users ● Constantly large queue
  • 3. Public Galaxy servers - In Australia.. ● Galaxy-QLD ○ Set up for QLD but globally public ● Galaxy-Mel ○ Set up for VIC but globally public ● Galaxy-Tut ○ For workshops ● And many others!
  • 4. Public Galaxy servers - In Australia.. Galaxy-QLD + Galaxy-Mel + Galaxy-Tut = Galaxy-Australia usegalaxy.org.au
  • 5. Public Galaxy servers - And the list grew.. ● Different versions ● Different tools ● Different references ● User confusion ● Lots of duplication of effort
  • 6. So we got together.. ● At Galaxy Australasia Meeting 2017 ○ Key people from US, Europe, Australia including Galaxy PI. ○ Agreed to work together to support publically available Galaxys ○ Do as much together as possible And so usegalaxy.* was born
  • 7. What is usegalaxy.*? Group of public Galaxy servers ● Present a similar experience to users no matter which they use ● Guarantee a minimum service ○ Tools & versions ○ Reference Data ○ Reproducibility ○ Training materials ● Starting with USA, Europe and Australia, more welcome! ● Manage with community assets/repositories ● Don’t prescribe hardware resources usegalaxy.* servers Community assets
  • 8. usegalaxy.* - Tools Shared repository of tool lists ● Minimum tools ○ Genomics and others ● Extra tools ○ Metagenomics ○ Proteomics ○ Metabolomics ● Curation/maintenance of tools and versions ● Automatic upgrades and installation of trusted tools ● Still allow local specialisations
  • 9. usegalaxy.* - Reference Data/Indices CVM-FS Tier 0 Reference Data/Indices usegalaxy.eu usegalaxy.org.au usegalaxy.org CVM-FS Tier 1 Data/Indices Cache CVM-FS Tier 1 Data/Indices Cache Run by usegalaxy.org staff ● Genomic references ● Tool indices Tier 1 uses smart caching ● On demand ● Local specialisation
  • 10. usegalaxy.* - Look and Feel usegalaxy.* servers should: ● Run the latest stable Galaxy release ● Present the user with similar tool list layout ● Be able to run all of the Galaxy Training Network’s core tutorials ● Have same testing/training datasets available
  • 11. usegalaxy.* - Future - Tools Global repository of Tools in containers ● Use CVMFS for smart distribution similar to References ● Singularity containers ● Galaxy just uses appropriate container ● Much easier to manage tool lists and versioning CernVM-FS Singularity containers
  • 12. usegalaxy.* - Future - References ● Move to a community based model ● Improve metadata availability ● Improve reference data provenance usegalaxy.eu usegalaxy.org.au usegalaxy.orgCVM-FS Tier 1 Data/Indices Cache CVM-FS Tier 1 Data/Indices Cache CVM-FS Tier 0 Reference Data/Indices
  • 13. usegalaxy.* - Proposed Global Architecture Community Managed Globally Distributed Reference Data/Indices Tool Containers usegalaxy.eu usegalaxy.org.au usegalaxy.org
  • 14. usegalaxy.* - Future - BYOC Trialling BYOC now in Australia and Europe ● Adding Melbourne/Sydney/Other resources to Galaxy Australia ● Adding Czech/Dutch and other resources to Galaxy Europe Goal is to allow user/group to add their compute/storage resources Dynamic job allocation will know ● Where user is from ● What resources they can use
  • 15. usegalaxy.* - Australian Architecture
  • 16. usegalaxy.* - Ultimate goal - Single Sign-on The ultimate goal! ● Sign on in Global Galaxy WebServer! ● Job is run where- ever your compute and data is located! Compute Compute Compute Compute Compute Compute Compute
  • 17. It’s a big effort.. Gareth Price Simon Gladman Derek Benson Anna Syme Igor Makunin Nuwan Goonasekera Christina Hall Helen van der Pol Andrew Lonie Björn Grüning Helena Rasche Bérénice Batut Anika Erxleben Torsten Houwaart Joachim Wolff Mehmet Tekman Rolf Backofen & Other Elixir Members Nate Coraor Enis Afgan Anton Nekrutenko James Taylor John Chilton Martin Čech Dave Bouvier & The Galaxy Project Team & Galaxy Project Community

Editor's Notes

  1. G’day everyone, my name is Simon Gladman and I’m going to talk to you about something called usegalaxy.*. An initiative of the Galaxy community to provide publicly accessible bioinformatics analysis for everybody.
  2. There’s been a long history of public Galaxy servers. The first one was run by the Galaxy project itself. It runs out of the USA and is usually referred to as Galaxy Main. It has many users, is backed by a very large set of compute resources and is constantly in high demand.