• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
D Baker - Galaxy Update
 

D Baker - Galaxy Update

on

  • 631 views

Presentation at BOSC2012 by D Baker - Galaxy Update

Presentation at BOSC2012 by D Baker - Galaxy Update

Statistics

Views

Total Views
631
Views on SlideShare
631
Embed Views
0

Actions

Likes
0
Downloads
8
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • What's the goal of scalability?Should run for a million users like it runs for a single userComplex task for any software Should run for a million users like it runs for a single userComplex task for any software

D Baker - Galaxy Update D Baker - Galaxy Update Presentation Transcript

  • Galaxy Update Dannon Baker Galaxy Team Emory University
  • Topics• API• Automatic Parallelization• Tool Shed• ?
  • API Overview• RESTful API supporting CRUD operations• Uses generated keys for per-user authentication • No username/password • No credential caching (via keys)• Request parameters and responses are in JSON (JavaScript Object Notation)
  • Quickstart
  • Raw GET Example» GET /api/histories?key=966354fc14c9e427cee380ef50a72a21 « [ « { « url: /api/histories/d0bfe935d0f5258d, « id: d0bfe935d0f5258d, « name: Demo History 1 « } « ]
  • Making the CallsWrapper methods exist (in /scripts/api/) to make calls easier:python scripts/api/{action}.py <api key> http://<ip>/api/{module}/[id] [args]action: create | display | update | deleteapi_key: obtained from the UImodule: datasets | forms | histories | libraries | permissions | quotas |requests | roles | samples | tools | users | visualizations | workflowsunit: dataset_id / history_id / library_id / …args: name / key-value pair / …
  • Sample InvocationsCreate a history ./create.py <api_key> https://localhost:8080/api/histories name="from API”Display all histories ./display.py <api_key> https://localhost:8080/api/historiesDisplay information about a history ./display.py <api_key> https://localhost:8080/api/histories/6b5cf7e7ef797b21View datasets in a given history ./display.py <api_key> https://localhost:8080/api/histories/6b5cf7e7ef797b21/contentsDelete a history ./delete.py <api_key> https://localhost:8080/api/histories/976a9ce09b49502a
  • End-to-end pipelines• Push data from instruments to Galaxy• Execute a workflow• Associate with a user or add to a Data Library• Export outputs• Or a totally custom interface to Galaxy
  • Automatic Parallelisminput BLAST/strip? output
  • Parallelism• Take maximum advantage of available resources• Less costly fault recovery (spot instances)• Overhead in splitting time• Increased temporary storage requirement
  • Use it nowuse_tasked_jobs = TrueTools supported: BLAST, BWA, Bowtie Yours?
  • Try it for your tool<parallelism method = "multi” split_inputs = "query" split_mode = "number_of_parts” split_size = "4" shared_inputs = "subject" merge_outputs = "output1”/>
  • Advanced Splitting• FUSE • No disk write required • But it is slightly slower to read• More splitters: • Chromosome based?
  • Galaxies on Galaxies on private clouds public clouds private Tool Sheds G a la x y T o o lhttp://usegalaxy.org S he d ... http://usegalaxy.org/community 1 2 3 ... ∞ p r iv a t e G a la x y in s t a lla t io n s
  • Tool Shed - Developer
  • Tool Shed - Developer
  • Tool Shed - User
  • Tool Shed
  • Tool Shed
  • Tool Shed - User
  • Tool Shed• Simple installation to galaxy of tools, workflows • Dependencies• Automatic update notifications• Multiple Tool Versions installed
  • Tool Shed References• Main Tool Shed: usegalaxy.org/toolshed• ISMB Tech Track w/ Greg – Sunday, TT10
  • if more_time:• S3ObjectStore• Documentation • <galaxy_dir>/doc – `make html`• Join us in #galaxyproject on irc.freenode.net• Acknowledgements: • Galaxy Team, Community, people who send pull requests