This document discusses using Taverna and ARC workflow management tools together with grid computing resources. It outlines benefits like resource sharing, easy configuration, knowledge sharing, and dependency management. It proposes using a Taverna plugin to submit workflows to the ARC grid middleware for execution across heterogeneous resources. Challenges addressed include dynamic runtime environments, common tools, and firewall configuration. Potential applications discussed include Taverna as a web service, embedding workflows, and packaging programs for grid execution.

1. Taverna + ARC Workflow management, command line tools and the grid Saturday, June 27, 2009 Hajo Nils Krabbenhöft, University of Lübeck

2. Why use a grid? cpu power storage space node redundancy

3. Why use a grid? resource sharing tit-for-tat buy cpu power shared maintenance software development package deployment configuration

4. Why use Taverna 2 ? knowledge sharing web services plug-ins myExperiment

5. Why use Taverna 2 ? myExperiment

6. Why use Taverna 2 ? dependency management data management & conversion easy tweaking database integration

7. shell script pitfalls command line ambiguities no specific program version unaware of changes to syntax

8. manual grid usage upload & download data xrsl difficult to write no failure recovery

9. proposed solution Workflow plug-in submits ARC executes use cases runtime environments out of through

10. proposed solution ARC grid middleware homogeneous interface security certificates data management scalable

11. proposed solution runtime environments specify program & version installation on demand use cases require RE no command line shared repository

12. proposed solution Taverna plug-in job submission use cases => run in parallel storage management data references => fast silent failover SSH + local for testing

13. proposed solution Taverna easy to present embedded workflows parameter tweaking managed dependencies easy retry easy parallelization X. Zhou et al.: An Easy Setup for Parallel Medical Image Processing: Using Taverna and ARC

14. reality check dynamic RE still experimental use common tools send binaries call administrators firewall need LDAP and GSIFTP ports proxy support

15. reality check disk caching since Taverna 2.0 programs not locally installable use as web service upload is slow upload static files to SE

16. neat toys Taverna as web service Taverna on grid node embedded Taverna NestedVM package arbitrary C program into JAR

17. neat toys Amazon S3 upload from Taverna grid URL good for static data Amazon EC on-demand grid nodes control from Taverna

18. neat toys use case java API submit, receive, monitor data references silent failover but NO dependency management GridRunnable e.g. clustering based on different criteria

19. Thank you for your attention http:// taverna.nordugrid.org