SlideShare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our User Agreement and Privacy Policy.
SlideShare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our Privacy Policy and User Agreement for details.
Successfully reported this slideshow.
Activate your 14 day free trial to unlock unlimited reading.
3.
Data Capacitor<br /><ul><li>Provide temporary storage for the pipeline and for the science gateway, interface with archive, and data transfer from ODI and to compute resources
12.
Open</li></li></ul><li>Science Gateway<br />A Science Gateway is a community-developed set of tools, applications, and data that is integrated via a portal or a suite of applications, usually in a graphical user interface, that is customized to meet the needs of the targeted community.<br />More Info - http://www.teragrid.org/gateways/ <br />
13.
Gateways Advantages<br />Increase access<br />To instruments<br />Increase capabilities<br />To analyze data<br />Improve workforce development<br />For underserved populations<br />Increase outreach<br />Increase public awareness<br />Public sees value in investments in large facilities<br />
14.
There are approximately 30 gateways using the TeraGrid<br />
15.
Example Gateway Accomplishments<br />LEAD - access to radar data<br />NVO – access to sky surveys<br />OOI – access to sensor data<br />PolarGrid – access to polar ice sheet data<br />SIDGrid – analysis tools<br />GridChem – developing multiscale coupling<br />How would this have been done before gateways?<br />How many details do we want each individual scientist to need to know?<br />
16.
TeraGrid Advantages and Challenges<br />What’s different when the resource doesn’t belong just to me?<br />Resource discovery<br />Accounting<br />Security<br />Proposal-based requests for resources (peer-reviewed access)<br />Code scaling and performance numbers<br />Justification of resources<br />Gateway citations<br />Tremendous benefits at the high end, but even more work for the developers<br />Potential impact on science is huge<br />Small number of developers can impact thousands of scientists<br />But need a way to train and fund those developers and provide them with appropriate tools<br />
20.
NSF Engineering Research Center for Collaborative Adaptive Sensing of the Atmosphere (CASA)<br />UMass/Amherst, OU, CSU, UPRM<br />Concept: inexpensive, phased array Doppler radars on cell towers and buildings<br />Dynamically adaptive sensing of multiple targets while simultaneously meeting multiple end-user needs<br />
21.
LEAD Workflow Requirements<br />Run jobs on-demand on TeraGrid.<br />Deadline driven workflows (severe weather tracking)<br />Users ranging from 8th grade students to seasoned researchers.<br />Run jobs on Multiple TeraGrid resources to decrease turn-around time.<br />Must be able to integrate to Portal with very user friendly web interface.<br />
22.
Workflow Survey in 2003(http://www.extreme.indiana.edu/swf-survey/)<br />
25.
LEAD Scientists and Educational Interactions<br />Lowering the barrier for using complex end-to-end weather technologies<br />Democratize<br />Empower<br />Facilitate<br />End Users<br />Developers<br />Researcherss<br />
30.
OGCE Workflow Suite<br />Generic Service Toolkit<br />Tool to wrap command-line applications as web services<br />Handles file staging & job submission and monitoring<br />Extensible runtime for security, resource brokering & urgent computing<br />Generic Factory service for on-demand creation of application services<br />XRegistry<br />Information repository for the OGCE workflow suite<br />Register, search, retrieve & share XML documents<br />User & hierarchical group based authorization<br />XBaya<br />GUI based tool to compose & monitor workflows<br />Extensible support for compiler plug-ins like BPEL, Jython, SCUFL<br />Dynamic Workflow Execution support to start, pause, resume, rewind of workflow executions<br />Apache ODE Scientific Workflow Extensions<br />XBaya GUI integration for BPEL Generation<br />Asynchronous support for long running workflows<br />Instrumented with fine grained monitoring<br />Eventing System<br />Supports both WS-Eventing and WS-Notification Standards<br />Very scalable<br />Persistent Message Box for clients behind firewalls and with intermittent network glitches.<br />
32.
Application Wrapper Framework<br />c<br />Application Factory<br /><ul><li>Scientific Applications are wrapped into web services by filling in a web-form.
33.
The Application Factory generates a web service for each application with I/O interfaces.
34.
Registers WSDL for the service with a registry
35.
Each service generates a stream of notifications that log the service actions back to the XMCCat Metadata Catalog, user monitoring, and provenance tracking tools</li></ul>App <br />Service<br />Run program<br />& publish events<br />
36.
Service Monitoring via Events<br />1<br />2<br />3<br />4<br />5<br />6<br /><ul><li>The service output is a stream of events
44.
These are automatically generated by the service using a distributed event system(WS-Eventing / WS-Notification)
45.
Topic based pub-sub system witha well known “channel”</li></ul>Application<br />Service<br />Instance<br />Notification<br />Channel<br />x<br />x<br />publisher<br />listener<br />
48.
WS-BPEL<br />Business Process Execution Language for Web Services (WS-BPEL)<br />De-facto standard for specifying web service based business processes and service compositions<br />Basic activities<br />Invoke, Receive, Assign..<br />Structured activities<br />Sequence, Flow, ForEach,..<br />
49.
Workflow Composition, Execution & Monitoring<br /> XBaya enables users to construct, share, execute and monitor sequence of tasks executing on their local workstations to high-end compute resources.<br />
50.
GPEL<br />Grid Process Execution Language<br />BPEL4WS based home grown research workflow engine<br />Supports a subset of BPEL4WS 1.1 <br />One of the very early adaptations of BPEL efforts<br />Specifically designed for eScience Usage<br />Long running workflow support<br />Decoupled client<br />
52.
XML Metadata Catalog (XMC Cat)<br />Taming Complex Scientific Metadata Schemas<br />“A significant need exists in many disciplines for long-term, distributed, and stable data and metadata repositories”<br /><ul><li>NSF Blue-Ribbon Advisory Panel on Cyberinfrastructure</li></ul>“Metadata is key to being able to share results”<br /><ul><li>UK e-Science Core Programme Study</li></ul>More Info: Scott Jensen, Beth Plale<br />
54.
OGCE Workflow Usage Flow<br />Scientist/Application provider registers application description with Registry Service.<br />Workflow Author constructs the workflow with multiple wrapped application services.<br />Workflow is compiled and deployed to the ODE workflow Engine.<br />Workflow inputs are captured by XBaya and workflow is launched to ODE.<br />Workflow system and possibly some services publish notifications to the Message bus reporting the progress of the workflow.<br />XBaya monitoring system listens to notifications and color the workflow components to present workflow progress.<br />