The LEAD Portal: An OGCE based weather science gateway Marcus Christie and Suresh Marru Indiana University LEAD Project (www.leadproject.org)

The Weather Challenge (WxChallenge)

WxChallenge - LEAD Portal Beta Testers … and others

So, what’s the value to the participants?

So, what’s the value to the participants?

So, what’s the value to the participants?

So, what’s the value to the participants?

So, what’s the value to the participants?

So, what’s the value to the participants?

So, what’s the value to the participants?

Outcome Total participants: 10 Total workflows: 279 Total data storage: 2.6 TB (including non weather challenge participants) Total SUs: 52925 (including non weather challenge participants) Workflow success rate: 78%/36%

Total participants: 10

Total workflows: 279

Total data storage: 2.6 TB (including non weather challenge participants)

Total SUs: 52925 (including non weather challenge participants)

Workflow success rate: 78%/36%

The Architecture of Gateway Services The Users Desktop. Gateway Services Grid Portal Server Physical Resource Layer Core Grid Services Proxy Certificate Server / vault Application Events Resource Broker User Metadata Catalog Replica Mgmt Application Workflow App. Resource catalogs Application Deployment Execution Management Information Services Self Management Data Services Resource Management Security Services OGSA-like Layer

The Users Desktop.

Info/History Staffing: 2 FTE + several graduate students Fall 2004: Started work on the LEAD Portal (uPortal) Spring 2005: Selected GridSphere Spring 2006: Integrated with BPEL workflow engine and updated metadata schema Summer 2006: First went “live” supporting Unidata Users’ Workshop Spring 2007: WxChallenge and Spring Forecast experiments

Staffing: 2 FTE + several graduate students

Fall 2004: Started work on the LEAD Portal (uPortal)

Spring 2005: Selected GridSphere

Spring 2006: Integrated with BPEL workflow engine and updated metadata schema

Summer 2006: First went “live” supporting Unidata Users’ Workshop

Spring 2007: WxChallenge and Spring Forecast experiments

TeraGrid Resources Big Red Data Capacitor NCSA’s Tungsten and Mercury SPRUCE at UC

Security: Registering for an account

Security:Verifying Email Address

Security: Email address confirmed

Security: Administrator Approving

Security: Administrator Approving

Security: User gets acceptance email

Security: User can now log in

Security: Verifying user account

A Tale of Two Authorization Systems Application Service LEAD Portal - authenticate with identity certificate verify authorization GSI TeraGrid community account proxy certificate AuthZ

- authenticate with identity certificate

verify authorization

community account

proxy certificate

LEAD Architecture + Auditing App Service LEAD Portal Notification Broker GPEL Workflow Engine App Service App Service Auditing Service GRAM Gatekeeper 1. Portal registers workflow 2. Portal submits workflow 3. WF engine invokes app services 4. Launch GRAM jobs 5. Audit notifs 6. Queries for charge

Challenges, Lessons Learned Globus reliability issues Become best friends with your RPs Gateway priorities Make sure you know for what audience you are building your gateway Security It’s a lot harder as an afterthought Production deployment You’ll want to be serious about separate deployments; and it will cost you

Globus reliability issues

Become best friends with your RPs

Gateway priorities

Make sure you know for what audience you are building your gateway

Security

It’s a lot harder as an afterthought

Production deployment

You’ll want to be serious about separate deployments; and it will cost you

Future Work Give user’s more control Allow editing of model configurations Allow users to burn their own allocations Allow users to bring in their own software Running ensembles Data-driven workflows Fault tolerance/monitoring Repackaging

Give user’s more control

Allow editing of model configurations

Allow users to burn their own allocations

Allow users to bring in their own software

Running ensembles

Data-driven workflows

Fault tolerance/monitoring

Repackaging

Wrap Up Go to http://portal.leadproject.org to request an account For more information about OGCE Tuesday, 4:30-5:00: Building a Grid Portal for TeraGrid’s Big Red Wednesday, 9:30-10:00: Grid Portlets and Services from the Open Grid Computing Environments (OGCE) Collaboration (Software Provider Forum) Questions?

Go to http://portal.leadproject.org to request an account

For more information about OGCE

Tuesday, 4:30-5:00: Building a Grid Portal for TeraGrid’s Big Red

Wednesday, 9:30-10:00: Grid Portlets and Services from the Open Grid Computing Environments (OGCE) Collaboration (Software Provider Forum)

Questions?