0
OGCE Overview: Portals, Services, Workflows, Gadgets, and Tags <ul><li>Marlon Pierce (IU), Suresh Marru (IU), Gregor von L...
Links for More Information  <ul><li>Website:  http://www.collab-ogce.org </li></ul><ul><li>News/RSS/Blog:  http://collab-o...
Tutorial will focus on the bold-faced items. Project Description Status Grid Portal Packaged, one step installation of Gri...
OGCE and Gateways  <ul><li>We develop and package software for use by TeraGrid Science Gateways and other resources </li><...
Preview: Workflow, Open Social Gadgets, and Tab Libraries
OGCE Workflow Tools (Suresh Marru) WRF-Static running on Tungsten
Open Life Science Gateway Bio-gadgets (Wenjun Wu) Job Submission History gadget Blast gadget ClustalW gadget
GTLAB Gadgets  Code Base GTLAB Portlets Code Base Tomcat  Web  Server Tomcat Web Server +  Portlet Container iGoogle Clien...
GTLAB MyProxy Example <h:form id=&quot;form&quot;>  <h:outputText value=&quot;Username:&quot;/> <h:inputText value=&quot;#...
Packaging, Building and Testing <ul><li>All builds are designed to be  self contained  </li></ul><ul><ul><li>Use Apache Ma...
JMeter test suite
OGCE Portal
Components for Science Portals <ul><li>OGCE is founded on the principal that portals should be built out of  reusable part...
Downloading and Installing OGCE Portal Software <ul><li>You can have a basic portal up and running in a few minutes. </li>...
OGCE GPIR portlet can interoperate with TeraGrid and your own GPIR services.
Manage TeraGrid MyProxy credentials with the OGCE ProxyManager portlets.
OGCE file management client portlets interact with TeraGrid GridFTP servers.
General purpose batch and interactive job submission to GRAM, WS-GRAM is supported.
Dashboard Portlet Check on your jobs with a simple dashboard portlet.
 
Queue forecasting portlets work with the NWS QBETS to predict wait times and deadlines.
Condor and Condor-G
OGCE IFrame Portlet can be used to integrate external sites.
Under the Hood: Building Components <ul><li>Portlets can be built with our  Apache Velocity bridge . </li></ul><ul><ul><li...
Some OGCE Services <ul><li>Information Web Services and build framework </li></ul>
Resource Discovery Service <ul><li>Extracted from the TeraGrid User Portal </li></ul><ul><ul><li>Contributed by Rion Doole...
Resource Prediction Service (RPS) <ul><li>Predicts an optimal set of resources for running scientific applications </li></...
Packaging Services <ul><li>Everything builds with one command </li></ul><ul><ul><li>mvn clean install </li></ul></ul><ul><...
Upcoming Services <ul><li>XMC-CAT  metadata cataloging service with JSDL sample implementation. </li></ul><ul><ul><li>See ...
Upcoming SlideShare
Loading in...5
×

OGCE Overview for SciDAC 2009

551

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
551
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "OGCE Overview for SciDAC 2009"

  1. 1. OGCE Overview: Portals, Services, Workflows, Gadgets, and Tags <ul><li>Marlon Pierce (IU), Suresh Marru (IU), Gregor von Laszewski (RIT), Mary Thomas (SDSU), Nancy Wilkins-Diehr (SDSC), Jeff Sale (SDSC), Maytal Dahan (TACC), Rion Dooley (TACC), and Wenjun Wu (UC) </li></ul><ul><li>Funding: NSF SDCI, TeraGrid RP and GIG (synergistic) </li></ul>
  2. 2. Links for More Information <ul><li>Website: http://www.collab-ogce.org </li></ul><ul><li>News/RSS/Blog: http://collab-ogce.blogspot.com </li></ul><ul><li>Email: [email_address] </li></ul><ul><li>SVN Code Repository: http://ogce.svn.sourceforge.net/viewvc/ogce/ </li></ul><ul><ul><li>And get tar.gz’s </li></ul></ul><ul><li>Source Forge: http://sourceforge.net/projects/ogce </li></ul>
  3. 3. Tutorial will focus on the bold-faced items. Project Description Status Grid Portal Packaged, one step installation of Grid portlets into Tomcat+Gridsphere Stable, V2.5 for TG09 Axis Services One step install of Resource Discovery and Prediction Services. More services to come. Stable, V1.0 for TG09. Workflow Suite Support for scientific workflows, based on LEAD tools. Suresh will describe next. Dev. Release for TG09 GTLAB JSF Tag Libraries for building Grid portlets and gadgets Dev. Release for TG09 JavaScript COG (Cyberaide) JavaScript libraries for building Grid gateways. Dev. Preview for TG09 Gadgets, Open Social Portals Open Social containers, gadgets, OAuth, OpenID SVN, will build Incubator projects Pylons portals, metascheduling services, bio-gadgets, etc. SVN if you dare
  4. 4. OGCE and Gateways <ul><li>We develop and package software for use by TeraGrid Science Gateways and other resources </li></ul><ul><ul><li>BioVLAB use OGCE tools to run on Amazon </li></ul></ul><ul><li>A lot of this comes from active Gateways. </li></ul><ul><ul><li>Information Services (GPIR, QBETS): TeraGrid User Portal </li></ul></ul><ul><ul><li>Workflow tools: LEAD </li></ul></ul><ul><ul><li>Resource Discovery Service, File Browser Applet: TGUP, GridChem </li></ul></ul><ul><ul><li>SIDGrid, OLSG </li></ul></ul><ul><li>We contribute codes back to these projects. </li></ul>Gateways OGCE Software
  5. 5. Preview: Workflow, Open Social Gadgets, and Tab Libraries
  6. 6. OGCE Workflow Tools (Suresh Marru) WRF-Static running on Tungsten
  7. 7. Open Life Science Gateway Bio-gadgets (Wenjun Wu) Job Submission History gadget Blast gadget ClustalW gadget
  8. 8. GTLAB Gadgets Code Base GTLAB Portlets Code Base Tomcat Web Server Tomcat Web Server + Portlet Container iGoogle Client Aggregator Compile and deploy into server Decorate with bridge and container jars, xml config files. GTLAB gadgets can also run as portlets with no code changes by using the JSF portlet bridge.
  9. 9. GTLAB MyProxy Example <h:form id=&quot;form&quot;> <h:outputText value=&quot;Username:&quot;/> <h:inputText value=&quot;#{resource.username}&quot; required=&quot;true&quot;/> <h:outputText value=&quot;Password: &quot;/> <h:inputSecret value=&quot;#{resource.password}&quot; required=&quot;true&quot;/> <h:outputText value=&quot;MyProxy Server: &quot;/> <h:inputText value=&quot;#{resource.myproxyHostname}&quot; required=&quot;true&quot;/> <o:submit id=&quot;submit&quot; value=&quot;Submit&quot; binding=&quot;#{builder.body}&quot; action=&quot;#{builder.junkAction}&quot; > <o:multitask id=&quot;multi&quot; persistent=&quot;true&quot; taskname=&quot;#{resource.taskname}&quot;> <o:myproxy id=&quot;mypr&quot; hostname=&quot;#{resource.myproxyHostname}&quot; lifetime=&quot;2&quot; password=&quot;#{resource.password}&quot; port=&quot;7512&quot; username=&quot;#{resource.username}&quot;/> </o:multitask> </o:submit> </h:form>
  10. 10. Packaging, Building and Testing <ul><li>All builds are designed to be self contained </li></ul><ul><ul><li>Use Apache Maven 2.0 </li></ul></ul><ul><ul><li>Download includes everything you need. </li></ul></ul><ul><li>Portal, Axis Services, and Xregistry all build nightly on the NMI Build and Test facility at UW. </li></ul><ul><ul><li>17 Linux platforms, Mac PPC, and Mac X86 </li></ul></ul><ul><ul><li>Java 1.5 </li></ul></ul><ul><li>Apache JMeter test suite for the portal. </li></ul><ul><ul><li>Run against your installation </li></ul></ul><ul><ul><li>Automated tests nightly </li></ul></ul>
  11. 11. JMeter test suite
  12. 12. OGCE Portal
  13. 13. Components for Science Portals <ul><li>OGCE is founded on the principal that portals should be built out of reusable parts . </li></ul><ul><li>Key standard in our first phase: the JSR 168 portlet specification. </li></ul><ul><li>Portlets can run in multiple containers </li></ul><ul><ul><li>uPortal, Sakai, GridSphere, LifeRay, etc. </li></ul></ul><ul><li>Allows us to build Grid specific components and deploy along side third party components </li></ul><ul><ul><li>Sakai collaboration tools, RSS feed readers, contributed portlets, etc. </li></ul></ul><ul><li>Future (?): Open Social compliant Google Gadgets </li></ul><ul><ul><li>Facebook apps </li></ul></ul>
  14. 14. Downloading and Installing OGCE Portal Software <ul><li>You can have a basic portal up and running in a few minutes. </li></ul><ul><li>Installation process: </li></ul><ul><ul><li>Update properties in pom.xml to match your Grid. </li></ul></ul><ul><ul><li>Run “ mvn clean install ” </li></ul></ul><ul><ul><li>That’s it </li></ul></ul>
  15. 15. OGCE GPIR portlet can interoperate with TeraGrid and your own GPIR services.
  16. 16. Manage TeraGrid MyProxy credentials with the OGCE ProxyManager portlets.
  17. 17. OGCE file management client portlets interact with TeraGrid GridFTP servers.
  18. 18. General purpose batch and interactive job submission to GRAM, WS-GRAM is supported.
  19. 19. Dashboard Portlet Check on your jobs with a simple dashboard portlet.
  20. 21. Queue forecasting portlets work with the NWS QBETS to predict wait times and deadlines.
  21. 22. Condor and Condor-G
  22. 23. OGCE IFrame Portlet can be used to integrate external sites.
  23. 24. Under the Hood: Building Components <ul><li>Portlets can be built with our Apache Velocity bridge . </li></ul><ul><ul><li>Still some interest in this. </li></ul></ul><ul><ul><li>“ Template” or “steal this code” approach. </li></ul></ul><ul><li>OGCE portlets use the Java COG Abstraction Layer to access Grid services. </li></ul><ul><ul><li>Provides a buffer over different Grid toolkits and versions. </li></ul></ul><ul><ul><li>Provides ability to compose graph-based workflows. </li></ul></ul><ul><ul><li>Tutorial in itself </li></ul></ul><ul><li>We have also developed Grid Tag Libraries and Beans (GTLAB) to simplify development process. </li></ul>
  24. 25. Some OGCE Services <ul><li>Information Web Services and build framework </li></ul>
  25. 26. Resource Discovery Service <ul><li>Extracted from the TeraGrid User Portal </li></ul><ul><ul><li>Contributed by Rion Dooley, TACC </li></ul></ul><ul><li>Axis2 Web service </li></ul><ul><li>Integrates information from INCA, GPIR services. </li></ul><ul><ul><li>What machines are in my Grid </li></ul></ul><ul><ul><li>Which ones are actually running? </li></ul></ul><ul><li>Works with TeraGrid deployed services, but you can use it with your own information service installations. </li></ul>
  26. 27. Resource Prediction Service (RPS) <ul><li>Predicts an optimal set of resources for running scientific applications </li></ul><ul><ul><li>Predicts a set of resources on which the sum of data transfer time, queue wait time and compute time for the application will be minimum </li></ul></ul><ul><ul><li>Data transfer time: Uses input data size and NWS info </li></ul></ul><ul><ul><li>Queue wait time : Uses QBETS info </li></ul></ul><ul><ul><li>Compute time: Uses application performance info </li></ul></ul><ul><li>Axis2 web service with a MySQL backend </li></ul><ul><li>RPS is a subset of the Fault Tolerance and Recovery service used in LEAD and VGrADS </li></ul>
  27. 28. Packaging Services <ul><li>Everything builds with one command </li></ul><ul><ul><li>mvn clean install </li></ul></ul><ul><li>We use Apache Maven 2 for builds. </li></ul><ul><ul><li>Structured, modular builds and consistent layouts </li></ul></ul><ul><li>Build a single module: </li></ul><ul><ul><li>mvn clean install –f somemod/pom.xml </li></ul></ul><ul><li>We include Apache Tomcat in the download, so all you need is Java and MySQL. </li></ul><ul><li>Suitable also for the NMI build and test system. </li></ul><ul><li>Want the Javadoc? mvn javadoc:javadoc </li></ul>
  28. 29. Upcoming Services <ul><li>XMC-CAT metadata cataloging service with JSDL sample implementation. </li></ul><ul><ul><li>See also our demo on Wednesday. </li></ul></ul><ul><li>Swarm Web Service for mass job submission and management. </li></ul><ul><ul><li>http://escience2008.iu.edu/sessions/SWARM.shtml </li></ul></ul><ul><li>GPIR Web Service for information on your Grid. This is being repackaged; older packaged version (but same code) is already available. </li></ul><ul><li>Workflow suite services will be integrated in the future. </li></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×