0
globus onlineGlobus Online forResearch Data ManagementRachana AnanthakrishnanGreat Plains Network Annual Meeting 2013
We started with technologyproven in many large-scale gridsGridFTPGRAMMyProxyGSI-OpenSSH…
1.2 PB of climate datadelivered to 23,000 users
Typical of large, well fundedresearch projects using GT1.2 PB of climate datadelivered to 23,000 users
GT provides robustinfrastructure for the 1%
What about the 99%?GT provides robustinfrastructure for the 1%
What about the 99%?BIG SCIENCE. Small labsGT provides robustinfrastructure for the 1%
globus online
Managing data should be easy …Registry	  Staging	  Store	  Ingest	  Store	  Analysis	  Store	  Community	  Store	  Archive...
… but it’s hard and frustrating!Registry	  Staging	  Store	  Ingest	  Store	  Analysis	  Store	  Community	  Store	  Archi...
What is Globus Online?Transfer and sharing of largedata sets……with dropbox-likecharacteristics……directly from your ownstor...
We adopted SaaS approaches totransform the user experience… for both researchers andresource owners/systemadministrators
We started with reliable, secure,high-performance file transfer …DataSourceDataDestinationUser initiatestransfer request1G...
… and then made it simple to sharebig data off existing storage systemsDataSourceUser A selects file(s) to share,selects u...
Log into Globus Online
Alternate Logins
Login using InCommon
InCommon Login
Source endpoint
Destination endpoint
Activation
Transfer data
Share data
Set permissions
Manage Groups
Interactive login to command line interface:Running commands remotely:Using CLI with gsissh:Globus Online CLI$ ssh tuecke@...
Usage is accelerating
Early Adopters
•  What is GCMU?–  Globus Connect version for easily creating (sharable) endpointson multi-user storage servers–  Packages...
We are a non-profit serviceprovider to the non-profitresearch community
Our challenge:SustainabilityWe are a non-profit serviceprovider to the non-profitresearch community
Globus Online Provider PlansSupport ongoing operationsOffer value-added capabilitiesEngage more closely with users
•  Endpoint operations management•  Branded web sites•  Alternate identity provider•  Usage reporting•  MSS optimizations•...
End User Plans•  Basic: Free– File transfer and synchronization to/fromservers– Personal endpoints with Globus Connect– Ac...
Globus Platform-as-a-ServiceGlobus Nexus(Identity, Group, Profile)…Sharing ServiceTransfer ServiceDataset ServicesGlobus T...
Our research is supported by:U. S. DE PART M E N T O FENERGY
Questions?Contact: support@globusonline.orgProviders: globusonline.org/provider-planswww.globusonline.org
Upcoming SlideShare
Loading in...5
×

Globus Online for Research Data Management

209

Published on

This presentation is by Rachana Ananthakrishnan, Sr. Engagement Manager and Solutions Architect at the Computation Institute at The University of Chicago. It was given at the Great Plains Network Annual Meeting, on May 29, 2013.

For more information on Globus Online, visit globusonline.org.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
209
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Globus Online for Research Data Management"

  1. 1. globus onlineGlobus Online forResearch Data ManagementRachana AnanthakrishnanGreat Plains Network Annual Meeting 2013
  2. 2. We started with technologyproven in many large-scale gridsGridFTPGRAMMyProxyGSI-OpenSSH…
  3. 3. 1.2 PB of climate datadelivered to 23,000 users
  4. 4. Typical of large, well fundedresearch projects using GT1.2 PB of climate datadelivered to 23,000 users
  5. 5. GT provides robustinfrastructure for the 1%
  6. 6. What about the 99%?GT provides robustinfrastructure for the 1%
  7. 7. What about the 99%?BIG SCIENCE. Small labsGT provides robustinfrastructure for the 1%
  8. 8. globus online
  9. 9. Managing data should be easy …Registry  Staging  Store  Ingest  Store  Analysis  Store  Community  Store  Archive   Mirror  Ingest  Store  Analysis  Store  Community  Store  Archive   Mirror  Registry  
  10. 10. … but it’s hard and frustrating!Registry  Staging  Store  Ingest  Store  Analysis  Store  Community  Store  Archive   Mirror  Ingest  Store  Analysis  Store  Community  Store  Archive   Mirror  Registry  Quotaexceeded!Expiredcredentials!Networkfailed. Retry.!Permissiondenied!
  11. 11. What is Globus Online?Transfer and sharing of largedata sets……with dropbox-likecharacteristics……directly from your ownstorage systems
  12. 12. We adopted SaaS approaches totransform the user experience… for both researchers andresource owners/systemadministrators
  13. 13. We started with reliable, secure,high-performance file transfer …DataSourceDataDestinationUser initiatestransfer request1Globus Onlinemoves andsyncs files2Globus Onlinenotifies user3
  14. 14. … and then made it simple to sharebig data off existing storage systemsDataSourceUser A selects file(s) to share,selects user orgroup, and setspermissions1Globus Online tracksshared files; no needto move files to cloudstorage!2User B logs in toGlobus Onlineand accessesshared file3
  15. 15. Log into Globus Online
  16. 16. Alternate Logins
  17. 17. Login using InCommon
  18. 18. InCommon Login
  19. 19. Source endpoint
  20. 20. Destination endpoint
  21. 21. Activation
  22. 22. Transfer data
  23. 23. Share data
  24. 24. Set permissions
  25. 25. Manage Groups
  26. 26. Interactive login to command line interface:Running commands remotely:Using CLI with gsissh:Globus Online CLI$ ssh tuecke@cli.globusonline.org$ ssh tuecke@cli.globusonline.org <command>$ gsissh tuecke@cli.globusonline.org <command>$ ssh tuecke@cli.globusonline.org scp –r –s 3 -D nersc#dtn:~/myfile* mylaptop:~/projects/p1Task ID: 4a3c471e-edef-11df-aa30-1231350018b1$ _
  27. 27. Usage is accelerating
  28. 28. Early Adopters
  29. 29. •  What is GCMU?–  Globus Connect version for easily creating (sharable) endpointson multi-user storage servers–  Packages a GridFTP server and MyProxy CA authenticationserver, pre-configured for use with Globus Online•  Why GCMU?–  Create transfer endpoints in minutes–  Avoid complex GridFTP install•  To download: www.globusonline.org/gcmuGlobus Connect Multiuser (GCMU)29“We  used  GCMU  to  form  a  campus-­‐wide  GSI  authenAcaAon  service  spanning  mulAple  servers.  Now  my  users  have  a  fast,  easy  way  to  get  their  data  wherever  it  needs  to  go,  and  the  setup  process  was  trivial."    -­‐-­‐University  of  Michigan  “As  a  resource  admin,  Ive  found  GCMU  an  exceedingly  useful  tool....  With  GCMU,  seHng  up  a  GridFTP  server  and  handling  authenAcaAon  for  mulAple  users  is  easy."    -­‐-­‐Oak  Ridge  Na8onal  Lab  
  30. 30. We are a non-profit serviceprovider to the non-profitresearch community
  31. 31. Our challenge:SustainabilityWe are a non-profit serviceprovider to the non-profitresearch community
  32. 32. Globus Online Provider PlansSupport ongoing operationsOffer value-added capabilitiesEngage more closely with users
  33. 33. •  Endpoint operations management•  Branded web sites•  Alternate identity provider•  Usage reporting•  MSS optimizations•  Multiple GridFTP servers per endpointProvider Plans offer…Starting at $20k per year
  34. 34. End User Plans•  Basic: Free– File transfer and synchronization to/fromservers– Personal endpoints with Globus Connect– Access to shared endpoints created by others•  Plus: $7/month (or $70/year)– Create and manage shared endpoints– Peer-to-peer transfer and sharing
  35. 35. Globus Platform-as-a-ServiceGlobus Nexus(Identity, Group, Profile)…Sharing ServiceTransfer ServiceDataset ServicesGlobus ToolkitGlobusOnlineAPIsGlobusConnect
  36. 36. Our research is supported by:U. S. DE PART M E N T O FENERGY
  37. 37. Questions?Contact: support@globusonline.orgProviders: globusonline.org/provider-planswww.globusonline.org
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×