EPrints and the Cloud


Published on

EPrints capabilities in the Cloud; a presentation at the EduServ "Repositories and the Cloud" event. For more info see http://repcloud.eventbrite.com/

Published in: Education, Technology, Business
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

EPrints and the Cloud

  1. 1. EPrintsCloud Visions<br />
  2. 2. What is EPrints For?<br />EPrints offers a safe, open and useful place to store, share and manage material in the pursuit of research and educational agendas.<br />administrative reporting, collaboration, data sharing, digital profile enhancement , e-learning, e-publishing, e-research, marketing, open access, preservation, publicity, research assessment, research management, scholarly collections<br />
  3. 3. Research Curation, Researcher Support<br />Researchers’ environment supported by repository<br />Research data managed by repository<br />Research community assisted by repository<br />
  4. 4. What is a Repository<br />Safe, secure, persistent, managed storage for files<br />Safe, secure, persistent management of shareable FRBR works<br />Safe, secure, persistent, management of scholarly & scientific working <br />Leading to…<br />Science 2.0 / The Fourth Paradigm / Data Intensive Science<br />The challenge is not cloud computing but cloud thinking<br />
  5. 5. Bio-Diversity<br />
  6. 6. Current EPrints Cloud Capabilities<br />Amazon Elastic Compute Machine Images (AMIs)<br />Small (Single Core / 1.7Gb)<br />Large (64 Bit / Quad Core / 7.5Gb)<br />Extra Large (64 Bit / 8 Core / 15Gb) <br />EPrints 3.2 is 64 Bit Enabled<br />Persistent Database & Storage<br />Really Excited - Super Fast / Cheap / Easy! <br />
  7. 7. Cloud to Desktop Storage<br />Data can be stored on multiple storage services<br />Local disk, SAN, NAS, Honeycomb, Cloud<br />Researchers can mount repository objects as a networked filesystem<br />Service usage and preservation risks can be monitored and analysed.<br />
  8. 8. Hybrid Storage In EPrints<br />A single storage solution has drawbacks.<br />Cost vs. Speed vs. Reliability<br />Repositories need to be agile: to utilize and be able to migrate to new platforms<br />Leverage the benefits of each solution without losing control of your digital objects. <br />
  9. 9. Local Disk Storage<br />No local bandwidth costs<br />Hard to expand <br />Locally Managed <br />High overheads cost <br />Requires space and cooling <br />Tied closely to the software <br />Storage ecosystem<br />
  10. 10. Local Archival Storage<br />Specialist <br />Expensive to purchase <br />Locally Managed <br />Space and running costs <br />Expandable <br />Storage ecosystem<br />
  11. 11. Cloud Storage<br />Scalable <br />Externally controlled <br />Known Costings<br />Unclear retention policy <br />Re-Useable (using simple APIs) <br />Global Scale<br />Storage ecosystem<br />
  12. 12. But Clouds Blow Away<br />Recently:<br />Yahoo Briefcase<br />XDrive<br />AOL Pictures<br />HP Upline<br />Sony Image Station<br />Source: Tom Spring - PCWorld<br />
  13. 13. Why use Hybrid Storage<br />Use the best features of each storage type<br />Performance<br />Scaling-up bandwidth<br />Optimisation<br />Large-file handling<br />Multimedia streaming<br />Localised Delivery<br />Local delivery from the cloud<br />
  14. 14. EPrints Storage Controller<br /><ul><li>The storage controller decides where to put a file.
  15. 15. Rule-based policy defined by XML configuration file
  16. 16. Large binary files of scientific data (raw machine result data) can be stored in a large disk (slower access) system and sent to a tape company for long term storage.
  17. 17. Processed results can be stored locally and in the cloud ready for rapid delivery to end points. </li></li></ul><li>Architecture Diagram<br />
  18. 18. Controller Ruleset<br /><choose><br /> <when test="datasetid = 'document'"><br /> <choose><br /> <when test="$parent{relation_type} = 'isVolatileVersionOf'"><br /> <plugin name="Local"/><br /> </when><br /> <otherwise><br /> <plugin name="AmazonS3"/><br /> </otherwise><br /> </choose><br /> </when><br /> <otherwise><br /> <plugin name="Local"/><br /> </otherwise><br /> </choose><br />
  19. 19. EPrints Storage Manager<br />
  20. 20. Amazon S3 Localisation (1)<br />
  21. 21. Amazon S3 Localisation (2)<br />
  22. 22. Preservation Services<br />Object Classification<br />Risk Analysis<br />Mitigation and Migration<br />
  23. 23. EPrintsForthcoming Development<br />
  24. 24. EPrints Cloud Services<br />Web based repository setup<br />Much like getting started with a blog.<br />Fill in a form and obtain a repository.<br />Coming to EPrints core in next major release.<br />Enterprise Support for Cloud Solutions<br />Full Setup & Configuration<br />Global Distribution<br />Auto Upgrade & Patching<br />Trusted Backup<br />
  25. 25. EPrints 3.2<br />Plug-ins / Modules<br />Everything builds on the core layer<br />Major part of v3.2 is strengthening the core and adding more abstraction layers<br />Improved data model <br />Enhanced data facilities <br />Enhanced metadata facilities<br />Improved programming & API<br />
  26. 26. EPrints 3.2 Structure<br />
  27. 27. Community Driven Development<br />There are many abstraction layers.<br />Display Manipulation<br />Upload Handlers<br />Custom Datasets<br />Import / Export Plug-ins<br />Transcoding Plug-ins<br />Database Plug-ins<br />Storage Plug-ins<br />One API<br />
  28. 28. Storage Plug-ins<br />Local<br />NFS<br />Amazon S3<br />Sun Cloud Storage Service<br />Microsoft Azure<br />Any others based on the S3 API…. (the last 3 all are)<br />5 Call API (about 30mins to write a plug-in)<br />
  29. 29. Our Development Vision<br />Empower the Community with a simple API<br />API in 3.2<br />Give the community a platform to test their code<br />Use the Cloud!<br />Give the community a distribution mechanism<br />The EPrints Bazaar (beta)<br />
  30. 30. EPrints Bazaar<br />Similar in concept to Apple’s App Store<br />Every install of EPrints will have access to the Bazaar<br />Single click install/uninstall of plug-ins<br />EPrints Services Approved Plug-ins<br />Enterprise support for limited 3rd party plug-ins<br />
  31. 31. Summary<br />EPrints provides the professional, enterprise level application for resource management<br />Including cloud support at many levels<br />Repository-in-the-cloud<br />Storage-in-the-cloud<br />Services-in-the-cloud<br />