PLANETS, OPF & SCAPE                   A summary of the tools from these                 preservation projects, and where ...
PLANETS• A big project to build digital preservation tools...www.openplanetsfoundation.org
OPF’s Challenge• The Open Planets Foundation was set up to sustain  the PLANETS outputs into the future.   – But the tools...
SCAPE• http://www.scape-project.eu/• Many PLANETS partners   – Including OPF• Many new partners too• Driven by data   – We...
PLATOwww.openplanetsfoundation.org
The PLANETS Testbedwww.openplanetsfoundation.org
The PLANETS Testbed:           Too Many Good Ideas In One Place• Designing experiments   – Web GUI for complex workflows• ...
Re-imagining The PLANETS Testbed:                A Modular Approach• Use separate tools in each role   – Experiment Design...
Experiment Design:                   SCAPE Workflows In Taverna• As part of SCAPEwww.openplanetsfoundation.org
Experiment Design Support:                      SCAPE Service Registrywww.openplanetsfoundation.org
Experiment Design Support:                     OPF Shared Test Corpora• Simple collections accessed over HTTP   – No speci...
Experiment Design Support:      Sharing & Publishing Via myExperimentwww.openplanetsfoundation.org
Experiment Execution Support:           SCAPE’s Lightweight Tool Wrapping• PIT: Preservation-action Invocation Tool   – Us...
Experiment Execution: Multi-platform Tool & Workflow Invocation• Shared tool specifications make multi-platform  execution...
Experiment Execution:     Publishing Experimental Results Via REF• OPF Results Evaluation Framework: REF  – Hard-coded exp...
Analysing Results:                     Linked Data & Future Plans• REF allows data to be inspected   – Concentrating on co...
Summary• PLATO   – SCAPE will add Preservation Watch & more• The PLANETS Testbed   – Re-imagined as a gateway to a complem...
Upcoming SlideShare
Loading in …5
×

Planets, OPF & SCAPE - presentation of tools on digital preservation

284 views
227 views

Published on

Andrew Jackson from British Library presents digital preservation tools from the EU projects Planets and SCAPE and the Open Planets Foundation which is a network providing practical solutions and expertise in digital preservation.
Presented at 'Practical Tools for Digital Preservation: A Hack-a-thon' in York, September 28, 2011.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
284
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Planets, OPF & SCAPE - presentation of tools on digital preservation

  1. 1. PLANETS, OPF & SCAPE A summary of the tools from these preservation projects, and where their development is headingwww.openplanetsfoundation.org
  2. 2. PLANETS• A big project to build digital preservation tools...www.openplanetsfoundation.org
  3. 3. OPF’s Challenge• The Open Planets Foundation was set up to sustain the PLANETS outputs into the future. – But the tools are • Numerous, often complex, & of mixed quality/maturity • Require complex technology stacks (JEE) – So, how do we make the code sustainable? • Selection, modularisation, simplification • Aim for a flexible suite of modular tools, rather than a monolithic systemwww.openplanetsfoundation.org
  4. 4. SCAPE• http://www.scape-project.eu/• Many PLANETS partners – Including OPF• Many new partners too• Driven by data – Web archiving, science data, large-scale• Cluster computing for scale – Based on the HADOOP platformwww.openplanetsfoundation.org
  5. 5. PLATOwww.openplanetsfoundation.org
  6. 6. The PLANETS Testbedwww.openplanetsfoundation.org
  7. 7. The PLANETS Testbed: Too Many Good Ideas In One Place• Designing experiments – Web GUI for complex workflows• Running experiments – All services hosted centrally, plus test corpora• Analysing the results – Per-experiment automated & manual analysis – Multi-experiment aggregation & data mining• Sharing all of the abovewww.openplanetsfoundation.org
  8. 8. Re-imagining The PLANETS Testbed: A Modular Approach• Use separate tools in each role – Experiment Design – Execution – Analysis• Publish results from each – Loosely coupled instead of all-in-one • i.e. sharing is built into the designwww.openplanetsfoundation.org
  9. 9. Experiment Design: SCAPE Workflows In Taverna• As part of SCAPEwww.openplanetsfoundation.org
  10. 10. Experiment Design Support: SCAPE Service Registrywww.openplanetsfoundation.org
  11. 11. Experiment Design Support: OPF Shared Test Corpora• Simple collections accessed over HTTP – No special browser software required• Publicly hosted by HATII – May also be mirrored by OPF members• Stabilise corpora from Planets – Adsorb corpora from SCAPE & elsewhere• Look for Open Source CMS/Annotation tools – Layer on top of HTTP collectionswww.openplanetsfoundation.org
  12. 12. Experiment Design Support: Sharing & Publishing Via myExperimentwww.openplanetsfoundation.org
  13. 13. Experiment Execution Support: SCAPE’s Lightweight Tool Wrapping• PIT: Preservation-action Invocation Tool – Uses XML ‘tool specification’ documents that describe preservation actions • Command-line templates, Java classes, PLANETS/SCAPE web services, etc – Built to be shared • Can be published via, e.g. myExperiment • Should lead to more reproducible results – Re-using PLANETS interoperability codewww.openplanetsfoundation.org
  14. 14. Experiment Execution: Multi-platform Tool & Workflow Invocation• Shared tool specifications make multi-platform execution easier – From the command line – From within Taverna – From the SCAPE cluster platform – From a simplified web interface• Run local-first, remote/service as needed• Collect results in a standard form, using Testbed codewww.openplanetsfoundation.org
  15. 15. Experiment Execution: Publishing Experimental Results Via REF• OPF Results Evaluation Framework: REF – Hard-coded experiments of common interest • Can run the experiment automatically – Publishes results as linked data • http://data.openplanetsfoundation.org/ref/extension/• Built by Dave Tarrant, based on P2 format registry – Will come up again in the Identification session – SCAPE aims to publish much more datawww.openplanetsfoundation.org
  16. 16. Analysing Results: Linked Data & Future Plans• REF allows data to be inspected – Concentrating on collecting data at present• Will expose SPARQL endpoint for data queries – Analysis, visualisation can be build upon that• Please add analysis Issues for your Datasets and preservation processes to the wiki! – e.g. what graphs and statistics would be useful?www.openplanetsfoundation.org
  17. 17. Summary• PLATO – SCAPE will add Preservation Watch & more• The PLANETS Testbed – Re-imagined as a gateway to a complementary suite of preservation tools and data services – SCAPE leveraging work from Taverna, IMPACT• Development driven by user needs – SCAPE Scenarios, AQuA/Hackathon Issueswww.openplanetsfoundation.org

×