Developing the
Hydra - Blacklight Way
Tom Cramer
Chief Technology Strategist
Stanford University Libraries
@tcramer
CNI Me...
Agenda
• What is Hydra?
• What is Blacklight?
• Where are they going?
• What does it all mean?
What Is Hydra?
• A robust repository fronted by feature-rich,
tailored applications and workflows (“heads”)
➭ One body, ma...
Fundamental Assumption #1
No single system can provide the full range
of repository-based solutions for a given
institutio...
Books
Articles
Theses
Images
Maps
Data (Raster)
Data (Comp.)
Data (Observ.)
Audio
Video
Documents
Point Solution Approach …Welcome to Siloville
ETDs
(Theses)
Books,
Articles
Images
Audio-
Visual
Research
Data
Maps
& GIS
...
Repository-Powered Approach
ETDs
(Theses)
Books,
Articles
Images
Audio-
Visual
Research
Data
Maps
& GIS
Docu-
ments
Scalab...
One Body, Many Heads…
ETDs
(Theses)
Books,
Articles
Images
Audio-
Visual
Research
Data
Maps
& GIS
Docu-
ments
Scalable, Ro...
Hydra Technical
Framework
CRUD in Repositories
Repository/
Persistent Storage
Create/Submit/Edit
(CUD)
Search/View
(R)
CRUD in Repositories
Repository/
Persistent Storage
Create/Submit/Edit
(CUD)
Search/View
(R)
Major Hydra Components
Fedora Solr
Solrizer
Blacklight
(R)
hydra-head
Rails Plugin
(CUD)
Blacklight
(Read Only)
A Note on Ruby on Rails
• Rapid application development for web
applications: “Convention over configuration”
– 10x produc...
A Note on Fedora
• Flexible, Extensible, Durable Object
Repository Architecture
– Flexible: model and store any content ty...
Hydra Community
Framework
Fundamental Assumption #2
No single institution can resource the
development of a full range of solutions on
its own,
…yet...
Hydra Philosophy -- Community
• An open architecture, with many
contributors to a common core
• Collaboratively built “sol...
Community
• Conceived & executed as a distributed, collaborative,
open source effort from the start
• Initially a joint de...
Hydra Partners…
…are individuals, institutions, corporations or
other groups that have committed to contributing
to the Hy...
Code Licensing
• All Hydra code is available under Apache
License, Version 2.0
• All code commitments are being managed
th...
Hydra Current State
Hydra Partners
0
5
10
15
20
25
OR09 OR10 OR11 OR12 OR13
OR = Open Repositories Conference
Hydra Partners and Known Users
0
5
10
15
20
25
30
35
40
OR09 OR10 OR11 OR12 OR13 Now
OR = Open Repositories Conference
Hydra Partners @ UCSD, 2012
University of Virginia, 2008
LibDevConX^3, Stanford, 2012: (Hydranauts and Fellow Travelers)
First Worldwide Hydra Connect @ UCSD, 2013
Trending
Trending
Hydra Heads: Institutional Repositories
University of Hull
Hydra Heads: Institutional Repositories
ScholarSphere / Sufia @ Penn State
Hydra Heads: Institutional Repositories
Hydramata
• 6-institution collaboration
• Build a shared Hydra head to
serve as an...
Hydra Heads of Note
Avalon & HydraDAM for Media
Sufia
BPL Digital Commonwealth
UCSD DAMS
Northwestern Digital Image Lib.
Hydra-based Applications at Stanford
ETD’s – Electronic Theses
& Dissertations
SALT – Self-Archiving
Legacy Toolkit
EEMs –...
Sustainability
No animals were harmed
in the making of this film.
Current State of Hydra
• Doubled in size, thrice, since its founding
• Achieved all its original goals
• Entering a new ph...
Three critical priorities
1. Technical framework continue to advance
to enable easy code sharing and reuse
2. Community fr...
Eight strategic priorities
1. Develop solution bundles
2. Develop turnkey applications
3. Grow the Hydra vendor ecosystem
...
Blacklight
Blacklight for Repositories
• Repository-agnostic, feature-rich, content-
aware, turnkey access interface
• Aggregate cont...
Blacklight
• Who’s Using It?
– Scores (probably hundreds) of institutions
– Notables: UVa, Stanford, Columbia, Cornell, Pr...
Blacklight Development
http://www.ohloh.net/p/blacklight
Library Catalog @ Stanford
CLIO at Columbia University – Bento Box results w/ article search
Virgo at University of Virginia – Music Search View
Forward at University of Wisconsin
Revs Digital Library at Stanford: Blacklight for Image Collection
FRDA at Stanford: Blacklight for text & image collection
Digital Manuscript Index at Stanford: Blacklight for MS Catalog
Bassi-Veratti at Stanford: Blacklight for EAD and digital archive
Rock & Roll Hall of Fame: Blacklight for Catalog, EAD and Media
OpenVault: Blacklight for Video at WGBH
Digital Commonwealth at BPL: Blacklight for statewide repository
GeoBlacklight: Blacklight for geospatial resources
Spotlight: Blacklight for exhibits
The Hydra-Blacklight Way
Why Hydra?
• Need a flexible, rich, robust repository solution
• Be part of a community
– Shared resources, shared risk, s...
Breadth & Depth: Access, Mgmt & Pres
ETDs
(Theses)
Books,
Articles
Images
Audio-
Visual
Research
Data
Maps
& GIS
Docu-
men...
If You Want To Go Fast …go alone.
…use Hydra
1) Notre Dame deployed a video cataloging
head in 6 weeks, from scratch
https...
Becoming a Hub
• Working Groups forming
– Repository Managers
– Archivsists
– Hydra RDF
– Fedora…
• Jobs
Sustainability…
• For institutions
Partners help shoulder the load
• For other projects
Post-project maintenance & governa...
The Hydra Way
• Not a directed project
• Investment in a framework, not an application
– Contributions back to core code b...
http://projecthydra.org
Hydra for CNI Spring 2014 Meeting
Upcoming SlideShare
Loading in...5
×

Hydra for CNI Spring 2014 Meeting

1,052

Published on

Hydra and Blacklight are both successful, vibrant open source projects among research libraries and higher education. They have achieved a critical mass of adopters and rich set of functions, as much because of the methodology and community as their strong technical capabilities. This presentation gives an overview of both projects, and describes the "Hydra-Blacklight" Way, and how this "way" is pulling institutions into the future of digital libraries.

Published in: Internet, Technology, Education
1 Comment
3 Likes
Statistics
Notes
No Downloads
Views
Total Views
1,052
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
16
Comments
1
Likes
3
Embeds 0
No embeds

No notes for slide
  • Future development progress will be 1) based on leveraging the existing toolsin the ecosystem to assemble new solutions, and 2) ongoing investments in and extensions to the infrastructure.
  • Future development progress will be 1) based on leveraging the existing toolsin the ecosystem to assemble new solutions, and 2) ongoing investments in and extensions to the infrastructure.
  • Future development progress will be 1) based on leveraging the existing toolsin the ecosystem to assemble new solutions, and 2) ongoing investments in and extensions to the infrastructure.
  • One body, many heads: Stanford has developed 5 distinct Hydra Heads, all fronting a Fedora repository—and each with their specialized interfaces and workflows for distinct audiences.
  • Transcript of "Hydra for CNI Spring 2014 Meeting"

    1. 1. Developing the Hydra - Blacklight Way Tom Cramer Chief Technology Strategist Stanford University Libraries @tcramer CNI Membership Meeting St. Louis * April 1, 2014
    2. 2. Agenda • What is Hydra? • What is Blacklight? • Where are they going? • What does it all mean?
    3. 3. What Is Hydra? • A robust repository fronted by feature-rich, tailored applications and workflows (“heads”) ➭ One body, many heads • Collaboratively built “solution bundles” that can be adapted and modified to suit local needs. • A community of developers and adopters extending and enhancing the core ➭ If you want to go fast, go alone. If you want to go far, go together.
    4. 4. Fundamental Assumption #1 No single system can provide the full range of repository-based solutions for a given institution’s needs, …yet sustainable solutions require a common repository infrastructure.
    5. 5. Books Articles Theses Images Maps Data (Raster) Data (Comp.) Data (Observ.) Audio Video Documents
    6. 6. Point Solution Approach …Welcome to Siloville ETDs (Theses) Books, Articles Images Audio- Visual Research Data Maps & GIS Docu- ments Management Access Preservation(?) Effective? Sustainable?
    7. 7. Repository-Powered Approach ETDs (Theses) Books, Articles Images Audio- Visual Research Data Maps & GIS Docu- ments Scalable, Robust, Shared Management and Preservation Services
    8. 8. One Body, Many Heads… ETDs (Theses) Books, Articles Images Audio- Visual Research Data Maps & GIS Docu- ments Scalable, Robust, Shared Management and Preservation Services
    9. 9. Hydra Technical Framework
    10. 10. CRUD in Repositories Repository/ Persistent Storage Create/Submit/Edit (CUD) Search/View (R)
    11. 11. CRUD in Repositories Repository/ Persistent Storage Create/Submit/Edit (CUD) Search/View (R)
    12. 12. Major Hydra Components Fedora Solr Solrizer Blacklight (R) hydra-head Rails Plugin (CUD) Blacklight (Read Only)
    13. 13. A Note on Ruby on Rails • Rapid application development for web applications: “Convention over configuration” – 10x productivity • Supportable: MVC (Model-View-Controller) and Rails framework make code well-structured, predictable • Testable: Rspec and Cucumber give powerful, automatable, testing tools • Learnable: Stanford went from 1 to 8 Ruby savvy developers in one year (no new hires) – 1 week learning curve to basic proficiency
    14. 14. A Note on Fedora • Flexible, Extensible, Durable Object Repository Architecture – Flexible: model and store any content types – Extensible: easy to augment with apps and services – Durable: foundation of preservation repository • Proven, sustained and successful digital repository – 100’s of adopters; 12 years of development, 3 releases – Vibrant community & funding under DuraSpace • Fedora 4 in development; co-evolving with Hydra
    15. 15. Hydra Community Framework
    16. 16. Fundamental Assumption #2 No single institution can resource the development of a full range of solutions on its own, …yet each needs the flexibility to tailor solutions to local demands and workflows.
    17. 17. Hydra Philosophy -- Community • An open architecture, with many contributors to a common core • Collaboratively built “solution bundles” that can be adapted and modified to suit local needs • A community of developers and adopters extending and enhancing the core • “If you want to go fast, go alone. If you want to go far, go together.” One body, many heads
    18. 18. Community • Conceived & executed as a distributed, collaborative, open source effort from the start • Initially a joint development project between Stanford, Univ of Virginia, and Univ of Hull • Hydra Partners are the backbone of the project • Coalition of the willing • No fees or dues • Apache-style consensus and governance • Steering Group provides administration, continuity, and serves as backstop when needed • But no central planning, no Project Director, no “one” architect
    19. 19. Hydra Partners… …are individuals, institutions, corporations or other groups that have committed to contributing to the Hydra community; they not only use the Hydra technical framework, but also add to it in at least one of many ways: code, analysis, design, support, funding, or other resources. Hydra Partners collectively advance the project and the community for the benefit of all participants. https://wiki.duraspace.org/display/hydra/Hydra+Community+Framework
    20. 20. Code Licensing • All Hydra code is available under Apache License, Version 2.0 • All code commitments are being managed through Contributor License Agreements • Individual – so each developer is clear about what they are contributing • Corporate – so each institution is clear about what it is contributing • Code contributors maintain ownership of their IP • …and grant a non-exclusive license to the project and its users
    21. 21. Hydra Current State
    22. 22. Hydra Partners 0 5 10 15 20 25 OR09 OR10 OR11 OR12 OR13 OR = Open Repositories Conference
    23. 23. Hydra Partners and Known Users 0 5 10 15 20 25 30 35 40 OR09 OR10 OR11 OR12 OR13 Now OR = Open Repositories Conference
    24. 24. Hydra Partners @ UCSD, 2012 University of Virginia, 2008 LibDevConX^3, Stanford, 2012: (Hydranauts and Fellow Travelers)
    25. 25. First Worldwide Hydra Connect @ UCSD, 2013
    26. 26. Trending
    27. 27. Trending
    28. 28. Hydra Heads: Institutional Repositories University of Hull
    29. 29. Hydra Heads: Institutional Repositories ScholarSphere / Sufia @ Penn State
    30. 30. Hydra Heads: Institutional Repositories Hydramata • 6-institution collaboration • Build a shared Hydra head to serve as an IR • Distributed, agile team University of Notre Dame Northwestern University Indiana University University of Cincinnati University of Virginia
    31. 31. Hydra Heads of Note Avalon & HydraDAM for Media Sufia BPL Digital Commonwealth UCSD DAMS Northwestern Digital Image Lib.
    32. 32. Hydra-based Applications at Stanford ETD’s – Electronic Theses & Dissertations SALT – Self-Archiving Legacy Toolkit EEMs – Everyday Electronic Materials Argo – Repository Reporting and Management Hypatia – Archives & Special Collections SDR – Web UI (aka Hydrus)
    33. 33. Sustainability No animals were harmed in the making of this film.
    34. 34. Current State of Hydra • Doubled in size, thrice, since its founding • Achieved all its original goals • Entering a new phase
    35. 35. Three critical priorities 1. Technical framework continue to advance to enable easy code sharing and reuse 2. Community framework evolves to accommodate growth in partners. 3. Create a full suite of solution bundles
    36. 36. Eight strategic priorities 1. Develop solution bundles 2. Develop turnkey applications 3. Grow the Hydra vendor ecosystem 4. Codify a scalable training framework to fuel community growth 5. Develop a documentation framework 6. Ensure the technical framework allows code sharing 7. Refresh and intensify the community ties 8. Grow the community of users and adopters
    37. 37. Blacklight
    38. 38. Blacklight for Repositories • Repository-agnostic, feature-rich, content- aware, turnkey access interface • Aggregate content from multiple repositories, with links back to source systems • Vibrant, multi-institutional, open source community on its own • Can be used independently, or as the first component of, Hydra
    39. 39. Blacklight • Who’s Using It? – Scores (probably hundreds) of institutions – Notables: UVa, Stanford, Columbia, Cornell, Princeton, Yale, Johns Hopkins, WGBH, BPL, NYPL, Danish Technical University, Tufts, Indiana University, Univ. of Wisconsin, et al. – Every Hydra institution • Remarkably strong community – Regular workshops and tutorials at Code4Lib, DLF, et al. – 328 members on blacklight-development@googlegroups.com
    40. 40. Blacklight Development http://www.ohloh.net/p/blacklight
    41. 41. Library Catalog @ Stanford
    42. 42. CLIO at Columbia University – Bento Box results w/ article search
    43. 43. Virgo at University of Virginia – Music Search View
    44. 44. Forward at University of Wisconsin
    45. 45. Revs Digital Library at Stanford: Blacklight for Image Collection
    46. 46. FRDA at Stanford: Blacklight for text & image collection
    47. 47. Digital Manuscript Index at Stanford: Blacklight for MS Catalog
    48. 48. Bassi-Veratti at Stanford: Blacklight for EAD and digital archive
    49. 49. Rock & Roll Hall of Fame: Blacklight for Catalog, EAD and Media
    50. 50. OpenVault: Blacklight for Video at WGBH
    51. 51. Digital Commonwealth at BPL: Blacklight for statewide repository
    52. 52. GeoBlacklight: Blacklight for geospatial resources
    53. 53. Spotlight: Blacklight for exhibits
    54. 54. The Hydra-Blacklight Way
    55. 55. Why Hydra? • Need a flexible, rich, robust repository solution • Be part of a community – Shared resources, shared risk, shared advances • “We” is smarter than “me” – Especially in this crowd • Control your own destiny • Build institutional capacity • Practice best practices • The way work is getting done now
    56. 56. Breadth & Depth: Access, Mgmt & Pres ETDs (Theses) Books, Articles Images Audio- Visual Research Data Maps & GIS Docu- ments Scalable, Robust, Shared Management and Preservation Services
    57. 57. If You Want To Go Fast …go alone. …use Hydra 1) Notre Dame deployed a video cataloging head in 6 weeks, from scratch https://github.com/projecthydra/hypatia/graphs/impact 2) Hypatia development at Stanford • First 20% of project took 80% of time (modelling, data acquisition and preparation) • 80% of deliverables (coding) happened in 8 week spurt, by leveraging Hydra
    58. 58. Becoming a Hub • Working Groups forming – Repository Managers – Archivsists – Hydra RDF – Fedora… • Jobs
    59. 59. Sustainability… • For institutions Partners help shoulder the load • For other projects Post-project maintenance & governance • For leveraging funders’ investments Adoption by growing user community
    60. 60. The Hydra Way • Not a directed project • Investment in a framework, not an application – Contributions back to core code base • Investment in a community, not a vendor – Contributions back to community: Training, documentation, modeling, evangelism, support • Travel / face-time
    61. 61. http://projecthydra.org
    1. ¿Le ha llamado la atención una diapositiva en particular?

      Recortar diapositivas es una manera útil de recopilar información importante para consultarla más tarde.

    ×