Recommended
More Related Content
What's hot
What's hot (20)
Similar to Toward a National Digital Network: An Update from DPLA and ESDN - Metro Annual Meeting 2015 -
Similar to Toward a National Digital Network: An Update from DPLA and ESDN - Metro Annual Meeting 2015 - (20)
Recently uploaded
Recently uploaded (20)
Toward a National Digital Network: An Update from DPLA and ESDN - Metro Annual Meeting 2015 -
- 1. EMPIRE STATE DIGITAL NETWORK New York Service Hub of the DPLA Kerri Willette, Chris Stanton, John Mignault METRO Annual Meeting, January 15, 2015
- 4. New York Service Hub
- 5. Timeline • Hire staff • Convene advisory & working groups • Develop infrastructure • Establish workflows • Gather data from NY 3Rs hosted collections • Create and distribute guidelines for contribution • Outreach to LAMS statewide • Grow New York content in DPLA Phase 1 October 2013 - April 2015 Phase 2 May 2015 - April 2016
- 8. New York Mini-hubs • Outreach • Communication • Permissions
- 9. New York Mini-hubs • Outreach • Communication • Permissions
- 10. New York Mini-hubs Hosted Regional Collections Non-hosted Regional Collections Member institutions with: • Locally hosted collections – Large private institutions – Small specialized institutions with local systems • Collections looking for a home – Digital content with no platform
- 11. METRO Members • METRO Digital Culture • Liaison: Anne Karle-Zenith
- 12. What’s next Phase 1 • First contribution to DPLA – happening now! 89,626 records • Schedule monthly ongoing harvests • Coordinate outreach and communication through 3R’s regional liasons in preparation for Phase 2 Phase 2 Broaden contribution • Streamline contribution processes • Continue adding regionally hosted content • Work with regional liaisons to include non-hosted partners statewide • Grow New York content in DPLA
- 14. Overview Different metadata formats from partners DC, MODS right now Partner metadata coming from CONTENTdm, Islandora, CollectiveAccess, ArchivalWare, etc. OAI-PMH Allows us to harvest from data providers and also provide data to DPLA ESDN normalizes and sends one stream of MODS data to DPLA
- 15. Mapping MODS is mapped to the DPLA MAP (Metadata Application Profile) http://dp.la/info/developers/map/ Closely follows DPLA’s preferred MODS implementation (NCDHC!)
- 16. Required/Recommended Fields Required (per record) Title Rights Link to record on local site Link to content preview (where applicable) Thumbnail Other fields recommended and/or optional Place Subject Date Type Language http://www.mnylc.org/esdn/contributors/metadata- requirements/
- 17. Data Review Still very manual in parts Tools from North Carolina Digital Heritage Center https://github.com/ncdhc/dpla-aggregation-tools
- 18. Aggregation REPOX (http://repox.sysresearch.org/) Developed by Technical University of Lisbon for Europeana Used by other DPLA Service Hubs Allows us to harvest and provide various formats through OAI-PMH
- 19. Transformations Available @ https://github.com/ESDNhub
- 20. Thanks! • ESDN website: http://metro.org/esdn/ • Follow: @NYSdigital Chris Stanton Metadata Specialist cstanton@metro.org John Mignault Technology Specialist jmignault@metro.org Kerri Willette ESDN Manager cstanton@metro.org
Editor's Notes
- DPLA brings together digital resources from America’s libraries, archives and museums and it makes them freely available to the world. In addition to their searchable portal which provides access to millions of items from libraries, archives, and museums around the US -- DPLA is also a platform with a free and open Application Programming Interface (API) for developers and programmers. The API encourages creative reuse of this shared content.
- Where does all that content come from? DPLA relies on a national network of partners called “Hubs”. Many of DPLA’s hubs are state or regionally based partners – these are the Service hubs shown in this diagram - that gather data from collecting institutions and share that data with DPLA.
- ESDN is the New York State service hub for DPLA. In May 2013 - the NY 3Rs association put out a report that named 6 initiatives as part of their strategic planning process. One of the 6 initiatives was the creation of a New York service hub for the DPLA. It was agreed then that METRO would host the hub, but that it would be administered in collaboration with the other 8 regional councils that make up the NY 3R’s Association.
- When the hub was announced a 3-year project plan was put in place. The plan was divided into two phases. As you can see, we are now in the home stretch of Phase 1 which has focused primarily on laying the necessary groundwork to get the hub up and running. Basically, we’ve spent the past year putting the pieces in place to get our hub functional. And now we’re preparing to move into phase 2 this spring. Phase 2 is when the hub will really open for business. That’s when we will begin to open up participation more broadly throughout the state.
- Phase 1 – we mostly focused on hosted 3R’s collections and low hanging fruit. We used select collections from regional projects and a few additional partners to get our infrastructure and workflows ironed out. We roped in the State Library and the State Archives and we wanted to work with at least one large, private institution in the state, Columbia University. These organizations all agreed to provide us with data from their systems so that we could work through our technical processes – but even more importantly they’ve helped us establish our workflows for contribution.
- So when we open up contribution more broadly in Phase 2 and begin bringing in content from all sorts of organizations statewide, we have some idea now of what our process needs to look like. First of all, we’re clear now that we cannot sustain 1 to 1 relationships with every institution in the state that wants to contribute data to DPLA. Instead we will be relying on the 3R’s councils to facilitate the contribution process with new partners. We’re working now to implement a regionally coordinated approach.
- We think this will function kind of like a statewide network of mini-hubs. As you can imagine, there are simply too many individual organizations and potential providers in the state for it to make sense for our staff of 3 to coordinate communication and outreach with every new contributor going forward. Luckily, the state is already divided into to nine existing service regions. This is the NY 3Rs councils map. In phase 2 of the ESDN project plan, all communication and contact with potential and existing contributors will be coordinated through the NY3R’s regional councils. Each regional council will host an ESDN liaison (a council staff member) who will be the primary contact for ESDN within a given part of the state. So there will be 9 liaisons statewide that will facilitate contribution to DPLA.
- That facilitation will continue to include growing content from these hosted projects we’ve already been working with in Phase 1. We believe these projects will also provide a potential on-ramp to DPLA for small institutions in each region that can’t support their own systems locally.
- Of course not every institution in the state has their digital content in one of these hosted projects. So, in addition to growing content from the existing hosted projects, regional liaisons will also facilitate partnerships with institutions that host collections locally. The ESDN Regional Liaisons are already meeting as a group and working with ESDN staff to coordinate consistent and clear communication statewide.
- For METRO members, your regional liaison for ESDN will be Anne Karle-Zenith. Anne will be the primary contact for ESDN for METRO member organizations. She will take the lead in contacting and communicating with institutions that would like to contribute to DPLA through ESDN. If over the course of the past year you have reached out to ESDN directly to express interest in contributing – either via the online interest form, or speaking to me directly at conferences – that information has all been tracked and passed on to Anne so she is aware of your interest. Later this spring, once we enter phase 2, Anne will take the lead in reaching out to interested parties. Some of you may have already heard from Anne and we’re very excited for the interest METRO members have shown in participating in DPLA, we just ask your patience as we move forward to begin rolling partners into the project.
- Up till this point, majority of content from CONTENTdm hosted collections.
- Mapping our “single stream of data”, MODS, to the DPLA Metatada Model Benefited from work of existing service hubs, like North Carolina Digital Heritage Center, who are also providing MODS to the DPLA DPLA MAP specifies required/recommended fields
- Few required fields, more optional and recommended fields Low-barrier to entry
- Work 1 on 1 with partners – do field mapping in spreadsheets – use some tools like these custom things to review varies aspects of the data and send feedback to the institution to do clean-up or mapping changes. Check for presence of required and recommended fields Review data feed for inconsistencies and mapping issues Help to configure/troubleshoot OAI Provide feedback to partners
- We are relying on REPOX to handle aggregation processes - we pull data into here, apply transformations using XSLT, and then output an OAI feed for DPLA to grab.
- Base stylesheets, provider specific stylesheets