Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
SLUB Dresden and Avantgarde Labs
June 13, 2014
Lightning Talk at ELAG 2014, Bath, England
d:swarm - a Data Management and
Integration Platform
http://dmp.slub-dresden.de
Jan Polowinski et al.
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
d:swarm is an an Open Source Middleware for Data Integration
June 13, 2014
Integrated Library SystemERM Backend System A
ERM Frontend
d:swarm – Middleware for Data Integration
Frontend XDiscovery System
Web,LOD
LOD
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
June 13, 2014
 d:swarm will serve as a middle ware for the linked-data-based
ERM system AMSL (UB Leipzig, AKSW)
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
d:swarm – Some More Details
June 13, 2014
„Data Hub“
GUI
Configurations,
Mappings,
Transformations ...
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
d:swarm as a Flexible Data Storage
June 13, 2014
 d:swarm achieves the lossless integration of data from
heterogeneous data sources in a flexible, graph-based data
model.
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
d:swarm as a Flexible Data Storage
June 13, 2014
„Data Hub“ –
graph database (neo4j)
• 1 sub-graph per
imported source
• special sub-graph:
the internal model
• versioning and
provenance
information are
handled
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
Inspecting the Graph with the neo4j-Browser
June 13, 2014
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
d:swarm as a Provider for RDF data
June 13, 2014
„Data Hub“ –
graph database (neo4j)
(e.g. the current
internal model)
provide sub-graphs as RDF
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
d:swarm for Increasing Data Quality
June 13, 2014
 d:swarm increases the quality of library data by way of
deduplication, merging, FRBRization, semantic enrichment and
its publication as LOD.
FRBRization ...Deduplication
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
d:swarm as a Data Modelling Tool
June 13, 2014
 d:swarm is a data modeling tool with a graphical and easy-to-
use interface that poses no obstacles to non-programming
librarians
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
Graphical User Interface – Modeling Perspective
June 13, 2014
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
Internal Model and Internal Schema
June 13, 2014
 Can be freely
constructed from
concepts of
multiple
vocabularies
 May be shared with
other libraries
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
d:swarm – Sharing Features
June 13, 2014
GUI
• import configurations
• mappings, transformations
• internal schema
sharing with the swarm
ommons.wikimedia.org/wiki/File:Fish_swarm_Loro_Parque.JPG
Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de
© Creative Commons Attribution 3.0
Alpha release was published end of May –
Help test the software
June 13, 2014
ELAG 2014, Bath, England
d:swarm
http://dmp.slub-dresden.de/en/interesse/
http://dmp.slub-dresden.de/
Jan Polowinski et al.

Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

  • 1.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 SLUB Dresden and Avantgarde Labs June 13, 2014 Lightning Talk at ELAG 2014, Bath, England d:swarm - a Data Management and Integration Platform http://dmp.slub-dresden.de Jan Polowinski et al.
  • 2.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 d:swarm is an an Open Source Middleware for Data Integration June 13, 2014 Integrated Library SystemERM Backend System A ERM Frontend d:swarm – Middleware for Data Integration Frontend XDiscovery System Web,LOD LOD
  • 3.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 June 13, 2014  d:swarm will serve as a middle ware for the linked-data-based ERM system AMSL (UB Leipzig, AKSW)
  • 4.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 d:swarm – Some More Details June 13, 2014 „Data Hub“ GUI Configurations, Mappings, Transformations ...
  • 5.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 d:swarm as a Flexible Data Storage June 13, 2014  d:swarm achieves the lossless integration of data from heterogeneous data sources in a flexible, graph-based data model.
  • 6.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 d:swarm as a Flexible Data Storage June 13, 2014 „Data Hub“ – graph database (neo4j) • 1 sub-graph per imported source • special sub-graph: the internal model • versioning and provenance information are handled
  • 7.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 Inspecting the Graph with the neo4j-Browser June 13, 2014
  • 8.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 d:swarm as a Provider for RDF data June 13, 2014 „Data Hub“ – graph database (neo4j) (e.g. the current internal model) provide sub-graphs as RDF
  • 9.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 d:swarm for Increasing Data Quality June 13, 2014  d:swarm increases the quality of library data by way of deduplication, merging, FRBRization, semantic enrichment and its publication as LOD. FRBRization ...Deduplication
  • 10.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 d:swarm as a Data Modelling Tool June 13, 2014  d:swarm is a data modeling tool with a graphical and easy-to- use interface that poses no obstacles to non-programming librarians
  • 11.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 Graphical User Interface – Modeling Perspective June 13, 2014
  • 12.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 Internal Model and Internal Schema June 13, 2014  Can be freely constructed from concepts of multiple vocabularies  May be shared with other libraries
  • 13.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 d:swarm – Sharing Features June 13, 2014 GUI • import configurations • mappings, transformations • internal schema sharing with the swarm ommons.wikimedia.org/wiki/File:Fish_swarm_Loro_Parque.JPG
  • 14.
    Sächsische Landesbibliothek –Staats- und Universitätsbibliothek Dresden slub-dresden.de © Creative Commons Attribution 3.0 Alpha release was published end of May – Help test the software June 13, 2014 ELAG 2014, Bath, England d:swarm http://dmp.slub-dresden.de/en/interesse/ http://dmp.slub-dresden.de/ Jan Polowinski et al.

Editor's Notes

  • #2  ----- Besprechungsnotizen (12.06.14 11:00) ----- Saxon State and University Library Dresden
  • #3 d:swarm is a middleware solution that goes in between existing data management systems and presentation frontends, being able to take care of all management processes executed on library data.
  • #4 integrates ERM sources and provides RDF
  • #12 Ersetzen durch aktuellen Screenhots evtl. ----- Besprechungsnotizen (12.06.14 11:00) ----- metafacture DNB
  • #13  ----- Besprechungsnotizen (12.06.14 11:00) ----- dini-ag : kompatible metadata