Semantic Data Integration with SMW+

1,439 views

Published on

SMW+ is a semantic enterprise Wiki for teams that need a human-readable and agile knowledge base for collaborating on rich text and data in their day to day work.

Learn here how you can integrate heterogeneous data stored in external databases into SWM+ using TripleStore professional and OntoStudio.

(this presenation was helt at the Semantic Technology Conference 2011 San Francisco)

Published in: Technology
  • Be the first to comment

Semantic Data Integration with SMW+

  1. 1. Data Integration with SMW+Michael Erdmann, ontoprise KarlsruheSemTech, June 2011, San Francisco, CA © 2010 ontoprise GmbH Seite 1
  2. 2. Agenda Motivation General workflow and architecture OntoStudio (with demo)  From relational database to wiki vocabulary SMW+ (with demo)  Using external data  Enhancing/extending external data Summary and Outlook © 2010 ontoprise GmbH Seite 2 http://smwforum.ontoprise.com
  3. 3. Motivation Enterprises typically manage there data in relational databases Often a landscape of isolated data silos grows In contrast, a wiki provides one platform for sharing information Nevertheless,  the data bases exist  contain valuable information  will not be deserted Enterprise use cases we see often require access to external data from within the wiki  Usually the external data sources are relational databases  Wiki is used as a data access and visualisation tool  Wiki users should be able to formulate queries © 2010 ontoprise GmbH Seite 3 http://smwforum.ontoprise.com
  4. 4. Workflow for Data Integration with SMW+ OntoStudio  SMW+ / TSC  Lift database schema  Import ontologies  Model wiki ontology  Formulate queries (QI)  Map database ontology to  Create articles containing inline queries wiki ontology  Browse database via Non-  Test and refine mappings Existing-Pages  Export ontologies  Potentially, enhance model  Transfer to Wiki server via annotations  Adapt and extend wiki ontology  Import ontology  Export ontology as OBL  Test and refine ontology © 2010 ontoprise GmbH Seite 4 http://smwforum.ontoprise.com
  5. 5. Architecture © 2010 ontoprise GmbH Seite 5Slide 5 http://smwforum.ontoprise.com
  6. 6. Database Lifting Database schemas are table-based and usually geared towards performance not conceptual clarity Schemas are lifted to an ontological level automatically  Tables become classes  Foreign-keys become object properties (in the OWL sense)  Other columns become data properties The result is an ObjectLogic ontology representing the database This ontology contains data-access rules that populate classes and properties  These rules are OBL rules reaching out into the database  Rules are triggered at query time © 2010 ontoprise GmbH Seite 6 http://smwforum.ontoprise.com
  7. 7. Live Demo ofOntoStudio © 2010 ontoprise GmbH Seite 7 http://smwforum.ontoprise.com
  8. 8. OntoStudio: Database Lifting© 2010 ontoprise GmbH Seite 8http://smwforum.ontoprise.com
  9. 9. OntoStudio: Modeling© 2010 ontoprise GmbH Seite 9http://smwforum.ontoprise.com
  10. 10. OntoStudio: Graphical Rule Modeling © 2010 ontoprise GmbH Seite 10 http://smwforum.ontoprise.com
  11. 11. OntoStudio: Mapping© 2010 ontoprise GmbH Seite 11http://smwforum.ontoprise.com
  12. 12. OntoStudio: Testing© 2010 ontoprise GmbH Seite 12http://smwforum.ontoprise.com
  13. 13. Query AnsweringTSC with OntoBroker mapping results manual mappings query SMW+ generated ontologies mapping rules integrated results Wiki facts access automatic ontology schema from rules mapping source databases © 2010 ontoprise GmbH Seite 13 Slide 13 http://smwforum.ontoprise.com
  14. 14. Workflow OntoStudio  SMW+ / TSC  Lift database schema  Import ontologies  Model wiki ontology  Formulate queries (QI)  Map database ontology to  Create articles containing inline queries wiki ontology  Browse database via Non-  Test and refine mappings Existing-Pages  Export ontologies  Potentially, enhance model  Transfer to Wiki server via annotations  Adapt and extend wiki ontology  Import ontology  Export ontology as OBL  Test and refine ontology © 2010 ontoprise GmbH Seite 14 http://smwforum.ontoprise.com
  15. 15. Import Ontology into Wiki The wiki ontology coming from OntoStudio needs to be imported. This is a task for the Deplyoment Framework (DF) Ontologies can be imported from a file or from a repository Technically, the ontology file is converted into the MW XML- format and then imported by wiki tools.  The external tool for this task is “onto2mwxml”. It can also handle OWL, RDF/XML, N3, NTRIPLE, OBL  smwadmin –i myOntology.obl © 2010 ontoprise GmbH Seite 15 http://smwforum.ontoprise.com
  16. 16. ObjectLogic OBL contains stuff that has no equivalent in the wiki  Predicates  Mapping rules  Queries They are stored as a separate file in the wiki and are copied into the TSC as an individual module to be executable. TSC:  Wikimodule (contains all wiki annotations, incl. the ones imported from OBL) is automatically synched with Wiki  TSC-only part from imported OBL (this module is imported by the wikimodule)  Other modules, e.g. module created by lifting a database © 2010 ontoprise GmbH Seite 16 http://smwforum.ontoprise.com
  17. 17. Wiki Part ofData Integration © 2010 ontoprise GmbH Seite 17 http://smwforum.ontoprise.com
  18. 18. Imported Ontology in OntologyBrowser © 2010 ontoprise GmbH Seite 18 http://smwforum.ontoprise.com
  19. 19. Imported rules Rules of an ontology are stored on a separate page for each ontology. © 2010 ontoprise GmbH Seite 19 http://smwforum.ontoprise.com
  20. 20. Example of an Imported Page Imported page Property:HasName  Property has two domains: Product, Region  Type is String  The original URI in the ontology is  http://www.NewOnto1.org/ontology#hasName  This is separately stored in a mapping table to provide fast access whenever wiki names have to be replaced by OB URIs or vice-versa.  The (automatically created) bundle is Ontology-v9 © 2010 ontoprise GmbH Seite 20 http://smwforum.ontoprise.com
  21. 21. Query for Integrated Data{{#ask: [[Category:Price]][[InRegion.HasName::+]][[OfProduct.HasName::+]][[OfProduct.HasManufacturer::+]]|?Price|?InRegion.HasName=Region name|?OfProduct.HasName=Product name|?OfProduct.HasManufacturer=Manufacturer|source=tsc}} © 2010 ontoprise GmbH Seite 21 http://smwforum.ontoprise.com
  22. 22. Query in the Query Interface© 2010 ontoprise GmbH Seite 22http://smwforum.ontoprise.com
  23. 23. Non-Existing Pages An instance created from a database mapping is represented by a red-link. In case that there is no real database key, OntoBroker creates one automatically. If the user clicks on a red link, the non-existing page handler takes care of it  It displays all statements about this instance as well as all statements which have this instance as object. © 2010 ontoprise GmbH Seite 23 http://smwforum.ontoprise.com
  24. 24. Non-Existing PagesThis is the NEP page with the default template. It can be user-defined. © 2010 ontoprise GmbH Seite 24 http://smwforum.ontoprise.com
  25. 25. Extend the Ontology in the Wiki Create a new category © 2010 ontoprise GmbH Seite 25 http://smwforum.ontoprise.com
  26. 26. Extend the Ontology in the Wiki Create a rule in the wiki with the editor © 2010 ontoprise GmbH Seite 26 http://smwforum.ontoprise.com
  27. 27. ObjectLogic Export To re-import the ontology in OntoStudio, export it via the OBL export bot. © 2010 ontoprise GmbH Seite 27 http://smwforum.ontoprise.com
  28. 28. Download Ontology from Wiki Exported ontologies are stored in the wiki as files. © 2010 ontoprise GmbH Seite 28 http://smwforum.ontoprise.com
  29. 29. Workflow OntoStudio  SMW+ / TSC  Lift database schema  Import ontologies  Model wiki ontology  Formulate queries (QI)  Map database ontology to  Create articles containing inline queries wiki ontology  Browse database via Non-  Test and refine mappings Existing-Pages  Export ontologies  Potentially, enhance model  Transfer to Wiki server via annotations  Adapt and extend wiki ontology  Import ontology  Export ontology as OBL  Refine and test ontology © 2010 ontoprise GmbH Seite 29 http://smwforum.ontoprise.com
  30. 30. Re-imported Ontology OS shows new wiki entities © 2010 ontoprise GmbH Seite 30 http://smwforum.ontoprise.com
  31. 31. Summary and Outlook SMW+ and TripleStoreConnector realize  Access to relational data from within SMW  Using the wiki vocabulary  Live queries  Enhance/Extend the data by wiki users Let’s see how this combines with SPARQL endpoints  SMW‘s new SPARQL implementation  Federated queries  Against different sources  Different vocabularies (with and without mapping) © 2010 ontoprise GmbH Seite 31 http://smwforum.ontoprise.com
  32. 32.  Thank you! Michael Erdmann ontoprise GmbH Karlsruhe, Germany erdmann@ontoprise.de © 2010 ontoprise GmbH Seite 32 http://smwforum.ontoprise.com

×