0
Michael K. Bergman Structured Dynamics LLC presented at Semantic Technologies ’09 Conference San Jose, CA June 16, 2009 “ ...
Presentation Outline <ul><li>Overview of BKN </li></ul><ul><li>Demonstration of a BKN Node </li></ul><ul><li>More on Desig...
I.   Overview of BKN
Introduction <ul><li>BibKN  or  BKN :  the  Bib liographic  K nowledge  N etwork </li></ul><ul><li>Develop tools and servi...
The Project <ul><li>Two-year effort </li></ul><ul><li>Began October 2008 </li></ul><ul><li>Joint consortium effort of: </l...
Some Points for this Talk <ul><li>Four kinds of network “nodes”: </li></ul><ul><ul><li>VO Nodes  – collaboration portals <...
Preview of Benefits <ul><li>Comprehensive toolset for structured data (semantic Web) conversion, use and exposure </li></u...
conStruct SCS <ul><li>A ‘data-driven app’ (ontologies + structured data) </li></ul><ul><li>Datasets + permissions </li></u...
II.   Demonstration of a BKN Node
BibKN Welcome Screen
III.   More on Design
Data Formats and Exchange <ul><li>Ingest standard structured and bibliographic data: </li></ul><ul><ul><li>BibTeX </li></u...
Data Formats and Exchange
Four Kinds of ‘Nodes’ <ul><li>VO Nodes  – collaboration portals </li></ul><ul><li>Gateways   – connections to existing ext...
Multiple Deployment Options
Illustrative BKN Network
The Backend Structure <ul><li>Drupal: </li></ul><ul><ul><li>User interface and theming </li></ul></ul><ul><ul><li>User and...
The Backend Structure
IV.   Architecture and Web Services Framework
Overall Architecture
structWSF (Web services framework) <ul><li>Standard functionality: </li></ul><ul><ul><li>Data management: </li></ul></ul><...
structWSF Schema
V.   Collaboration Demonstration
Topology of the Collaboration Demo
VI.   Design Benefits
Comprehensive Toolset <ul><li>Standard functionality: </li></ul><ul><ul><li>Data management: </li></ul></ul><ul><ul><ul><l...
Data-driven  via Ontologies <ul><li>Ontologies (OWL) guide: </li></ul><ul><ul><li>Instance records and attributes </li></u...
RESTful structWSF <ul><li>Independent, standalone piece </li></ul><ul><li>Naïve data formats and RDF APIs via RESTful Web ...
Open Source Drupal Distro <ul><li>Provided as the conStruct module </li></ul><ul><li>See conclusion </li></ul>
Re-cap of Benefits <ul><li>Comprehensive toolset for structured data (semantic Web) conversion, use and exposure </li></ul...
VII.   conStruct and Next Plans
conStruct SCS <ul><li>conStruct SCS is a  structured content system </li></ul><ul><li>Open source version of the BKN proje...
The conStruct System
conStruct Distribution Options <ul><li>Initially: </li></ul><ul><ul><li>Downloads from multiple sites </li></ul></ul><ul><...
conStruct Plans and Schedule <ul><li>conStructSCS.com  now open </li></ul><ul><ul><li>Online demo available </li></ul></ul...
VII.   Contact Info
Contacts & Information <ul><li>Bibliographic Knowledge Network </li></ul><ul><ul><li>Dr. Jim Pitman </li></ul></ul><ul><ul...
 
Upcoming SlideShare
Loading in...5
×

Data-driven Applications with conStruct

1,784

Published on

The first unveiling of conStruct, a structured content system for enabling Drupal to be driven by structured (RDF) data. conStruct also is based on the platform-independent structWSF Web services framework, the provides dataset collaboration over the Web. Presentation is from SemTech 2009.

Published in: Technology, Business
0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,784
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
26
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

Transcript of "Data-driven Applications with conStruct"

  1. 1. Michael K. Bergman Structured Dynamics LLC presented at Semantic Technologies ’09 Conference San Jose, CA June 16, 2009 “ BKN: Building Knowledge through Communities, and Communities through Knowledge”
  2. 2. Presentation Outline <ul><li>Overview of BKN </li></ul><ul><li>Demonstration of a BKN Node </li></ul><ul><li>More on Design </li></ul><ul><li>Architecture and Web Services Framework </li></ul><ul><li>Collaboration Demonstration </li></ul><ul><li>Design Benefits </li></ul><ul><li>conStruct and Next Plans </li></ul><ul><li>Contact Info </li></ul>
  3. 3. I. Overview of BKN
  4. 4. Introduction <ul><li>BibKN or BKN : the Bib liographic K nowledge N etwork </li></ul><ul><li>Develop tools and services for virtual organizations (“ VOs ”): </li></ul><ul><ul><li>Scientific communities of varied sizes, interests </li></ul></ul><ul><ul><li>Conference groups </li></ul></ul><ul><ul><li>Departmental research groups </li></ul></ul><ul><ul><li>Students, teachers and faculty alike </li></ul></ul><ul><li>Select, filter and enhance bibliographic data for each VO : </li></ul><ul><ul><li>Multiple input citation, bibliographic and formats </li></ul></ul><ul><li>Apply new and existing methods to these bibliographic collections </li></ul><ul><ul><li>Bibliometric analysis </li></ul></ul><ul><ul><li>Machine learning </li></ul></ul><ul><ul><li>Statistical visualization </li></ul></ul><ul><li>Research, provide authoring tools for relevant structured data </li></ul><ul><li>First math and statistics  then any knowledge community </li></ul>
  5. 5. The Project <ul><li>Two-year effort </li></ul><ul><li>Began October 2008 </li></ul><ul><li>Joint consortium effort of: </li></ul><ul><ul><li>University of California, Berkeley </li></ul></ul><ul><ul><li>Harvard University </li></ul></ul><ul><ul><li>Stanford University </li></ul></ul><ul><ul><li>American Institute of Mathematics (AIM) </li></ul></ul><ul><li>Director: Dr. Jim Pitman </li></ul><ul><ul><li>Professor of Statistics and Mathematics, UC Berkeley </li></ul></ul><ul><li>Funded by NSF (Grant No. 0835851) </li></ul><ul><li>All software and data to be open source </li></ul>
  6. 6. Some Points for this Talk <ul><li>Four kinds of network “nodes”: </li></ul><ul><ul><li>VO Nodes – collaboration portals </li></ul></ul><ul><ul><li>Gateways – connections to existing external content </li></ul></ul><ul><ul><li>Hubs – aggregate suppliers of useful datasets </li></ul></ul><ul><ul><li>Individual dataset contributors and clients </li></ul></ul><ul><li>Data formats and models: </li></ul><ul><ul><li>BibJSON : human readable, exchange format </li></ul></ul><ul><ul><li>Ingest of various existing citation/biblio formats </li></ul></ul><ul><ul><li>RDF : “canonical” internal data model </li></ul></ul><ul><li>VO Nodes the emphasis of this talk: </li></ul><ul><ul><li>CMS: Drupal </li></ul></ul><ul><ul><li>RDF triplestore: Virtuoso </li></ul></ul><ul><ul><li>Full-text, faceted search: Solr </li></ul></ul>
  7. 7. Preview of Benefits <ul><li>Comprehensive toolset for structured data (semantic Web) conversion, use and exposure </li></ul><ul><li>Data-driven via ontologies; easily scoped, tailored </li></ul><ul><li>Naïve data formats and RDF APIs via RESTful Web services </li></ul><ul><li>Web services framework can mix-and-match: </li></ul><ul><ul><li>Standalone </li></ul></ul><ul><ul><li>Integrated with any CMS </li></ul></ul><ul><ul><li>External tools access </li></ul></ul><ul><li>Web-wide user and dataset access and permissions </li></ul><ul><li>Available as a distro of the Drupal CMS </li></ul><ul><li>Open source and extensible </li></ul>
  8. 8. conStruct SCS <ul><li>A ‘data-driven app’ (ontologies + structured data) </li></ul><ul><li>Datasets + permissions </li></ul><ul><li>Context-sensitive display templates </li></ul><ul><li>Use and exposure of linked data </li></ul><ul><li>Hosted by Drupal </li></ul>
  9. 9. II. Demonstration of a BKN Node
  10. 10. BibKN Welcome Screen
  11. 11. III. More on Design
  12. 12. Data Formats and Exchange <ul><li>Ingest standard structured and bibliographic data: </li></ul><ul><ul><li>BibTeX </li></ul></ul><ul><ul><li>Bibsonomy </li></ul></ul><ul><ul><li>RePEc </li></ul></ul><ul><ul><li>etc., etc. </li></ul></ul><ul><li>Standard ‘naïve’ data format: BibJSON </li></ul><ul><ul><li>Attribute-value pair orientation </li></ul></ul><ul><ul><li>Human readable </li></ul></ul><ul><ul><li>Easily authored and edited </li></ul></ul><ul><li>RDF as the internal, ‘canonical’ data model </li></ul><ul><ul><li>Also can be used for exchange </li></ul></ul>
  13. 13. Data Formats and Exchange
  14. 14. Four Kinds of ‘Nodes’ <ul><li>VO Nodes – collaboration portals </li></ul><ul><li>Gateways – connections to existing external content </li></ul><ul><li>Hubs – aggregate suppliers of useful datasets </li></ul><ul><li>Individual dataset contributors and clients </li></ul><ul><li> </li></ul><ul><li>The primary construct for data exchange and use is the dataset </li></ul>
  15. 15. Multiple Deployment Options
  16. 16. Illustrative BKN Network
  17. 17. The Backend Structure <ul><li>Drupal: </li></ul><ul><ul><li>User interface and theming </li></ul></ul><ul><ul><li>User and group management </li></ul></ul><ul><ul><li>Content management system </li></ul></ul><ul><ul><li>Many third-party tools and modules </li></ul></ul><ul><li>Virtuoso: </li></ul><ul><ul><li>RDF triple store </li></ul></ul><ul><ul><li>SPARQL and endpoints; linked data exposure </li></ul></ul><ul><ul><li>Some structured data conversions </li></ul></ul><ul><li>Solr: </li></ul><ul><ul><li>Full-text indexing </li></ul></ul><ul><ul><li>Faceting and aggregating (counts) </li></ul></ul><ul><ul><li>Innovative complete RDF search </li></ul></ul>
  18. 18. The Backend Structure
  19. 19. IV. Architecture and Web Services Framework
  20. 20. Overall Architecture
  21. 21. structWSF (Web services framework) <ul><li>Standard functionality: </li></ul><ul><ul><li>Data management: </li></ul></ul><ul><ul><ul><li>C reate </li></ul></ul></ul><ul><ul><ul><li>R ead </li></ul></ul></ul><ul><ul><ul><li>U pdate </li></ul></ul></ul><ul><ul><ul><li>D elete </li></ul></ul></ul><ul><ul><li>Browse and search </li></ul></ul><ul><ul><li>Import/export </li></ul></ul><ul><ul><li>Display templates </li></ul></ul><ul><li>Dataset registration w/ permissions </li></ul><ul><li>Ontology registration </li></ul><ul><li>User authorization and access (IP-based initially) </li></ul><ul><li>RESTful design </li></ul>
  22. 22. structWSF Schema
  23. 23. V. Collaboration Demonstration
  24. 24. Topology of the Collaboration Demo
  25. 25. VI. Design Benefits
  26. 26. Comprehensive Toolset <ul><li>Standard functionality: </li></ul><ul><ul><li>Data management: </li></ul></ul><ul><ul><ul><li>C reate </li></ul></ul></ul><ul><ul><ul><li>R ead </li></ul></ul></ul><ul><ul><ul><li>U pdate </li></ul></ul></ul><ul><ul><ul><li>D elete </li></ul></ul></ul><ul><ul><li>Browse and search </li></ul></ul><ul><ul><li>Import/export </li></ul></ul><ul><ul><li>Display templates </li></ul></ul><ul><li>Dataset registration w/ permissions </li></ul><ul><li>Ontology registration </li></ul><ul><li>User authorization and access (via Drupal OG) </li></ul><ul><li>Drupal modules are lightweight wrappers over structWSF </li></ul>
  27. 27. Data-driven via Ontologies <ul><li>Ontologies (OWL) guide: </li></ul><ul><ul><li>Instance records and attributes </li></ul></ul><ul><ul><li>Data relationships </li></ul></ul><ul><ul><li>Data presentation: </li></ul></ul><ul><ul><ul><li>Trees/hierarchies </li></ul></ul></ul><ul><ul><ul><li>Display templates </li></ul></ul></ul><ul><ul><li>User interface, e.g .: </li></ul></ul><ul><ul><ul><li>Autocompletion </li></ul></ul></ul><ul><ul><ul><li>Contextual dropdown list selections </li></ul></ul></ul><ul><ul><ul><li>New record entry </li></ul></ul></ul><ul><ul><ul><li>New attribute entry </li></ul></ul></ul><ul><ul><ul><li>etc. </li></ul></ul></ul><ul><li>Addition or swap out of ontologies drives generic tools </li></ul>
  28. 28. RESTful structWSF <ul><li>Independent, standalone piece </li></ul><ul><li>Naïve data formats and RDF APIs via RESTful Web services </li></ul><ul><li>Web services framework can mix-and-match: </li></ul><ul><ul><li>Standalone </li></ul></ul><ul><ul><li>Integrated with any CMS </li></ul></ul><ul><ul><li>External tools access </li></ul></ul><ul><li>Web-wide user and dataset access and permissions </li></ul><ul><li>As described </li></ul>
  29. 29. Open Source Drupal Distro <ul><li>Provided as the conStruct module </li></ul><ul><li>See conclusion </li></ul>
  30. 30. Re-cap of Benefits <ul><li>Comprehensive toolset for structured data (semantic Web) conversion, use and exposure </li></ul><ul><li>Data-driven via ontologies; easily scoped, tailored </li></ul><ul><li>Naïve data formats and RDF APIs via RESTful Web services </li></ul><ul><li>Web services framework can mix-and-match: </li></ul><ul><ul><li>Standalone </li></ul></ul><ul><ul><li>Integrated with any CMS </li></ul></ul><ul><ul><li>External tools access </li></ul></ul><ul><li>Web-wide user and dataset access and permissions </li></ul><ul><li>Available as a distro of the Drupal CMS </li></ul><ul><li>Open source and extensible </li></ul>
  31. 31. VII. conStruct and Next Plans
  32. 32. conStruct SCS <ul><li>conStruct SCS is a structured content system </li></ul><ul><li>Open source version of the BKN project that runs on Drupal </li></ul><ul><li>Drupal components: </li></ul><ul><ul><li>Drupal </li></ul></ul><ul><ul><li>conStruct module (core functionality) </li></ul></ul><ul><ul><li>structDisplay module (display templating) </li></ul></ul><ul><ul><li>Required additional modules (e.g., Organic Groups, WYSIWYG, etc.) </li></ul></ul><ul><li>Structured Dynamics: </li></ul><ul><ul><li>structWSF (Web services framework) </li></ul></ul><ul><li>Third parties: </li></ul><ul><ul><li>Virtuoso RDF triple store </li></ul></ul><ul><ul><li>Solr full-text faceted search </li></ul></ul><ul><ul><li>Smarty templating system </li></ul></ul>
  33. 33. The conStruct System
  34. 34. conStruct Distribution Options <ul><li>Initially: </li></ul><ul><ul><li>Downloads from multiple sites </li></ul></ul><ul><ul><li>Download, Install & Configuration manual </li></ul></ul><ul><li>Next option: </li></ul><ul><ul><li>Single-click Amazon EC2 AMI install </li></ul></ul><ul><li>Planned: </li></ul><ul><ul><li>Complete, packaged Drupal distro </li></ul></ul><ul><li>Hoped: </li></ul><ul><ul><li>Multiple CMS versions </li></ul></ul>
  35. 35. conStruct Plans and Schedule <ul><li>conStructSCS.com now open </li></ul><ul><ul><li>Online demo available </li></ul></ul><ul><li>OpenStructs.org now open </li></ul><ul><ul><li>Also the distribution point for open source display templates, converters and extractors </li></ul></ul><ul><li>conStruct alpha distro to be available June 30 </li></ul><ul><li>sturctWSF alpha distro to be available June 30 </li></ul><ul><li>Additional conStruct supporting modules planned on an ongoing basis </li></ul>
  36. 36. VII. Contact Info
  37. 37. Contacts & Information <ul><li>Bibliographic Knowledge Network </li></ul><ul><ul><li>Dr. Jim Pitman </li></ul></ul><ul><ul><ul><li>Director </li></ul></ul></ul><ul><ul><ul><li>[email_address] </li></ul></ul></ul><ul><ul><li>Nitin Borwankar </li></ul></ul><ul><ul><ul><li>Project Manager </li></ul></ul></ul><ul><ul><ul><li>[email_address] </li></ul></ul></ul><ul><ul><li>Web Site </li></ul></ul><ul><ul><ul><li>www.BibKN.org </li></ul></ul></ul><ul><li>Structured Dynamics </li></ul><ul><ul><li>Michael K. Bergman </li></ul></ul><ul><ul><ul><li>CEO </li></ul></ul></ul><ul><ul><ul><li>[email_address] </li></ul></ul></ul><ul><ul><ul><li>blog: www.mkbergman.com </li></ul></ul></ul><ul><ul><li>Web Sites </li></ul></ul><ul><ul><ul><li>conStructSCS.com </li></ul></ul></ul><ul><ul><ul><li>www.structureddynamics.com </li></ul></ul></ul><ul><ul><ul><li>www.umbel.org </li></ul></ul></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×