Data-driven Applications with conStruct

Michael K. Bergman Structured Dynamics LLC presented at Semantic Technologies ’09 Conference San Jose, CA June 16, 2009 “ BKN: Building Knowledge through Communities, and Communities through Knowledge”

Presentation Outline
Overview of BKN
Demonstration of a BKN Node
More on Design
Architecture and Web Services Framework
Collaboration Demonstration
Design Benefits
conStruct and Next Plans
Contact Info

I. Overview of BKN

Introduction
BibKN or BKN : the Bib liographic K nowledge N etwork
Develop tools and services for virtual organizations (“ VOs ”):
Scientific communities of varied sizes, interests
Conference groups
Departmental research groups
Students, teachers and faculty alike
Select, filter and enhance bibliographic data for each VO :
Multiple input citation, bibliographic and formats
Apply new and existing methods to these bibliographic collections
Bibliometric analysis
Machine learning
Statistical visualization
Research, provide authoring tools for relevant structured data
First math and statistics  then any knowledge community

The Project
Two-year effort
Began October 2008
Joint consortium effort of:
University of California, Berkeley
Harvard University
Stanford University
American Institute of Mathematics (AIM)
Director: Dr. Jim Pitman
Professor of Statistics and Mathematics, UC Berkeley
Funded by NSF (Grant No. 0835851)
All software and data to be open source

Some Points for this Talk
Four kinds of network “nodes”:
VO Nodes – collaboration portals
Gateways – connections to existing external content
Hubs – aggregate suppliers of useful datasets
Individual dataset contributors and clients
Data formats and models:
BibJSON : human readable, exchange format
Ingest of various existing citation/biblio formats
RDF : “canonical” internal data model
VO Nodes the emphasis of this talk:
CMS: Drupal
RDF triplestore: Virtuoso
Full-text, faceted search: Solr

Preview of Benefits
Comprehensive toolset for structured data (semantic Web) conversion, use and exposure
Data-driven via ontologies; easily scoped, tailored
Naïve data formats and RDF APIs via RESTful Web services
Web services framework can mix-and-match:
Standalone
Integrated with any CMS
External tools access
Web-wide user and dataset access and permissions
Available as a distro of the Drupal CMS
Open source and extensible

conStruct SCS
A ‘data-driven app’ (ontologies + structured data)
Datasets + permissions
Context-sensitive display templates
Use and exposure of linked data
Hosted by Drupal

II. Demonstration of a BKN Node

BibKN Welcome Screen

III. More on Design

Data Formats and Exchange
Ingest standard structured and bibliographic data:
BibTeX
Bibsonomy
RePEc
etc., etc.
Standard ‘naïve’ data format: BibJSON
Attribute-value pair orientation
Human readable
Easily authored and edited
RDF as the internal, ‘canonical’ data model
Also can be used for exchange

Data Formats and Exchange

Four Kinds of ‘Nodes’
VO Nodes – collaboration portals
Gateways – connections to existing external content
Hubs – aggregate suppliers of useful datasets
Individual dataset contributors and clients

The primary construct for data exchange and use is the dataset

Multiple Deployment Options

Illustrative BKN Network

The Backend Structure
Drupal:
User interface and theming
User and group management
Content management system
Many third-party tools and modules
Virtuoso:
RDF triple store
SPARQL and endpoints; linked data exposure
Some structured data conversions
Solr:
Full-text indexing
Faceting and aggregating (counts)
Innovative complete RDF search

The Backend Structure

IV. Architecture and Web Services Framework

Overall Architecture

structWSF (Web services framework)
Standard functionality:
Data management:
C reate
R ead
U pdate
D elete
Browse and search
Import/export
Display templates
Dataset registration w/ permissions
Ontology registration
User authorization and access (IP-based initially)
RESTful design

structWSF Schema

V. Collaboration Demonstration

Topology of the Collaboration Demo

VI. Design Benefits

Comprehensive Toolset
Standard functionality:
Data management:
C reate
R ead
U pdate
D elete
Browse and search
Import/export
Display templates
Dataset registration w/ permissions
Ontology registration
User authorization and access (via Drupal OG)
Drupal modules are lightweight wrappers over structWSF

Data-driven via Ontologies
Ontologies (OWL) guide:
Instance records and attributes
Data relationships
Data presentation:
Trees/hierarchies
Display templates
User interface, e.g .:
Autocompletion
Contextual dropdown list selections
New record entry
New attribute entry
etc.
Addition or swap out of ontologies drives generic tools

RESTful structWSF
Independent, standalone piece
Standalone
As described

Open Source Drupal Distro
Provided as the conStruct module
See conclusion

Re-cap of Benefits
Comprehensive toolset for structured data (semantic Web) conversion, use and exposure
Data-driven via ontologies; easily scoped, tailored
Standalone
Available as a distro of the Drupal CMS
Open source and extensible

VII. conStruct and Next Plans

conStruct SCS
conStruct SCS is a structured content system
Open source version of the BKN project that runs on Drupal
Drupal components:
Drupal
conStruct module (core functionality)
structDisplay module (display templating)
Required additional modules (e.g., Organic Groups, WYSIWYG, etc.)
Structured Dynamics:
structWSF (Web services framework)
Third parties:
Virtuoso RDF triple store
Solr full-text faceted search
Smarty templating system

The conStruct System

conStruct Distribution Options
Initially:
Downloads from multiple sites
Download, Install & Configuration manual
Next option:
Single-click Amazon EC2 AMI install
Planned:
Complete, packaged Drupal distro
Hoped:
Multiple CMS versions

conStruct Plans and Schedule
conStructSCS.com now open
Online demo available
OpenStructs.org now open
Also the distribution point for open source display templates, converters and extractors
conStruct alpha distro to be available June 30
sturctWSF alpha distro to be available June 30
Additional conStruct supporting modules planned on an ongoing basis

VII. Contact Info

Contacts & Information
Bibliographic Knowledge Network
Dr. Jim Pitman
Director
[email_address]
Nitin Borwankar
Project Manager
[email_address]
Web Site
www.BibKN.org
Structured Dynamics
Michael K. Bergman
CEO
[email_address]
blog: www.mkbergman.com
Web Sites
conStructSCS.com
www.structureddynamics.com
www.umbel.org

Data-driven Applications with conStruct

by Mike Bergman on Jun 21, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 1

Statistics

Data-driven Applications with conStruct — Presentation Transcript