knowIT Mapping out Informatics systems Laurent Alquier  Keith McCormick Ed Jaeger
About <ul><li>Laurent Alquier </li></ul><ul><li>Software engineer, Project lead </li></ul><ul><li>Johnson & Johnson Pharma...
Could you answer these questions ? <ul><li>Can you give us a list of  all of your applications, related servers and stakeh...
Systems knowledge
knowIT in a nutshell <ul><li>A collaborative database </li></ul><ul><ul><li>Semantic wiki </li></ul></ul><ul><li>Capture k...
Goals <ul><li>Answer recurring questions </li></ul><ul><ul><li>Subject Matter Experts  lists for Application Support </li>...
Pragmatic approach <ul><li>Bottom up knowledge management in a corporate, R&D environment </li></ul><ul><li>Search is not ...
Evolution  <ul><li>Started as disconnected files </li></ul><ul><li>Turned into a relational database </li></ul><ul><ul><li...
Collaborative database <ul><li>Flexible yet structured content management  </li></ul><ul><ul><li>Collaborative data model ...
Semantic Media Wiki <ul><li>Based on Media Wiki </li></ul><ul><ul><li>Proven platform (Wikipedia) </li></ul></ul><ul><ul><...
Semantic Annotations <ul><li>Tags with meaning </li></ul><ul><li>Syntax </li></ul><ul><ul><li>Triple: Page -> Property -> ...
Relationships <ul><li>Defined as links to other pages </li></ul><ul><ul><li>Enhanced with semantic properties </li></ul></...
Wiki ? What wiki ? <ul><li>Focus on content , not technology </li></ul><ul><li>Occasional users less intimidated when wiki...
Content Migration <ul><li>From relational tables to Categories and Pages </li></ul><ul><ul><li>Review data model, drop unn...
Queries <ul><li>Visualize structure of content </li></ul><ul><ul><li>Ad-hoc reports </li></ul></ul><ul><ul><li>Interactive...
Enhanced Search <ul><li>Default search replaced by Sphinx Search extension </li></ul><ul><li>Faceted search  </li></ul><ul...
Input flexibility - Data capture <ul><li>Import  </li></ul><ul><ul><li>Manually using Forms </li></ul></ul><ul><ul><li>Rem...
Output flexibility - Data integration <ul><li>Export </li></ul><ul><ul><li>HTML, PDF, CSV, XML, Email, Maps (Yahoo, Google...
Familiar look and feel <ul><li>Consistent with other intranet sites, familiar interface </li></ul><ul><ul><li>Integration ...
Make basic tasks explicit <ul><li>Search, Explore, Contribute </li></ul><ul><ul><li>On main page and on side bar </li></ul...
Consistent navigation for every pages <ul><li>‘ Table of Content’ links  </li></ul><ul><ul><li>Browse content </li></ul></...
Reduce clutter <ul><li>Advanced tasks moved to the bottom of pages </li></ul><ul><li>Maintenance tasks </li></ul><ul><li>U...
UI Simplification – Special Pages <ul><li>Custom made administrative tasks page </li></ul>
UI Simplification – Recent changes <ul><li>Simplified Recent changes using Dynamic Page List extension </li></ul>
UI Customization – Category:Location <ul><li>Customization of categories according to page type </li></ul><ul><li>Maps for...
UI Customization – Category:Events
Status - Usage <ul><li>After a year  </li></ul><ul><ul><li>2900 pages of content (4600 pages total ) </li></ul></ul><ul><u...
Status - Content <ul><ul><li>Data imported from old system except for Articles and Persons </li></ul></ul><ul><ul><li>Buil...
Features <ul><li>KnowIT currently includes:  </li></ul><ul><ul><li>An  IT systems portfolio management  (inventory)  </li>...
Observations from day to day use <ul><li>SMW is structured yet flexible </li></ul><ul><ul><li>Allows for exceptions, chang...
Acknowledgements <ul><li>We would like to thank current and past contributors for their patience, ideas and support : </li...
Resources <ul><li>Semantic MediaWiki </li></ul><ul><ul><li>http://semantic-mediawiki.org   </li></ul></ul><ul><li>Referata...
Upcoming SlideShare
Loading in...5
×

KnowIT, semantic informatics knowledge base

1,893

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,893
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Under the hood
  • KnowIT, semantic informatics knowledge base

    1. 1. knowIT Mapping out Informatics systems Laurent Alquier Keith McCormick Ed Jaeger
    2. 2. About <ul><li>Laurent Alquier </li></ul><ul><li>Software engineer, Project lead </li></ul><ul><li>Johnson & Johnson Pharmaceutical Research & Development, L.L.C </li></ul><ul><li>[email_address] </li></ul>
    3. 3. Could you answer these questions ? <ul><li>Can you give us a list of all of your applications, related servers and stakeholders and send us an update every six months ? </li></ul><ul><li>All Linux servers need to be patched this weekend. Can you send an outage announcement with a list of affected applications by tomorrow ? </li></ul><ul><li>Is this server still in use ? Can we retire it ? </li></ul><ul><li>What is the meaning of DRU ? </li></ul><ul><li>(Based on real questions) </li></ul>
    4. 4. Systems knowledge
    5. 5. knowIT in a nutshell <ul><li>A collaborative database </li></ul><ul><ul><li>Semantic wiki </li></ul></ul><ul><li>Capture knowledge about informatics systems </li></ul><ul><ul><li>Information Systems components </li></ul></ul><ul><ul><ul><li>Applications, Servers, Data sources, plugins </li></ul></ul></ul><ul><ul><li>Map relationships between components </li></ul></ul><ul><ul><li>Capture Business context around them </li></ul></ul><ul><ul><ul><li>Organizations, Companies, Locations </li></ul></ul></ul><ul><ul><li>Document known issues, procedures, processes </li></ul></ul>
    6. 6. Goals <ul><li>Answer recurring questions </li></ul><ul><ul><li>Subject Matter Experts lists for Application Support </li></ul></ul><ul><ul><li>Application / License rationalization </li></ul></ul><ul><ul><li>Outage communications </li></ul></ul><ul><li>Increase knowledge retention </li></ul><ul><ul><li>Many ways to contribute </li></ul></ul><ul><li>Facilitate “Transfer In / Transfer Out” </li></ul><ul><ul><li>Capture knowledge from experts before they leave </li></ul></ul><ul><ul><li>Facilitate learning for new resources </li></ul></ul><ul><li>Enable self service </li></ul><ul><ul><li>Many ways to search and explore </li></ul></ul>
    7. 7. Pragmatic approach <ul><li>Bottom up knowledge management in a corporate, R&D environment </li></ul><ul><li>Search is not enough </li></ul><ul><ul><li>Complementary to a document library with search index </li></ul></ul><ul><ul><li>Capture details about individual components of systems </li></ul></ul><ul><ul><li>Rely on queries as much as search </li></ul></ul><ul><li>Change will happen </li></ul><ul><ul><li>Plan for future integration and migration from the start </li></ul></ul><ul><ul><li>Import content from several sources </li></ul></ul><ul><ul><li>Export content to several formats </li></ul></ul><ul><li>“ Know your content, respect your users. “ – E.Tufte </li></ul><ul><ul><li>Accept incomplete content </li></ul></ul><ul><ul><li>Evolve the data model as necessary </li></ul></ul><ul><ul><li>Let real data, use cases drive requirements </li></ul></ul><ul><li>Above all, remain flexible </li></ul>
    8. 8. Evolution <ul><li>Started as disconnected files </li></ul><ul><li>Turned into a relational database </li></ul><ul><ul><li>Rigid design </li></ul></ul><ul><ul><li>Lack of collaboration tools </li></ul></ul><ul><li>Solution: Collaborative Database using a Semantic Wiki </li></ul><ul><ul><li>Collaborative features and flexibility of wiki </li></ul></ul><ul><ul><li>Structure from Semantic annotations </li></ul></ul>
    9. 9. Collaborative database <ul><li>Flexible yet structured content management </li></ul><ul><ul><li>Collaborative data model </li></ul></ul><ul><ul><li>Discussions, comments, community editing </li></ul></ul><ul><li>Knowledge management tools </li></ul><ul><ul><li>Redirections, wanted pages </li></ul></ul><ul><ul><li>Automated maintenance tasks </li></ul></ul><ul><ul><ul><li>Background jobs to enforce consistency and updates </li></ul></ul></ul><ul><ul><li>Monitoring tools, change tracking </li></ul></ul><ul><li>Modular and extensible design </li></ul><ul><ul><li>Templates </li></ul></ul><ul><ul><li>Open source components </li></ul></ul>
    10. 10. Semantic Media Wiki <ul><li>Based on Media Wiki </li></ul><ul><ul><li>Proven platform (Wikipedia) </li></ul></ul><ul><ul><li>Redirect, wanted pages, templates, API, bots </li></ul></ul><ul><ul><li>Active development, commercial support </li></ul></ul><ul><ul><li>No licensing fee (PHP, Mysql) </li></ul></ul><ul><li>Structure from Semantic annotations </li></ul><ul><ul><li>Inline annotations </li></ul></ul><ul><ul><li>Supports forms and direct annotations </li></ul></ul><ul><ul><li>Map complex relationships between objects </li></ul></ul><ul><ul><li>Allow both Search and Queries </li></ul></ul><ul><ul><li>Multiple input / output formats </li></ul></ul><ul><ul><li>Compatible with Semantic Web integration </li></ul></ul><ul><ul><ul><li>Semantic Web in a bottle </li></ul></ul></ul>
    11. 11. Semantic Annotations <ul><li>Tags with meaning </li></ul><ul><li>Syntax </li></ul><ul><ul><li>Triple: Page -> Property -> Value </li></ul></ul><ul><ul><ul><li>[[Has support contact::Help Desk]] </li></ul></ul></ul><ul><li>Data types </li></ul><ul><ul><li>Page, URL, Date, String, Text, Number, Geo-location </li></ul></ul><ul><ul><li>Custom units for Number </li></ul></ul><ul><li>Browse properties </li></ul><ul><ul><li>Summary of all properties for a page </li></ul></ul>
    12. 12. Relationships <ul><li>Defined as links to other pages </li></ul><ul><ul><li>Enhanced with semantic properties </li></ul></ul><ul><li>Tracking lists of things is not enough </li></ul><ul><ul><li>Knowledge comes from understanding relationships </li></ul></ul><ul><li>SMW assisted Ontology design </li></ul>
    13. 13. Wiki ? What wiki ? <ul><li>Focus on content , not technology </li></ul><ul><li>Occasional users less intimidated when wiki tools are not visible </li></ul><ul><ul><li>But keep wiki tools available to advanced users </li></ul></ul><ul><li>Use forms to standardize data capture </li></ul><ul><ul><li>Make semantic annotations invisible using forms and templates </li></ul></ul><ul><ul><li>Enforce (some) naming conventions </li></ul></ul><ul><ul><ul><li>Auto-completion </li></ul></ul></ul><ul><ul><ul><li>Automated page names </li></ul></ul></ul><ul><li>Be ready to provide help with difficult tasks </li></ul><ul><ul><li>Provide guidance and training </li></ul></ul><ul><ul><li>Front loading wiki with data users care about </li></ul></ul>
    14. 14. Content Migration <ul><li>From relational tables to Categories and Pages </li></ul><ul><ul><li>Review data model, drop unnecessary attributes </li></ul></ul><ul><ul><li>Create forms, templates, properties in Semantic MediaWiki </li></ul></ul><ul><ul><li>One category per page </li></ul></ul><ul><ul><ul><li>Separate ‘semantic categories’ from ‘supporting categories’ </li></ul></ul></ul><ul><li>Extract old content into tabular form </li></ul><ul><li>Review, clean up, correct </li></ul><ul><ul><li>Unique titles (Disambiguation) </li></ul></ul><ul><ul><li>Special characters in titles </li></ul></ul><ul><li>Load pages in bulk </li></ul><ul><ul><li>using PHP API (bulkinsert.php) </li></ul></ul><ul><li>Consider specialized import forms if content needs detailed review </li></ul><ul><ul><li>Example: Support articles </li></ul></ul>
    15. 15. Queries <ul><li>Visualize structure of content </li></ul><ul><ul><li>Ad-hoc reports </li></ul></ul><ul><ul><li>Interactive queries ( Exhibit ) </li></ul></ul><ul><ul><li>Automate system configuration pages </li></ul></ul><ul><ul><li>Architectural layers </li></ul></ul><ul><ul><ul><li>Business, Functional, Process, Data, Applications, Physical </li></ul></ul></ul><ul><ul><li>Network diagrams </li></ul></ul><ul><li>Concepts </li></ul><ul><ul><li>Saved queries, dynamic categories </li></ul></ul>
    16. 16. Enhanced Search <ul><li>Default search replaced by Sphinx Search extension </li></ul><ul><li>Faceted search </li></ul><ul><ul><li>Drill down by properties </li></ul></ul><ul><ul><li>Search results grouped by Category </li></ul></ul><ul><li>Semantic search </li></ul><ul><ul><li>Semantic summary instead of excerpt </li></ul></ul><ul><ul><ul><li>Customized by Category </li></ul></ul></ul><ul><ul><li>Annotations used to improve results </li></ul></ul><ul><ul><ul><li>Aliases, keywords </li></ul></ul></ul><ul><ul><ul><li>Related terms </li></ul></ul></ul><ul><ul><ul><li>Selection of default category </li></ul></ul></ul><ul><li>Feedback option </li></ul><ul><ul><li>Ask a question </li></ul></ul>
    17. 17. Input flexibility - Data capture <ul><li>Import </li></ul><ul><ul><li>Manually using Forms </li></ul></ul><ul><ul><li>Remote CSV files, databases, LDAP </li></ul></ul><ul><ul><li>FOAF format to retrieve and provide vocabularies </li></ul></ul><ul><ul><li>OWL DL ontologies can be imported </li></ul></ul><ul><ul><ul><li>Explicit statements only – no support for reasoning </li></ul></ul></ul><ul><li>Query remote sources </li></ul><ul><ul><li>Linked data import </li></ul></ul><ul><ul><ul><li>SMW+ can enrich page annotations with queries across multiple sources </li></ul></ul></ul><ul><ul><ul><li>Supports OpenCalais, DBPedia, RSS feeds </li></ul></ul></ul>
    18. 18. Output flexibility - Data integration <ul><li>Export </li></ul><ul><ul><li>HTML, PDF, CSV, XML, Email, Maps (Yahoo, Google, Open Layers), Timeline (Simile), Google graphs, vCard, iCalendar </li></ul></ul><ul><li>Machine readable </li></ul><ul><ul><li>Default RSS feed replaced by #ask query for recent content </li></ul></ul><ul><ul><li>RDF view for each page </li></ul></ul><ul><ul><li>RDFa, CSV index, FOAF files, Web Services (SMW+) </li></ul></ul><ul><ul><li>Ontology and content export </li></ul></ul><ul><ul><ul><li>RDF dumps / SPARQL endpoint available </li></ul></ul></ul><ul><li>Follows Linked Data principles </li></ul><ul><ul><li>One page per entity </li></ul></ul><ul><ul><li>One HTTP URI for each entity </li></ul></ul><ul><ul><li>RDF information available from each page </li></ul></ul><ul><ul><li>RDF statements are browsable </li></ul></ul>
    19. 19. Familiar look and feel <ul><li>Consistent with other intranet sites, familiar interface </li></ul><ul><ul><li>Integration with MS SharePoint look and feel using RILPoint theme </li></ul></ul><ul><ul><li>Login using global directory </li></ul></ul>
    20. 20. Make basic tasks explicit <ul><li>Search, Explore, Contribute </li></ul><ul><ul><li>On main page and on side bar </li></ul></ul>
    21. 21. Consistent navigation for every pages <ul><li>‘ Table of Content’ links </li></ul><ul><ul><li>Browse content </li></ul></ul><ul><ul><ul><li>Using Semantic Drilldown </li></ul></ul></ul><ul><ul><li>Categories </li></ul></ul><ul><ul><ul><li>Using Nice Categories List for recursive tree view </li></ul></ul></ul><ul><ul><li>Topic </li></ul></ul><ul><ul><ul><li>#ask query for pages with Topic defined as a property </li></ul></ul></ul><ul><ul><li>A-Z index / Glossary </li></ul></ul><ul><ul><ul><li>Using a mix of Table of Content template, #urlget and #ask queries </li></ul></ul></ul><ul><li>Single link to add New content </li></ul><ul><ul><li>With list of forms available </li></ul></ul>
    22. 22. Reduce clutter <ul><li>Advanced tasks moved to the bottom of pages </li></ul><ul><li>Maintenance tasks </li></ul><ul><li>Upload file </li></ul><ul><li>Page tools </li></ul><ul><li>RDF link </li></ul><ul><li>Browse properties </li></ul>
    23. 23. UI Simplification – Special Pages <ul><li>Custom made administrative tasks page </li></ul>
    24. 24. UI Simplification – Recent changes <ul><li>Simplified Recent changes using Dynamic Page List extension </li></ul>
    25. 25. UI Customization – Category:Location <ul><li>Customization of categories according to page type </li></ul><ul><li>Maps for locations </li></ul><ul><li>Timelines for events </li></ul><ul><li>A-Z index for people </li></ul>
    26. 26. UI Customization – Category:Events
    27. 27. Status - Usage <ul><li>After a year </li></ul><ul><ul><li>2900 pages of content (4600 pages total ) </li></ul></ul><ul><ul><li>31 registered users ( 5 active contributors ) </li></ul></ul><ul><ul><li>Between 15 and 75 updates a day </li></ul></ul><ul><ul><li>130 unique visitors/month </li></ul></ul><ul><ul><li>400 visits / 600 searches a month </li></ul></ul><ul><li>Entering phase of growing interest </li></ul>
    28. 28. Status - Content <ul><ul><li>Data imported from old system except for Articles and Persons </li></ul></ul><ul><ul><li>Built an ontology of IT systems components </li></ul></ul><ul><li>550+ Applications, 90+ Databases and 280+ Servers portfolio </li></ul><ul><ul><ul><li>mostly RED systems at this point </li></ul></ul></ul><ul><li>145 data sources </li></ul><ul><ul><ul><li>Semi-automated generation of Data landscape </li></ul></ul></ul><ul><li>A Glossary of 950+ acronyms and definitions </li></ul><ul><ul><ul><li>imported from multiple sources within J&J and outside </li></ul></ul></ul><ul><li>About 170 support articles, how-to and FAQs </li></ul><ul><ul><ul><li>Another 400 old articles pending review </li></ul></ul></ul><ul><li>340+ Organizations </li></ul><ul><ul><ul><li>Including 44 J&J Operating Companies </li></ul></ul></ul><ul><ul><ul><li>Google Maps of J&J PRD sites </li></ul></ul></ul>
    29. 29. Features <ul><li>KnowIT currently includes: </li></ul><ul><ul><li>An IT systems portfolio management (inventory) </li></ul></ul><ul><ul><li>A Configuration management tool for these systems (components and relationships) </li></ul></ul><ul><ul><li>A Communication component (calendar / timeline of announcements, outages and training sessions) </li></ul></ul><ul><ul><li>A Question / feedback list (similar to WikiAnswers) </li></ul></ul><ul><ul><li>A Logging mechanism (to track events, outages) </li></ul></ul><ul><ul><li>A Service Account Password expiration management (with notification by RSS and eMail) </li></ul></ul><ul><ul><li>Semantic / faceted search results </li></ul></ul><ul><ul><li>Dynamic maps of known locations (with built-in form to driving directions) </li></ul></ul><ul><ul><li>A Self service help system (knowledge base of solutions) </li></ul></ul><ul><ul><li>And an Advanced glossary (terms organized by domains, with synonyms, related terms, etc ) </li></ul></ul><ul><li>Future directions </li></ul><ul><ul><li>Advanced bulk manipulations </li></ul></ul><ul><ul><li>Dynamic visualizations of relationships network </li></ul></ul><ul><ul><li>Automated annotations using internal and external sources </li></ul></ul><ul><ul><li>Improved Semantic search </li></ul></ul>
    30. 30. Observations from day to day use <ul><li>SMW is structured yet flexible </li></ul><ul><ul><li>Allows for exceptions, changes as well as standardization </li></ul></ul><ul><li>SMW doesn’t get in the way </li></ul><ul><ul><li>New content can be added, edited very quickly </li></ul></ul><ul><li>Remember to monitor response time of page edits, search </li></ul><ul><ul><li>Use PHP cache, optimization strategies to keep wiki as fast as possible </li></ul></ul><ul><li>Keep a single structure of ‘semantic categories’ </li></ul><ul><ul><li>Separate from other categories </li></ul></ul><ul><ul><li>Use semantic properties for complex categorizations of pages </li></ul></ul><ul><li>Keep realistic expectations </li></ul><ul><ul><li>A long way to go before shared ownership and fully documented systems </li></ul></ul>
    31. 31. Acknowledgements <ul><li>We would like to thank current and past contributors for their patience, ideas and support : </li></ul><ul><ul><li>Jim Gainor </li></ul></ul><ul><ul><li>Brian Wegner </li></ul></ul><ul><ul><li>Deborah Yates </li></ul></ul><ul><ul><li>David Epstein </li></ul></ul><ul><ul><li>John Baum </li></ul></ul><ul><ul><li>Lisa Valetta </li></ul></ul><ul><ul><li>Dimitris Agrafiotis </li></ul></ul><ul><ul><li>Mario Dolbec </li></ul></ul><ul><ul><li>Brian Johnson </li></ul></ul><ul><ul><li>Emmanouil Skoufos. </li></ul></ul>
    32. 32. Resources <ul><li>Semantic MediaWiki </li></ul><ul><ul><li>http://semantic-mediawiki.org </li></ul></ul><ul><li>Referata tips for SMW </li></ul><ul><ul><li>http://smw.referata.com/wiki/Special:BrowseData/Tips </li></ul></ul><ul><li>Wiki Patterns </li></ul><ul><ul><li>http://www.wikipatterns.com/display/wikipatterns/Wikipatterns </li></ul></ul><ul><li>Sphinx search extension </li></ul><ul><ul><li>http://www.mediawiki.org/wiki/Extension:SphinxSearch </li></ul></ul><ul><li>RILPoint – SharePoint theme for MediaWiki </li></ul><ul><ul><li>http://www.rilnet.com/en/rilpoint-sharepoint-look-alike-drupal-and-mediawiki-skin </li></ul></ul><ul><li>Gruff – Triple store browser for AlleroGraph (Relationships graph) </li></ul><ul><ul><li>http://www.franz.com/agraph/gruff/ </li></ul></ul><ul><li>Cytoscape – Network graph </li></ul><ul><ul><li>http://www.cytoscape.org/ </li></ul></ul>
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×