Successfully reported this slideshow.

Evolution: It's a process

795 views

Published on

Afternoon keynote given at the Web 3.0 Event in New York City, May 20, 2009

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

Evolution: It's a process

  1. 1. Evolution: It’s a process Christine Connors Among other things: librarian, information scientist, semantic web advocate and Global Director, Semantic Technology Solutions, Dow Jones & Company Web 3.0, New York, NY, May 20th, 2009
  2. 2. What is the Semantic Web? ✤ A universal medium for exchanging information that can be processed electronically and still have meaning and relevance ✤ It provides a common, standardized framework that allows data to be shared and reused across applications, enterprises, and community boundaries. Why do we care about it for our solutions? ✤ We need to provide import and export support for the Semantic Web to enable easier data exchange ✤ Greater interoperability means better standardization and integration into Web based applications – more customers can use it!
  3. 3. Challenges of the Semantic Web ✤ Overcoming prior organizational “bad experiences” with integration, MDM, KM, metadata, taxonomies and related projects ✤ What vs. How ✤ Identify and prioritize solutions ✤ Do the heavy lifting to reduce complexity for our users ✤ Usability & interaction design ✤ Determining ROI/ROE ✤ Trust & Security ✤ Determining market strategy 3
  4. 4. The Myths of the Semantic Web ✤ There will be a handful of “killer apps” to replace Web2.0 giants ✤ The current web will be replaced by the semantic web ✤ Everything will have to be tagged ✤ It will be expensive to migrate everything ✤ We will experience instant gratification ✤ It’s hard to get started 4
  5. 5. Battlestar Galactica Science Fiction http://www.scifi.com/battlestar/video/widget.php http://en.battlestarwiki.org/wiki/Hera_Agathon
  6. 6. Astrolabes Man, machine, and data http://astrolabes.org/mariner.htm http://en.wikipedia.org/wiki/Mariner's_astrolabe
  7. 7. BBC MusicBeta Data from users of MusicBrainz and Wikipedia, with BBC editorial oversight. http://www.bbc.co.uk/music/
  8. 8. Text Predicate Subject Object Two views of the semantic web Machine learning, natural language processing, artificial intelligence and linked data Images from Wikipedia
  9. 9. Editorial Content Interfaces Monitoring & Alerting Information Providers Data Data Capture Normalizer Normalization Coding Quality Distribution Capture Control Manual Coding Entity Rules-based Expansion/ Queue Categorizer Extraction Coding Validation Dow Jones Intelligent Indexing Metadata Management Manual Coding Software Interface Hybrid Solution Humans build the architecture-hardware, software AND data; machines process efficiently www.factiva.com
  10. 10. http://www.flickr.com/photos/blmurch/465623933/
  11. 11. http://www.flickr.com/photos/prettydaisies/869136465/
  12. 12. http://www.flickr.com/photos/exlibris/2383688387/
  13. 13. http://www.flickr.com/photos/yourpaldave/2268593096/
  14. 14. http://www.flickr.com/photos/ragesoss/133011158/
  15. 15. The Continuum Thesaurus Ambiguity Control Folksonomy Synonym Ring Synonym Control Hierarchical Relationships Personalized Labels Synonym Associative Relationships Control Scope Note (Equivalency) (BT, NT, RT, USE, SeeAlso) Less Complexity More Taxonomy Ontology List Ambiguity Control Ambiguity Control Ambiguity Synonym Control Synonym Control Control Hierarchical Relationships Hierarchical Relationships (BT, NT) Associative Relationships Classes Properties Localization Annotation Reasoning “NOT” See NISO Z39.19-2005
  16. 16. The Continuum We are building more complex and powerful data architectures; all types are available for use on the semantic web
  17. 17. Ontology Thesaurus Taxonomy Power Synonym Ring List Folksonomy Complexity The Continuum We are building more complex and powerful data architectures; all types are available for use on the semantic web
  18. 18. Andorra Austria Belgium Denmark Finland France Germany Hungary Ireland Italy Liechtenstein Monaco Netherlands Norway Portugal Spain Sweden Switzerland United Kingdom
  19. 19. Andorra Austria Belgium Denmark Finland France Germany Name: Hungary Address: Ireland City: Italy State/Province: Liechtenstein Country: Monaco Zip/Postal Code: Netherlands Norway Portugal Spain Sweden Switzerland United Kingdom
  20. 20. Andorra Austria Belgium Denmark Finland France Germany Name: Hungary Address: Ireland City: Italy Precision  State/Province: Liechtenstein Country: Monaco Zip/Postal Code: Netherlands Norway Portugal Spain Sweden Switzerland United Kingdom
  21. 21. United Kingdom Synonym: UK Synonym: United Kingdom of Great Britain and Northern Ireland
  22. 22. United Kingdom Synonym: UK Synonym: United Kingdom of Great Britain and Northern Ireland Behind the scenes in search
  23. 23. United Kingdom Synonym: UK Synonym: United Kingdom of Great Britain and Northern Ireland Behind the scenes in search Recall 
  24. 24. Europe NT ... United Kingdom NT England Scotland Wales Northern Ireland See http://www.nlsearch.com/rssearch.php
  25. 25. Europe NT ... United Kingdom Advanced Search NT England Scotland Wales Northern Ireland See http://www.nlsearch.com/rssearch.php
  26. 26. Europe NT Better ... Recall United Kingdom Advanced Search NT  England Scotland Better Wales Precision Northern Ireland See http://www.nlsearch.com/rssearch.php
  27. 27. Europe NT ... United Kingdom NT England Scotland Wales Northern Ireland See www.endeca.com or www.newssift.com
  28. 28. Europe England NT BT ... Britain United Kingdom Great Britain NT United Kingdom England BT Scotland European Union Wales Group of Eight Northern Ireland United Nations Security Council NATO See www.endeca.com or www.newssift.com
  29. 29. Europe England NT BT ... Britain United Kingdom Great Britain NT United Kingdom England BT Scotland European Union Wales Group of Eight Northern Ireland United Nations Security Council NATO Faceted or Parametric Search; Guided Navigation See www.endeca.com or www.newssift.com
  30. 30. Europe NT United Kingdom Scope Note Situated in north-west Europe, the island nation was formed January 1, 1801. Use For UK Use For United Kingdom of Great Britain and Northern Ireland See Also Great Britain See Also Britain See Also British Isles NT England Scotland Wales Northern Ireland
  31. 31. Europe NT United Kingdom Scope Note Situated in north-west Europe, the island nation was formed January 1, 1801. Categorization Use For UK Classification Use For United Kingdom of Search Great Britain and Northern Ireland Advanced Search See Also Great Britain Rules-based Coding See Also Britain See Also British Isles *Precision ? Recall ? NT England Scotland Wales Northern Ireland
  32. 32. Region 1 Region 2 100 70 75 52.5 50 35 25 17.5 0 0 2007 2008 2009 2010
  33. 33. NT England Britain BT NT NT BT BT Wales Great Britain NT NT BT Scotland BT United NT Northern Kingdom BT Ireland
  34. 34. NT England Britain BT God and my right NT NT BT BT Wales motto Great Britain NT NT BT Scotland BT flag United NT Northern God Save the Queen Kingdom BT Ireland anthem official English language capital currency legislature London pound sterling Parliament
  35. 35. OpenCyc Large ontology based on the Cyc Knowledge Base http://sw.opencyc.org/concept/Mx4rvViRhJwpEbGdrcN5Y29ycA
  36. 36. DBpedia A sizable ontology derived from data in Wikipedia http://dbpedia.org/page/United_kingdom http://wiki.dbpedia.org/Datasets
  37. 37. Umbel Subjects Concept Explorer http://umbel.zitgist.com/explorer.php?concept=http%3A%2F%2Fumbel.org%2Fumbel%2Fsc %2FUnitedKingdomOfGreatBritainAndNorthernIreland
  38. 38. Richard Cyganiak, available from Richard Cyganiak and Chris Bizer
  39. 39. As of March 2008 Richard Cyganiak, available from Richard Cyganiak and Chris Bizer
  40. 40. As of March 2008 Richard Cyganiak, available from Richard Cyganiak and Chris Bizer
  41. 41. As of March 2008 Richard Cyganiak, available from Richard Cyganiak and Chris Bizer
  42. 42. Sindice Index to linked data: books, people, places, news, statistics, events, business, music ... http://sindice.com/map
  43. 43. http://dbpedia.org/page/Dow_Jones_Industrial_Average
  44. 44. Semantic Web Layer Cake Key components; time left to influence - publish your use cases http://www.w3.org/2007/03/layercake.png 33
  45. 45. Capabilities ✤ Business development - market analysis, use cases ✤ Technical development - servers, apps, web ✤ Information architects ✤ Information scientists - define, organize, link ✤ User interface and interaction designers - user studies, structural design
  46. 46. Metadata Management: A commitment to process
  47. 47. Metadata Management: A commitment to process Assess Design Build Maintain Business Goals Audience Entity Extraction Continuous Work- Segmentation & (machine and/or in-progress Content Definition human) Engage end-users IT Facet Analysis Content Tagging (query log Rules (machine analysis, focus Metadata Schema Information and/or human) groups, Architecture folksonomy) Taxonomy Controlled Editorial Vocabulary or Governance Standards & Best Guidelines & Knowledge Base Process Practices Workflow Construction & Mapping Users
  48. 48. Why do we care? Business Perspective ✤ Embed ability to manipulate data rather than expend effort scraping it back out ✤ Re-purpose data rather than re-create it ✤ Improve product development with a global business vocabulary that feeds right into downstream applications such as portals, reporting programs and CRMs ✤ Improved findability ✤ Improve analytical capabilities ✤ Increase online revenue and improve your customers’ online experience by cross- referencing industry classification codes and brand names ✤ Compliance ✤ Increase delivery channels for data and services 36
  49. 49. Information Overload Relevancy Overload What’s important to me right now Getting Past Relevancy Overload The more precise the concept’s URI, the more precise the results
  50. 50. Thank you Christine.Connors@dowjones.com FOAF: http://www.synapticacentral.com/foafs/christineconnors-foaf.rdf Nick: CJMConnors at Twitter, Slideshare, LinkedIn, Identi.ca et al SynapticaCentral.com CJMConnors.com

×