Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Content Management, Metadata and Semantic Web


Published on

Keynote talk at: NetObjectDays, Erfurt, Germany, September 11, 2001

  • Slides 57-58 shows a semantic Web approach to iTV (interactive TV). Essentially metadata is extracted from video content (transcript, encoding, Close captioning), semantically annotated using ontologies (see related patent on Semantic Web search [1] or Internet Computing article [2]) and embedded back into video, enabling set-top box app developers (see VideoAnywhere: [3]) to provide consumers ability to interact through metadata (see next slide).

    [1] (filed 2000/awarded 2001)
    [2] (2002)
    [3] (1998-1999)
    Are you sure you want to  Yes  No
    Your message goes here

Content Management, Metadata and Semantic Web

  1. 1. Content Management, Metadata & Semantic Web Keynote Address Net.ObjectDAYS 2001, Erfurt, Germany, September 11, 2001 Amit Sheth CTO/SrVP, Voquette ( [formerly Founder/CEO, Taalee,] Director, Large Scale Distributed Information Systems Lab, University Of Georgia ( [email_address] Metadata Extraction is a patented pending technology of Taalee, Inc. Semantic Engine and WorldModel are trademarks of Taalee. Inc.
  2. 2. Agenda <ul><li>What is Traditional Content Management </li></ul><ul><li>New Content Management Challenges faced by Enterprises </li></ul><ul><ul><li>Semantic Content Management </li></ul></ul><ul><li>Metadata </li></ul><ul><ul><li>Metadata Descriptions and Standards </li></ul></ul><ul><ul><li>(Automated) Metadata Creation/Extraction/Tagging </li></ul></ul><ul><ul><li>Metadata Usage/Applications </li></ul></ul><ul><li>Semantics (and Semantic Web) </li></ul><ul><ul><li>Current and Future </li></ul></ul>
  3. 3. Traditional Content Management: Core Objectives and Features <ul><li>Primary Objective: Effectively create, manage and publish internal content, with </li></ul><ul><li>Existing content creation applications (MS-Office, Notes) and provide some new capabilities (Speech to text) </li></ul><ul><li>(Basic, Syntactic) metadata </li></ul><ul><li>Workflow or lifecycle support (from author to Web publication or distribution) </li></ul><ul><li>Versioning and Rollback </li></ul><ul><li>(Keyword-based/Syntactical) Search and Personalization </li></ul><ul><li>Internal Distribution </li></ul><ul><li>Web publishing </li></ul>Content Creation and Edition Content Management Content Personalization and Services Content Delivery
  4. 4. Technology/Product Provider Landscape <ul><li>Traditional Content Management Companies </li></ul><ul><ul><li>Interwoven, Vignette, Broadvision, Enprise, Documentum, Open Market </li></ul></ul><ul><li>Three of several upcoming companies focusing on metadata, semantics and/or semantic web </li></ul><ul><ul><li>Applied Semantics, Voquette (Taalee), Ontoprise </li></ul></ul><ul><ul><li>See for more </li></ul></ul>
  5. 5. Enterprise Content Management – sample user requirements (from a large Financial Svcs Company) <ul><li>“ If a new bond comes into inventory, then we should get a message, an alert...and be able to refine to say that I only have California, Oregon and Washington clients ....&quot; </li></ul><ul><li>“ In the month of July, I received 95 e-mails from my subscriptions. These e-mails included 61 that had 143 attachments that had 67 more attachments. In total therefore, I received almost 400 documents including 5 different types (HTML,PDF, Word, Rich Media, …). Even with this volume, I had subscribed to only 10 categories in the Equities area. There are a total of 26 Equity Subscription areas and a total of 166 categories to which a user can subscribe across all Product Areas.” </li></ul>Professional users of a traditional Content Management Product/Solution
  6. 6. Enterprise Content Management – sample user requirements (from a large Financial Svcs Company) <ul><li>The real question is, &quot; Which sales ideas may have significant relevance to my book of business ?&quot; For example, an earnings warning on an equity rated Hold or Lower and not owned by any of my clients may not be of high relevance to me. Ideally, a relevance analysis would: </li></ul><ul><ul><li>Greatly reduce the volume of Product Area Ideas sent to every FA, hopefully to perhaps 10% to 20% or less of today's volume with ideas that are potentially actionable for that FA and his/her client </li></ul></ul><ul><ul><li>Result in FAs reading and evaluating the Product Area Ideas, taking appropriate actions , and generating sales because the Product Area Ideas would be relevant </li></ul></ul><ul><ul><li>Result in customer satisfaction because clients would understand FAs are paying attention to their needs and developing focused ideas </li></ul></ul>Professional users of a traditional Content Management Product/Solution
  7. 7. Enterprise Content Management – sample product requirements (from a large Financial Svcs Company) <ul><li>“ Content generation is a more complex and probably costly problem to solve ... we reportedly create about 9 million messages a month for field delivery. On average, this would mean 1,000 messages per month per ‘ big user’ or perhaps only 500 to 600 per ‘ little user’ .…I strongly believe an analysis is in order of the nature and necessity of generated content , the establishment of content generation standards , the movement towards development and implementation of a relevance engine, … “ </li></ul>Director (Product Management) of a large company that uses a leading Content Management Product
  8. 8. New Enterprise Content Management Challenges <ul><li>More variety and complexity </li></ul><ul><ul><li>More formats (MPEG, PDF, MS Office, WM, Real, AVI, etc) </li></ul></ul><ul><ul><li>More types (Docs, Images -> Audio, Video, Variety of text-structured, unstructured) </li></ul></ul><ul><ul><li>More sources (internal, extranet, internet, feeds) </li></ul></ul><ul><li>Information Overload </li></ul><ul><ul><li>Too much data, precious little information (Relevance) </li></ul></ul><ul><li>Creating Value from Content </li></ul><ul><ul><li>How to Distribute the right content to the right people as needed? (Personalization -- book of business) </li></ul></ul><ul><ul><li>Customized delivery for different consumption options (mobile/desktop, devices) </li></ul></ul><ul><ul><li>Insight, Decision Making (Actionable) </li></ul></ul>
  9. 9. New Enterprise Content Management Technical Challenges <ul><li>Aggregation </li></ul><ul><ul><li>Feed handlers/Agents that understand content representation and media semantics </li></ul></ul><ul><ul><li>Push-pull, Web-DB-Files, Structured-Semi-structured-Unstructured data of different types </li></ul></ul><ul><li>Homogenization and Enhancement </li></ul><ul><ul><li>Enterprise-wide common view </li></ul></ul><ul><ul><ul><li>Domain model, taxonomy/classification, metadata standards </li></ul></ul></ul><ul><ul><li>Semantic Metadata– created automatically if possible </li></ul></ul><ul><li>Semantic Applications </li></ul><ul><ul><li>Search, personalization, directory, alerts, etc. using metadata and semantics (semantic association and correlation), for improved relevance, intelligent personalization, customization </li></ul></ul>
  10. 10. Creating and Serving Metadata to Power the Life-cycle of Content Applications Back End &quot;A Web content repository without metadata is like a library without an index.&quot; - Jack Jia, IWOV “ Metadata increases content value in each step of content value chain.” Amit Sheth Where is the content? Whose is it? Produce Aggregate What is this content about? Catalog/ Index What other content is it related to? Integrate Syndicate What is the right content for this user? Personalize What is the best way to monetize this interaction? Interactive Marketing Broadcast, Wireline, Wireless, Interactive TV Semantic Metadata
  11. 11. A Metadata Classification Data (Heterogeneous Types/Media) Content Independent Metadata (creation-date, location, type-of-sensor...) Content Dependent Metadata (size, max colors, rows, columns...) Direct Content Based Metadata (inverted lists, document vectors, LSI) Domain Independent (structural) Metadata (C++ class-subclass relationships, HTML/SGML Document Type Definitions, C program structure...) Domain Specific Metadata area, population (Census), land-cover, relief (GIS),metadata concept descriptions from ontologies Ontologies Classifications Domain Models User More Semantics for Relevance to tackle Information Overload!!
  12. 12. Semantics <ul><li>“ meaning or relationship of meanings, or relating to meaning” (Webster) </li></ul><ul><li>is concerned with the relationship between the linguistic symbols and their meaning or real-world objects </li></ul><ul><li>meaning and use of data (Information System) </li></ul><ul><li>Example: Palm -> Company, Product, Technology, Tree Name, part of location (Palm Spring, Palm Beach) </li></ul><ul><li>Semantics, Ontologies (Domain Models), Metamodels, Metadata, Content/Data </li></ul>
  13. 13. “ The Web of data (and connections) with meaning in the sense that a computer program can learn enough about what the data means to process it . . . . Imagine what computers can understand when there is a vast tangle of interconnected terms and data that can automatically be followed.” (Tim Berners-Lee, Weaving the Web , 1999) A Content Management centric definition of Semantic Web: The concept that Web-accessible content can be organized and utilized semantically, rather than though syntactic and structural methods. Semantics: The Next Step in the Web’s Evolution
  14. 14. Next Generation: Semantic Content Management
  15. 15. Organizing Content <ul><li>Different and Related Objectives: Search, Browse, Summarization, Association/Relationships </li></ul><ul><li>Indexing </li></ul><ul><li>Clustering </li></ul><ul><li>Classification </li></ul><ul><li>Controlled Vocabulary, Reference Data/ Dictionary/Thesaurus </li></ul><ul><li>Metadata </li></ul><ul><li>Knowledge Base (Entities/Objects and Relationships) </li></ul>
  16. 16. Statistical/AI Techniques Customer Article Feed 4715 Classification of Article 4715 Customer Training Set Traditional Text Categorization Routing/Distribution Classify Place in a taxonomy feed Most traditional Content Management Products support Categorization of unstructured content.. Standard Metadata Feed Source : iSyndicate   Posted Date : 11/20/2000
  17. 17. Knowledge-base & Statistical/AI Techniques Article Feed 4715 Classification of Article 4715 Customer Training Set & KB Routing/Distribution Classify Place in a taxonomy Taalee Training Set & KB Map to another taxonomy Metadata Catalog Semantic Engine™ Precise Personalization/ Syndication/Filtering Voquette/Taalee’s Categorization & Automatic Metadata Creation feed Standard metadata Semantic metadata FTE Company Analysis Conference Calls Earnings Stock Analysis ENT Company Analysis Conference Calls Earnings Stock Analysis NYSE Member Companies Market News IPOs Automated Content Enrichment (ACE) Article 4715 Metadata Feed Source : iSyndicate   Posted Date : 11/20/2000 Company Name : France Telecom , Equant Ticker Symbol : FTE , ENT Exchange : NYSE Topic : Company News
  18. 18. Technologies for Organizing Content <ul><li>Information Retrieval/Document Indexing </li></ul><ul><li>TF-IDF/statistical, Clustering, LSI </li></ul><ul><li>Statistical learning/AI: Machine learning, Bayesian, Markov Chains, Neural Network </li></ul><ul><li>Lexical, Natural language </li></ul><ul><li>Thesaurus, Reference data, Domain models ( Ontology ) </li></ul><ul><li>Information Extractors </li></ul><ul><li>Reasoning/Inferencing: Logic based, Knowledge-based, Rule processing and </li></ul><ul><li>Most powerful solutions require combine several of these, addressing more of the objectives </li></ul>
  19. 19. Multiple competitng standards! Multiple heterogeneous metadata models with different tag names for the same data in the same GIS domain Kansas State FGDC Metadata Model Theme keywords : digital line graph, hydrography, transportation... Title : Dakota Aquifer Online linkage : Direct Spatial Reference Method: Vector Horizontal Coordinate System Definition: Universal Transverse Mercator … … … ... UDK Metadata Model Search terms : digital line graph, hydrography, transportation... Topic : Dakota Aquifer Adress Id: Measuring Techniques: Vector Co-ordinate System: Universal Transverse Mercator … … … ...
  20. 20. Basis for Semantics <ul><li>A. Facts/Concepts/Terms/Entities </li></ul><ul><li>Dictionary, Thesaurus, Reference Data, Vocabulary </li></ul><ul><li>B. Facts with Relationships </li></ul><ul><li>Taxonomy/(Categories), Ontology </li></ul><ul><li>Domain Modeling (e.g., Golf = golfer, tournament name, golf course, event) </li></ul><ul><li>Knowledge Base </li></ul>
  21. 21. Ontology <ul><li>Standardizes meaning, description, representation of involved concepts/terms/attributes </li></ul><ul><li>Captures the semantics involved via domain characteristics, resulting in semantic metadata </li></ul><ul><li>“ Ontological Commitment” forms basis for knowledge sharing and reuse </li></ul><ul><li>Ontology provides semantic underpinning. </li></ul>
  22. 22. An Ontology Disaster eventDate description site => latitude, longitude site latitude longitude Natural Disaster Man-made Disaster damage numberOfDeaths damagePhoto Volcano Earthquake NuclearTest magnitude bodyWaveMagnitude conductedBy explosiveYield bodyWaveMagnitude < 10 bodyWaveMagnitude > 0 magnitude < 10 magnitude > 0 Terms/Concepts (Attributes) Functional Dependencies (FDs) Domain Rules Hierarchies
  23. 23. Controlled Vocabularies/ Classifications/Taxonomies/Ontologies <ul><li>WordNet </li></ul><ul><li>Cyc </li></ul><ul><li>The Medical Subject Headings (MeSH): NLM's controlled vocabulary used for indexing articles, for cataloging books and other holdings, and for searching MeSH-indexed databases, including MEDLINE . MeSH terminology provides a consistent way to retrieve information that may use different terminology for the same concepts. Year 2000 MeSH includes more than 19,000 main headings, 110,000 Supplementary Concept Records (formerly Supplementary Chemical Records), and an entry vocabulary of over 300,000 terms. </li></ul>
  24. 24. Open Directory Project (ODP): Classification/Taxonomy & Directory
  25. 25. Metadata Specifications (MetaModels) Metadata Domain Independent (Dublin Core, RDF, DAML+OIL) Frameworks/Infrastructures (XCM, XMI) Function Specific ICE (Syndication) Domain (Application) Specific MARC (Library), FGDC and UDK (Geographic), PRISM (Publishing), FXML (Financial Transactions). RIXML (Buy-Sell Research/Financial Services), IMS Learning Resource (Distance Learning). ….. Media Specific MPEGx, VoiceXML NewsML (News exchange)
  26. 26. Types of Specs and Standards (or MetaModels) <ul><li>Domain Independent: (MCF), RDF, (MOF), DublinCore </li></ul><ul><li>Media Specific: MPEG4, MPEG7, VoiceXML </li></ul><ul><li>Domain/Industry Specific (metamodels): MARC (Library), FGDC and UDK (Geographic), NewsML (News), PRISM (Publishing), RIXML (Buy-Sell Research/Financial Services) </li></ul><ul><li>Application Specific: ICE (Syndication), IMS Learning Resource (Distance Learning) </li></ul><ul><li>Exchange/Sharing: XCM, XMI </li></ul><ul><li>Orthogonal/(Other): RDFS, namespaces, ontologies, domain models, (DAML, OIL) </li></ul>
  27. 27. Dublin Core Metadata Initiative <ul><li>Simple element set designed for resource description </li></ul><ul><li>International, inter-discipline, W3C community consensus </li></ul><ul><li>“ Semantic” interface among resource description communities (very limited form of semantics) </li></ul>
  28. 28. Dublin Core RDF <ul><li><xml> </li></ul><ul><li><?namespace href = &quot;; as = &quot;RDF&quot;> </li></ul><ul><li><?namespace href = &quot;; as = &quot;DC&quot;> </li></ul><ul><li><RDF:Abbreviated> </li></ul><ul><li><RDF:Assertion RDF:HREF = </li></ul><ul><li>DC:Title = &quot;I've Never Metadata I've Never Liked“ </li></ul><ul><li>DC:Creator = &quot;Mary Crystal“ </li></ul><ul><li>DC:Subject = &quot;Metadata, Dublin Core, Stuff&quot;/> </li></ul><ul><li></RDF:Abbreviated> </li></ul><ul><li></xml> </li></ul>
  29. 29. NewsML Source: The content provider supplies NewsML packaged media content to the operator. The content can be categorized as current events, finance, sport, etc. (but no standards is specified) and updated hourly. The operator receives NewsML data from the content provider. The content server automatically pushes updated news articles to all news service subscribers. Consumers sign up for the news service directly on the device. When using the news service, the user browses through the categories and reads the news articles. The news articles are presented in a continuous flow (one after the other) without end-user interaction.
  30. 30. NewsML <ul><li>Content-descriptive metadata: </li></ul><ul><li>< HeadLine > Seattle attacked by Godzilla-like creature, Microsoft closes HQ </ HeadLine >   </li></ul><ul><li>< DateLine > Seattle, Was., Aug 30, 2009 /AthensWire via COMTEX/ -- </ DateLine >   </li></ul><ul><li>< CopyrightLine > Copyright (C) 2009 AthensWire. All rights reserved. </ CopyrightLine >   </li></ul><ul><li>Administrative metadata: </li></ul><ul><li>< Provider >< Party FormalName =&quot; Comtex &quot; /></ Provider > </li></ul><ul><li>< Source >< Party FormalName =&quot; AthensWire &quot; /></ Source > </li></ul><ul><li>Rights metadata: </li></ul><ul><li>< CopyrightDate > 2009 </ CopyrightDate > </li></ul><ul><li>Descriptive metadata: </li></ul><ul><li>< Language FormalName =&quot; en &quot; />   </li></ul><ul><li>< Property FormalName =&quot; Location &quot; Value =“ Seattle, Washington, United States, North America &quot; /> </li></ul><ul><li>< Property FormalName =&quot; PublicCompany &quot; Vocabulary =&quot; &quot;>   </li></ul><ul><li>< Property FormalName =&quot; CompanyName &quot; Value =“ Microsoft Corp. &quot; /> </li></ul><ul><li>< Property FormalName =&quot; StockSymbol &quot; Value =&quot; MSFT &quot;/>< Property FormalName =&quot; StockExchange &quot; Value =&quot; Nasdaq &quot; /> </li></ul><ul><li></ Property > </li></ul>
  31. 31. RIXML <ul><li>Financial metadata for Buy/Sell sides </li></ul><ul><li>Highly domain-specific </li></ul><ul><li>Schema (see next slide) [from UserGuide, p. 31] </li></ul><ul><li>Example: MorningCall . xml </li></ul>
  32. 32. RIXML Schema
  33. 33. Metadata Creation and Semanticization <ul><li>Automatic Content Classification/Categorization </li></ul><ul><li>Metadata Creation/Extraction: Types of metadata created </li></ul>Semantic Engine and WorldModel are trademarks of Taalee, Inc. Metadata Extraction is a patented technology of Taalee, Inc.
  34. 34. Content Handling/Ingest <ul><li>Infrastructure/Exchange </li></ul><ul><li>Feed Handlers </li></ul><ul><li>Crawlers/Screen Scrapers/Bots </li></ul><ul><li>Software Agents </li></ul><ul><li>Centralized, Distributed, or Mobile/Migratory </li></ul>
  35. 35. Information Extraction for Metadata Creation METADATA EXTRACTORS Key challenge: Create/extract as much (semantics) metadata automatically as possible WWW, Enterprise Repositories Digital Maps Nexis UPI AP Feeds/ Documents Digital Audios Data Stores Digital Videos Digital Images . . . . . . . . .
  36. 36. Extracting a Text Document: Syntactic approach INCIDENT MANAGEMENT SITUATION REPORT Friday August 1, 1997 - 0530 MDT NATIONAL PREPAREDNESS LEVEL II CURRENT SITUATION: Alaska continues to experience large fire activity. Additional fires have been staffed for structure protection. SIMELS, Galena District, BLM . This fire is on the east side of the Innoko Flats, between Galena and McGr The fore is active on the southern perimeter, which is burning into a continuous stand of black spruce. The fire has increased in size, but was not mapped due to thick smoke. The slopover on the eastern perimeter is 35% contained, while protection of the historic cabit continues. CHINIKLIK MOUNTAIN, Galena District, BLM . A Type II Incident Management Team (Wehking) is assigned to the Chiniklik fire. The fire is contained. Major areas of heat have been mopped up. The fire is contained. Major areas of heat have been mopped-up. All crews and overhead will mop-up where the fire burned beyond the meadows. No flare-ups occurred today. Demobilization is planned for this weekend, depending on the results of infrared scanning. LAYOUT Date => day month int ‘,’ int
  37. 37. Extraction Agent Web Page Enhanced Metadata Asset Taalee Extraction and Knowledgebase Enhancement
  39. 39. Video with Editorialized Text on the Web Automatic Categorization & Metadata Tagging (Web page) Auto Categorization Semantic Metadata
  40. 40. Automatic Categorization & Metadata Tagging (Feed) Text From Bllomberg Auto Categorization Semantic Metadata
  41. 41.       Taalee Metadata on Football Assets Rich Media Reference Page Baltimore 31, Pit 24 Quandry Ismail and Tony Banks hook up for their third long touchdown, this time on a 76-yarder to extend the Raven’s lead to 31-24 in the third quarter. Professional Ravens, Steelers Bal 31, Pit 24 Quandry Ismail, Tony Banks Touchdown 2/02/2000 League: Teams: Score: Players: Event: Produced by: Posted date: Crawler provided text for indexing vs Agent provided semantic metadata Virage Search on football touchdown Jimmy Smith Interview Part Seven Jimmy Smith explains his philosophy on showboating. URL: http://cbs.sportsline... Brian Griese Interview Part Four Brian Griese talks about the first touchdown he ever threw. URL: http://cbs.sportsline... Metadata from Typical Cataloging of Football Assets
  42. 42. Traditional Content Management Agent Push Pull Information Extraction Agents Dynamic KB Custom WorldModel Relevant Metadata Enhancement Knowledge Management Aggregation & Metadata Extraction Knowledge Management (Knowledge Base, Domain Model, Metadata) Agent Front End Portal Voquette Semantic Applications Feeds (proprietary formats, standards-based, NewsML) Corporate Repositories Web Sites One Approach to Extending Traditional CM: Voquette’s Semantic Engine Technology Search Personalization Alerts Notifications Custom “research” applications Content Metadata Metadata Metadata Metadata
  43. 43. Taalee/Voquette Semantic Platform Architecture <ul><li>Content of all format, media, push/pull: </li></ul><ul><li>Web sites/pages: static, dynamic </li></ul><ul><li>Content Feeds (unstructured, semistructured/docs, tagged/XML) </li></ul><ul><li>Corporate Repositories/databases </li></ul><ul><li>Homogenization/integration: </li></ul><ul><li>with taxonomy (categorization) </li></ul><ul><li>contextually relevant metadata </li></ul><ul><li>wrt to domain model, automatically generated from content and inferenced </li></ul>© Taalee Inc.
  44. 44. Content which does contain the words the user asked for Extractor Agents Content which does not contain the words the user asked for, but is about what he asked for. Value-added Metadata Content the user did not think to ask for , but which he needs to know . Semantic Associations + + Semantic Content End-User Semantic Content
  45. 45. Metadata and Semantic Technology enabled Applications
  46. 46. Taalee’s Semantic Search Highly customizable, precise and freshest A/V search Context and Domain Specific Attributes Uniform Metadata for Content from Multiple Sources, Can be sorted by any field Delightful, relevant information, exceptional targeting opportunity
  47. 47. Creating a Web of related information What can a context do?
  48. 48. Example (test on ) Search for company ‘Commerce One’ Links to news on companies that compete against Commerce One Links to news on companies Commerce One competes against (To view news on Ariba, click on the link for Ariba) Crucial news on Commerce One’s competitors (Ariba) can be accessed easily and automatically
  49. 49. What else can a context do? (a commercial perspective) Semantic Enrichment Semantic Targeting
  50. 50. Semantic/Interactive Targeting Precisely targeted through the use of Structured Metadata and integration from multiple sources Buy Al Pacino Videos Buy Russell Crowe Videos Buy Christopher Plummer Videos Buy Diane Venora Videos Buy Philip Baker Hall Videos Buy The Insider Video
  51. 51. Example 1 – Snapshots (“Jamal Anderson”) Click on first result for Jamal Anderson View metadata. Note that Team name and League name are also included in the metadata Search for ‘Jamal Anderson’ in ‘Football’ View the original source HTML page. Verify that the source page contains no mention of Team name and League name . They were Taalee’s value-additions to the metadata to facilitate easier search.
  52. 52. Example 2 – Snapshots (“Gary Sheffield”) Click on first result for Gary Sheffield View metadata. Note that Team name and League name are also included in the metadata Search for ‘Gary Sheffield’ in ‘Baseball’ View the original source HTML page. Verify that the source page contains no mention of Team name and League name . They were Taalee’s value-additions to the metadata to facilitate easier search.
  53. 53. Semantic Web – Intelligent Content (supported by Taalee Semantic Engine) Related Stock News Industry News Technology Products COMPANY EPA Regulations Competition COMPANIES in Same or Related INDUSTRY COMPANIES in INDUSTRY with Competing PRODUCTS Impacting INDUSTRY or Filed By COMPANY Important to INDUSTRY or COMPANY SEC Intelligent Content = What You Asked for + What you need to know!
  54. 54. Semantic Application – Equity Dashboard Focused relevant content organized by topic ( semantic categorization ) Automatic Content Aggregation from multiple content providers and feeds Related news not specifically asked for (Semantic Associations) Competitive research inferred automatically Automatic 3 rd party content integration
  55. 55. Internal Source 1 Research Internal Source 2 External feeds/Web (e.g. Reuters) Voquette Metabase World Model Third-party Content Mgmt And Syndication Semantic Engine 1 2 3 4 Cisco story from Source 1 passed on to add semantic associations Consults Knowledge Base for Cisco ’s competition Returns result: Lucent is a competitor of Cisco Lucent story from external feeds picked for publishing as “semantically related” to Cisco story – passed on to Dashboard Story on Lucent Story on Cisco XCM-compliant metadata, XML or other format Semantic Application ASP/Enterprise hosted Extractor Agent 1 Extractor Agent 2 Extractor Agent 3 Metadata centric Content Management Architecture
  56. 56. Wireless Application of Semantic Metadata and Automatic Content Enrichment  Clicking on the link for Cisco Analyst Calls displays a listing sorted by date. Semantic filtering uses just the right metadata to meet screen and other constrains. E.g., Analyst Call focuses on the source and analyst name or company. The icon denote additional metadata, such as “Strong Buy” by H&Q Analyst. MyStocks News Sports Music MyMedia    $  My Stocks CSCO NT IBM Market CSCO Analyst Call Conf Call Earnings    11/08 ON24 Payne 11/07 ON24 H&Q  11/06 CBS Langlesis CSCO Analysis
  57. 57. Scene Description Tree Retrieve Scene Description Track “ NSF Playoff” Node Enhanced XML Description MPEG-2/4/7 Enhanced Digital Cable Video MPEG Encoder MPEG Decoder Node = AVO Object Voqutte/Taalee Semantic Engine <ul><li>Produced by: Fox Sports   </li></ul><ul><li>Creation Date: 12/05/2000 </li></ul><ul><li>League: NFL </li></ul><ul><li>Teams: Seattle Seahawks, </li></ul><ul><li>Atlanta Falcons </li></ul><ul><li>Players: John Kitna </li></ul><ul><li>Coaches: Mike Holmgren, </li></ul><ul><li>Dan Reeves </li></ul><ul><li>Location: Atlanta </li></ul>Object Content Information (OCI) Metadata-rich Value-added Node Create Scene Description Tree  GREAT USER EXPERIENCE Metadata’s role in emerging iTV infrastructure Channel sales through Video Server Vendors, Video App Servers, and Broadcasters License metadata decoder and semantic applications to device makers “ NSF Playoff”
  58. 58. Metadata for Automatic Content Enrichment Interactive Television This segment has embedded or referenced metadata that is used by personalization application to show only the stocks that user is interested in. This screen is customizable with interactivity feature using metadata such as whether there is a new Conference Call video on CSCO. Part of the screen can be automatically customized to show conference call specific information– including transcript, participation, etc. all of which are relevant metadata Conference Call itself can have embedded metadata to support personalization and interactivity.
  59. 59. Semantic Technology Features <ul><li>Unstructured Text Content </li></ul><ul><li>Semi-Structured Content </li></ul><ul><li>Structured Content </li></ul><ul><li>Audio/Video Content with associated text (transcript, journalist notes) </li></ul><ul><li>Create a Customized &quot;World Model&quot; (Taxonomy Tree with customized domain attributes) </li></ul><ul><li>Automatically homogenize content feed tags </li></ul><ul><li>Automatically categorize unstructured text </li></ul><ul><li>Automatically create tags based on text Itself </li></ul><ul><li>Create and maintain a Customized Knowledge Base for any domain </li></ul><ul><li>Automatically enhance content tags based on information beyond text </li></ul><ul><li>Build contextually relevant custom research applications </li></ul><ul><li>Contextual Search (an order of magnitude better than keyword-based search) </li></ul><ul><li>Support push or pull delivery/ingestion of content </li></ul><ul><li>Personalization/Alerts/Notifications </li></ul><ul><li>Real Time Indexing (stories indexed for search/personalization within a minute) </li></ul><ul><li>Provide the user with relevant information not explicitly asked for (Semantic Associations) </li></ul>
  60. 60. Along with the evolution of metadata and semantic technologies enabling the next generation of the Web, Content Management has entered the next generation of Enhanced Content Management.
  61. 61. Resources/References <ul><li>RDF: w w w . w 3 . o r g / T R / R E C - r d f - s y n t a x / </li></ul><ul><li>ICE: www. icestandard .org </li></ul><ul><li>Meta Object Facility (MOF) Specification, Version 1.3, September 27, 1999: </li></ul><ul><li>XML Metadata Interchange (XMI) Specification, Version 1.1, October 25, 1999: </li></ul><ul><li>DAML: www. daml .org </li></ul><ul><li>NEWSML: </li></ul><ul><li>PRISM: </li></ul><ul><li>RIXML: </li></ul><ul><li>XCM: </li></ul><ul><li>OIL: www. ontoknowledge .org/oil </li></ul><ul><li>SEMANTICWEB: , </li></ul><ul><li>VOICEXML: www. voicexml .org </li></ul><ul><li>MPEG7: </li></ul><ul><li>Taalee: </li></ul><ul><li>Applied Semantics: </li></ul><ul><li>Ontoprose: </li></ul>
  62. 62. <ul><li>Multimedia Data Management: Using Metadata to Integrate and Apply Digital Media, Amit Sheth & Wolfgang Klas, Eds., McGraw Hill, ISBN: 0-07-057735-8, 1998. </li></ul><ul><li>Information Brokering, Vipul Kashyap & Amit Sheth, Kluwer Academic Publishers, 2001. </li></ul><ul><li>Voquette Semantic Technology White Paper. </li></ul><ul><li>Mysteries of Metadata, Speaker – Amit Sheth, Workshop at Content World 2001. </li></ul><ul><li>Infoquilt Project, LSDIS lab. </li></ul><ul><li> </li></ul><ul><li> </li></ul>