Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Calais @ the Palo Alto Semantic Web Meetup


Published on

An oveview of Thomson Reuters Calais Initiative given by Tom Tague at the Palo Alto Semantic Web Meetup in San Francisco, CA in August

Published in: Technology
  • Hi, thanks for sharing. I’m Ana Mui Stanley, working on my latest site on lyrics, . I enjoy reading the slide.
    Are you sure you want to  Yes  No
    Your message goes here
  • Great. I learned a new thing about Calais.

    Are you sure you want to  Yes  No
    Your message goes here
  • Great display about the need to innovate business models; tips on how to represent them succinctly; as well as the need to make advancement initiatives actionable. Superb use of pictures and clear to see illustrative examples.

    Are you sure you want to  Yes  No
    Your message goes here

Calais @ the Palo Alto Semantic Web Meetup

  1. 1. Calais PAWS Sep 4, 2008
  2. 2. Calais?
  3. 3. ClearForest <ul><li>Founded in 1998 by text analytics pioneers </li></ul><ul><li>A software organization that enables Intelligent Information </li></ul><ul><li>Enterprise and government customers </li></ul><ul><li>Led the market in the establishment of unstructured text as a key corporate asset </li></ul><ul><li>Acquired by Reuters June 2007 </li></ul><ul><li>Offices: Boston, Israel </li></ul>
  4. 4. The Text Problem <ul><li>People consume text </li></ul><ul><li>Most of it isn’t semantically enabled </li></ul><ul><li>Most of it won’t be semantically enabled </li></ul><ul><li>Why: Latency, cost and short shelf-life </li></ul>
  5. 5. Calais’ Piece of the Puzzle <ul><li>A semantic metadata generation service that extracts entities, facts and events from unstructured text </li></ul><ul><li>Two new capabilities: topics & relevance </li></ul><ul><li>Available for commercial or non-commercial use up to 40,000 times per day </li></ul>Calais Named Entities Facts Events People, Companies, Geographies, Albums, Authors, etc. Position, Alliance, Education, Political Affiliation, etc. Management Change, IPO, Labor Action, Sporting, Entertainment etc. Unstructured Documents (Text / HTML / XML)
  6. 6. Reuters Announced the Acquisition of ClearForest New York - April 30, 2007 Reuters, the global information company, has entered into an agreement to acquire all of the outstanding shares of ClearForest Ltd., a privately held provider of Text Analytics solutions, whose tagging platform and analytical products allow clients to derive precise business information from huge amounts of textual content. ClearForest has received sufficient shareholder approval to complete the transaction, which is expected to close in approximately 30 days, subject to customary closing conditions. The financial terms were not disclosed. Reuters plans to retain and continue to work with the existing management team and their highly skilled workforces in the US and Israel. It also plans to continue to support existing products and customers. Reuters believes that search will be a pivotal element to the future of how financial information is sourced and consumed. As part of its drive into this space, Reuters has created a new strategic group and appointed Gerry Campbell, who will oversee the integration of ClearForest and drive this innovation. <Topic>M&A</Topic> <Acquisition offset=&quot;494&quot; length=&quot;130&quot;>   <Company_Acquirer>Reuters</Company_Acquirer>   <Company_Acquired>ClearForest Ltd.</Company_Acquired>   <Status>Planned</Status> </Acquisition> <Company>Reuters</Company> <Company>ClearForest Ltd.</Company> <Product>Text Analytic Solution </Product> <Company>ClearForest Ltd.</Company> <Company>Reuters</Company> <Country>United States</Country> <Country>Israel</Country> <Company>Reuters</Company> <Person>Gerry Campbell</Person> <ManagementChange offset=&quot;2789&quot; length=&quot;92&quot;> <Person>Gerry Campbell</Person> <Company>Reuters</Company> <Action>Enters</Position> </ManagementChange>
  7. 7. What’s Behind and Event … An Example Digital Marketing Services,Inc. (DMS), the leading provider of online marketing research and a division of America Online Inc. (AOL), today announced an alliance with Netcentives Inc. (Nasdaq: NCNT) Extracted instances: Company = Digital Marketing Services, Inc. Company = Netcentives Inc. Status = announced DateString = today Date = 2000-01-31
  8. 8. Live Example Viewer Demo Gnosis Demo
  9. 9. Extending Calais’ Reach <ul><li>More than just a web service – a growing collection of tools and applications to make it valuable in the real world </li></ul>Calais Browser Extensions Gnosis Content Management Tools WordPress Drupal UIMA Development Tools & Libraries PHP Ruby JAVA .NET Applications And more… TopBraid RSS Tagger Powerhouse LinkedFacts Wirecatch FeedShaver
  10. 10. How Calais is Being Used Today <ul><li>Gist Automatically aggregates multiple news sources and automatically slots them into topic, etc. </li></ul>
  11. 11. The Stack ClearForest Tags Platform File Based Connector Programmatic API (SOAP web Service) RDBMS Connector Web Crawlers (Agents) Console Rich XML Live Feed Tooling Modeler Developer Cat Manager A F External Content/live feed/Enterprise Content ClearForest Extraction Modules B ClearForest Categorizer C
  12. 12. Detailed Stack Rich XML Rich XML ClearForest Tags Platform Files Document Conversion and Normalization Control DB Tags API Control API File Based API Programmatic API (SOAP web Service) Web Agents RDBMS based API Enterprise System Categorizer Semantic Tagging Language ID Headline Generation Classifier Extraction Modules Language Classifier Templates Categorization Manager ClearForest Dvlpr/Modeler Languages Configuration Key Concepts Configuration ClearForest Studio Rich XML External Feed Configuration & Monitoring Console Farm Manager
  13. 13. Platform Highlights <ul><li>Single run-time platform for all technologies </li></ul><ul><li>Modular architecture </li></ul><ul><li>Additional functional plug-in can be added anywhere </li></ul><ul><li>Web services interfaces </li></ul><ul><li>SOA ready </li></ul><ul><li>Java based </li></ul><ul><li>Programmatic API to all components </li></ul><ul><li>Farming support for scalability </li></ul><ul><li>Best practices/standards (XML, Unicode, Architectural Patterns, Design patterns …) </li></ul>
  14. 14. File API Programmatic API (SOAP web Service) RDBMS based API Web Custom Document Tagging (Doc Runner) Categorization Information extraction Control Console Control API Tags Pipeline KB Writer DB Writer XML Writer IO Bound Rich XML ANS Collection DB Other (Headline Generation) Document Conversion Conversion & Normalization PDF Conv. XML Conv. Doc Conv. File/Web/DB based API (Document Provider) Profile Listener Listener Listener Language identification Queues: CPU Bound Web Document Injector (flight plan) Technology
  15. 15. The NLP Stack Events & Facts Entities Candidates, Resolution, Normalization Basic NLP Noun Groups, Verb Groups, Numbers Phrases, Abbreviations Metadata Analysis Title, Date, Body, Paragraph Sentence Marking Morphological Analyzer POS Tagging (per word) Stem, Tense, Aspect, Singular/Plural Gender, Prefix/Suffix Separation Tokenization
  16. 16. Calais, Semantics and the Semantic Web <ul><li>Issues, Opportunities </li></ul><ul><ul><li>Ontologies </li></ul></ul><ul><ul><ul><li>How do we make this a community effort? </li></ul></ul></ul><ul><ul><li>Dereferenceable URI’s & Endpoints </li></ul></ul><ul><ul><ul><li>Engineering </li></ul></ul></ul><ul><ul><ul><li>Population </li></ul></ul></ul><ul><ul><ul><ul><li>Basic data </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Links </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Proprietary data sources </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Functions? Code? </li></ul></ul></ul></ul>
  17. 17. What’s in the Pipeline? <ul><li>2008 </li></ul><ul><ul><li>The basics of de-referenceable URI’s </li></ul></ul><ul><ul><li>Disambiguation – company & geography </li></ul></ul><ul><ul><li>Hooks </li></ul></ul><ul><li>2009 (this is a fuzzy list) </li></ul><ul><ul><li>Person disambiguation (social networks?) </li></ul></ul><ul><ul><li>Other disambiguation </li></ul></ul><ul><ul><li>Continued population of endpoints </li></ul></ul><ul><ul><li>Calais as hub </li></ul></ul><ul><ul><li>Exposure of the IDE </li></ul></ul><ul><ul><li>User managed lexicons </li></ul></ul><ul><ul><li>Lots and lots of hooks </li></ul></ul>
  18. 18. <ul><li> </li></ul><ul><ul><li>Gallery – code and applications examples </li></ul></ul><ul><ul><li>Forums </li></ul></ul><ul><ul><li>Documentation </li></ul></ul>