Apache Stanbol Enhancer Benchmark tool: introduction

1,647 views
1,577 views

Published on

Introduction to the Apache Stanbol Enhancer Benchmark tool, see also screencast at http://www.youtube.com/watch?v=QQ4G_mFLzVw

Slideshare didn't want my PDF, had to upload in keynote format and as a result it's a bit broken, but readable ;-)

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,647
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Apache Stanbol Enhancer Benchmark tool: introduction

    1. 1. Apache Stanbol Enhancer Bertrand Delacretaz, Senior R&D Developer, Adobe Systems IKS workshop + review, Saarbrücken, April 2011 - slides version 2011-04-08© 2011 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
    2. 2. New year, same vision© 2011 Adobe Systems Incorporated. All Rights Reserved. 2
    3. 3. Benchmarks: evaluate the quality of Stanbol enhancer annotations Paris Hilton is now in New York, after having spent some time in Geneva, Ohio. Paris, France Hilton Hotel Paris Paris Hilton New York State New York City Geneva, Switzerland Ohio state ...© 2011 Adobe Systems Incorporated. All Rights Reserved. 3
    4. 4. Benchmark definition Paris Hilton is now in New York, after having spent some time in Geneva, Ohio. Paris Hilton Paris, France Geneva, Ohio Hilton Hotel Ohio State Geneva, Switzerland ( New York City New York State )?© 2011 Adobe Systems Incorporated. All Rights Reserved. 4
    5. 5. Running the benchmarks in Stanbol© 2011 Adobe Systems Incorporated. All Rights Reserved. 5
    6. 6. Benchmark definition language= INPUT =Bob Marley was born in Kingston, Jamaica.= EXPECT =Description: Bob Marley must be found as a musical artisthttp://fise.iks-project.eu/ontology/entity-type URI http://dbpedia.org/ontology/MusicalArtisthttp://fise.iks-project.eu/ontology/entity-reference URI http://dbpedia.org/resource/Bob_Marley= COMPLAIN =Description: Miles Davis must not be foundhttp://fise.iks-project.eu/ontology/entity-type URI http://dbpedia.org/ontology/MusicalArtisthttp://fise.iks-project.eu/ontology/entity-reference URI http://dbpedia.org/resource/Miles_Davis Repeat for multiple benchmarks on a© 2011 Adobe Systems Incorporated. All Rights Reserved. 6
    7. 7. Benchmark results report Bob Marley was born in Kingston, Jamaica. Bob Marley must be found as a musical artist SUCCESSFUL (E) http://fise.iks-project.eu/ontology/entity-type URI http://dbpedia.org/ontology/ MusicalArtist (E) http://fise.iks-project.eu/ontology/entity-reference URI http://dbpedia.org/resource/ Bob_Marley Miles Davis must not be found SUCCESSFUL (C) http://fise.iks-project.eu/ontology/entity-type URI http://dbpedia.org/ontology/ MusicalArtist Very (C) http://fise.iks-project.eu/ontology/entity-reference URI http://dbpedia.org/resource/ Miles_Davis human© 2011 Adobe Systems Incorporated. All Rights Reserved. 7 readable.
    8. 8. Conclusions Benchmarks are key to industrial adoption decisions. The reports must be understandable by non- specialists. We’ll probably need richer quality statements.© 2011 Adobe Systems Incorporated. All Rights Reserved. 8
    9. 9. © 2011 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.

    ×