Email
Like
Liked ×
Save
Private Content
Embed
Loading embed code…
We have emailed the verification/download link to "".
Login to your email and click the link to download the file directly.

To request the link at a different email address, update it here. Close
Validation messages. Success message. Fail message.

Check your bulk/spam folders if you can't find our mail.
Loading

+ Follow

Apache UIMA and Semantic Search

by Tommaso Teofili

7,001 views

my introduction to Apache UIMA and Semantic Search at 2nd IKS Workshop in Rome 13th November 2009

Accessibility

View text version

Upload Details

Uploaded via SlideShare as Apple Keynote

Usage Rights

File a copyright complaint

4 Embeds 33

http://www.slideshare.net	29
http://www.linkedin.com	2
http://hophandsource.blogspot.com	1
http://sam.baojie.org	1

Statistics

Likes: 8
Downloads: 143
Comments: 5
Embed Views: 33
Views on SlideShare: 6,968
Total Views: 7,001

1–5 of 5 previous next Post a comment

Tommaso Teofili, Software Engineer this is because the original slide deck was made using Apple Keynote 6 months ago
Are you sure you want to
Tony Su Believe this slide cannot be downloaded, the link points to a 'key' file instead of a PDF or other typical presentation file. 6 months ago
Are you sure you want to
Tommaso Teofili, Software Engineer the code snippet should've appeared with tags to highlight annotations:

||book||title||Pride and Prejudice||title|| was written by||author||
Jane Austen||author||||book||, while ||book||||author||Joseph
Conrad||author|| wrote ||title||Heart of Darkness||title||||book||. 2 years ago
Are you sure you want to
Tommaso Teofili, Software Engineer It means that if you use Lucas to 'write down' your documents' annotations in fields then you'll have documents enriched and that is good but people often have different understandings of the 'semantic search' topic. Infact even if you have done named entity recognition with UIMA and then written down named entities annotations to Lucene fields then you won't be able to make queries which take relations and context in count.
Take the following example borrowed from a previous conversation I had with Thilo Goetz:

Pride and Prejudice was written by
Jane Austen, while Joseph
Conrad wrote Heart of Darkness.

'If you take the Lucas approach, you will not be able to
find out what books Jane Austen has written, because authors
and titles are indexed in different fields, independently.'

I hope this clarifies things a little :-) 2 years ago
Are you sure you want to
bolonudo what does 'Lucas example' mean? at the side number 4 2 years ago
Are you sure you want to

Hello everybody,
I am Tommaso Teofili, I am from Rome and I work in Sourcesense and I’m an Apache UIMA committer.
In this talk I am going to tell you about Apache UIMA & Semantic Search.
Apache UIMA stands for Unstructerd Information Management Architecture, it's an architectural framework to manage large volumes of unstructured data.
It was an IBM project donated to Apache.
It's currently an Incubator podling and the new 2.3.0 release is coming.
It's also been approved as an Oasis standard.
By the way, I became Apache UIMA committer on August.
UIMA is made of components, which can be put in a pipeline to be executed.
Every Apache UIMA component is described via XML descriptors.
The most important of which is the Analysis Engine, that is responsible for the very analysis of documents.
Each AE can be aggregated using an aggregate XML descriptor.
To manage large volumes of data UIMA can scale using Asynchronous Scaleout.
Each UIMA pipeline is made of AEs, one or more flow controllers and CAS consumers, the component which is responsible of treating the output (usually CASs).
Apache UIMA is not inherently a semantic search tool.
The semantic search tool package for UIMA is not open source.
Lucas is a CAS consumer for UIMA capable of putting UIMA annotations inside Lucene indexes, a semi-semantic approach.
UIMA is well suited as a metadata generation engine for CM systems.
It can enrich data with annotations, entities, categories and so on, eventually linking them.
For those who know the US Jeopardy game, IBM it's building a system able to answer open-domain questions against humans and it's based on UIMA-AS.
We'll see two examples of the power of UIMA to boost semantic search.
Here's the first one:
Recently during my college studies I used UIMA to extract metadata to build semantic searches on a real estate market analysis tool called Macpi.

zone statistics -> UIMA to find zones, price, filter out bad matchings
frequent announces -> disambiguation, data filtering
Another little demo I’m going to show is about integrating Apache UIMA and AlchemyAPI from Ochestr8.
AlchemyAPI provides, you guess, services to extract Entities from text, but what we are interested in here is using the linked data, to exploit, for example DBPedia, Freebase and so on data clouds.
So the power of UIMA here is again putting together in a pipeline many components, once my system learned I can easily substitute this component with a UIMA Dictionary using the ConceptMapper.
I get Alchemy component then I can put the OpenCalais component, my personal dictionary of specific terms, a machine learning engine based on what UIMA extracts and so on.
Here we’ll see indexing documents by concepts.
Ok, let’s go to the demos!

8 Likes

Trey Grainger, Search Technology Development Manager at CareerBuilder.com 1 month ago
Sitdhibong Laokok, Software Developer at Home 1 month ago
chodakowski 1 year ago
Nan Li, Research assistant at EPFL Tags semantic search 1 year ago
Sourcesense at Sourcesense Tags sourcesense 2 years ago
chchen62 Tags uima 3 years ago
Olivier Grisel, R&D Software Developer at Nuxeo Tags uima semweb 3 years ago
Piergiorgio Lucidi, Open Source ECM Specialist at Sourcesense 3 years ago

Apache UIMA and Semantic Search Presentation Transcript

Apache UIMA & Semantic Search Tommaso Teoﬁli tommaso@apache.org
Apache UIMA - what is it? Unstructered Information Management Architecture Architectural Framework to manage (eventually large) volumes of unstructered data Former IBM Alphaworks project donated to ASF Currently an Incubator podling ( http://incubator.apache.org/uima ) Apache UIMA is an Oasis standard ( http://www.oasis-open.org )
Apache UIMA - how? Many pluggable reusable components (described via XML) Analysis Engines (primitive or aggregates) Asynchronous scaleout (JMS, Apache ActiveMQ) Flow controllers Type systems
Apache UIMA - what is NOT? It’s not a semantic search tool inherently the “Lucas example” the semantic search package for UIMA is not open source! ( http://www.alphaworks.ibm.com/tech/uima/download )
UIMA & Semantic Search Metadata generation engine for CM systems Data enrichment Linked data Jeopardy (see http://www.research.ibm.com/deepqa/ faq.shtml#24 ) Let’s see...
RE Market Analysis & UIMA Macpi: a real estate market analysis tool developed at DIA Webpipe (crawling and wrapping data) Apache UIMA Spring framework Knowledge extraction Extract metadata with Apache UIMA to build our search
Apache UIMA & AlchemyAPI AlchemyAPI from Orchestr8 services wrapped as UIMA AEs Named-entity recognition, word disambiguation “Barack Obama” is http://dbpedia.org/resource/Barack_Obama Exploiting linked data enriching free text with DBpedia, GeoNames, Freebase URIs Plugging with other UIMA AEs providing you with a reusable component to deal with Linked Data
UIMA & Semantic Search it’s demo time!

Apache UIMA and Semantic Search

by Tommaso Teofili

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 33

Statistics

Apache UIMA and Semantic Search Presentation Transcript