K Search Al Khawarizmy Language Software

Monday 12/05/2008

Arabic NLP Research
Arabic Applications based on NLP components
Stress on software quality (targeting ‘zero defect’ S/W)
Cooperate with the community; e.g. research students at universities (forming partnerships)
Promote widespread use of affordable applications that take the special features of the Arabic language into account
Effectively serve the Arab region by catering for its users’ needs
Monday 12/05/2008

1 st Nov. 2007 – 31 st Dec. 2007:
3 Developers + 1 Product Manager => Small (borrowed) room.
1 st Jan. 2008 – 31 st Jan. 2008:
1 Linguist => Home Office.
1 st Feb. 2008 – 31 st Mar. 2008:
1 Linguist => Smart Village Incubation.
1 st Apr. 2008 – Present:
3 Developers + 1 Linguist + 1 Business Development Manager + 1 Office Manager => Smart Village Incubation.
Monday 12/05/2008

The number of Arab Internet Users is growing
22 million users in 2006
43 million expected in 2008
The volume of Arabic e-content is increasing (on the web and in companies’ intranets):
Around 100 million Arabic web pages
About 5 million Arabic web sites
Monday 12/05/2008

Arabic is a highly inflected language
Arabic morphology has a set of unique features
Proper Arabic e-content processing is deficient
Consequently, Arab users are unable to take full advantage of Arabic e-content, compared with other languages
As an example, considering searching through Arabic content …
Monday 12/05/2008

Using : - Search for “ الحائزون على جوائز نوبل ” produces about 238 results Monday 12/05/2008

Using : - Search for “ الحائزون على جائزة نوبل ” produces about 684 results Monday 12/05/2008

Using : - Search for “ حاز على جائزة نوبل ” produces about 16,700 results Monday 12/05/2008

When used for Arabic search, traditional search engines produce
Incomprehensive results, i.e. not all inflected forms are found => a lot of useful information is missing
Redundant results, i.e. some results are inaccurate => they ‘bear no relation’ in form or in meaning to the search word(s)
Monday 12/05/2008

An Arabic Search Model that:
Provides morphological search  Comprehensive
Differentiates between meanings of Arabic words  Improves Accuracy
In other words…
Let us see the same example, using KSearch …
Monday 12/05/2008

Monday 12/05/2008

Arabic Morphological Search (to produce comprehensive search results).
Differentiation between Word Meanings (to increase accuracy of search results, i.e. reduce redundancy).
Search using Logical Operators ( و – أو - ليس ).
Adjacency (Proximity) Search.
Search using Wildcards (for proper nouns and Latin text) .
Search words are highlighted in the results pages.
Over 200 document formats are supported, including UNICODE encoded documents.
Arabic comprehensive dictionary of contemporary Arabic (approximately 78,000 entries).
Fast Indexing Engine (25,000 - 30,000 words/sec on a PC with AMD Athlon 3800+ CPU, IDE HDD, 1GB RAM).
Uses 64 bit Technology => Unlimited Index Size.
Comprehensive Index Management: Capability of deleting, updating and merging indexes.
Monday 12/05/2008

Monday 12/05/2008 Arabic ِ Morphological Analyzer Comprehensive + Contemporary Arabic Lexicon Arabic Data Source (Database, Document, etc.) Fast Indexing Engine Meta Data Repository Search Engine Search Results Arabic Lexical Semantic Analyzer

Employs KMorph , a fast Arabic morphological analyzer
Uses a comprehensive Arabic lexicon of contemporary words
KSpell Engine: Provides APIs for spelling verification and correction, e.g. may be integrated with content management systems to produce correctly spelled Arabic web content
Monday 12/05/2008

K Search Al Khawarizmy Language Software

by Abdallah Aziz

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 1

Statistics

K Search Al Khawarizmy Language Software Presentation Transcript