Machine Aided Indexer

Machine Aided Indexer™

Machine Aided IndexerTM is available as astand-alone version or as part of MAIstro™(integrated with Thesaurus MasterTM).M.A.I.TM creates a simple rulebase from yourthesaurus terms to use for categorizingdocuments.You can fine-tune the rulebase to reflecteditorial knowledge and judgment, specifyingwhen thesaurus terms should be used. Your result: Precision Indexing

M.A.I. under the hood Concept Extractor™ Compares text to Knowledge Base rules to present suggested index terms Statistics Collector™ Gathers and stores the index experience of the system, sorting into Hits / Misses / Noise Prioritizes terms needing rule finetuning to improve indexing accuracy Rule Builder™ Human editor creates, edits, and reviews rules for indexing terms

IN Knowledge MAI BaseText Concept Rule Builder Extractor Editor manages Knowledge Base List of suggested terms from Statistics controlled Collector vocabulary improves the Knowledge Base OUT Human review Database results in: Indexed Hits—selected terms set of Misses—added terms documents Noise—rejected terms

Objective in indexing:apply indexing terms with... Accuracy Speed Depth -- specificity Breadth -- exhaustivity ConsistencyObjective in M.A.I. rulebuilding:make rules reflect human thinking foroptimal categorization

How? Formulate standard rules  for interpreting text  for applying thesaurus terms as subject metadata to index/categorize documents 2/14/2012

Why use rules for indexing?Rules provides consistent direction forinterpreting text and applying indexing terms.Accurate indexing results in preciseinformation retrieval.

M.A.I.’s starter rulebase M.A.I. automatically generates rules Starter rules match exactly to words in text  Identity rules for thesaurus terms  Synonym rules for established NonPreferred terms Success out of the box depends on  Taxonomy term expression of concepts  Writer’s creative expression of concepts

Fine-tuned by editors, rules enable context clues to pinpoint word meaning ―reading between the lines‖ natural language processing greater accuracy over simple rule indexing Use M.A.I.’s Rule Builder Module to fine-tune rules for applying terms.

Indexing and rule-building – two processes Indexing:  Read and interpret document text  Decide on indexing term Rulebuilding:  Identify prompt word(s)  What brought the indexing term to mind?  This text to match in the document is the starting point for rule-building. 2/14/2012

Indexer reads the document text―Indian leaders are asking the government…‖ 11

Indexer considers indexing terms  ―government‖ State government? Federal government? City government?  ―Indians‖ in India? Indigenous people? Native Americans? 2/14/2012

Indexer selects indexing terms―Indian leaders are asking the government to prevent a repeat of the 1990 census undercount that missed nearly 3000 Indians in New Mexico.‖ 13

M.A.I. term suggestions Government New MexicoUse your knowledge to select best terms – from M.A.l. suggested terms from thesaurusDecide on indexing terms and apply them to document.

Indexing done,rule-building beginsThe rule-building editor’s question: What words in the text prompted selection of those terms?This word (or words) is the starting point forbuilding a rule with M.A.I. – the ―gatekeeper.‖

Choose the MAI Rule Builder tabA rule hastwo parts: Viewing options:--Text to Match font--rule body style size

M.A.I. rule starts withText to Match The prompt word (or word part or phrase) in the document -- whatever made the indexer think of a specific indexing term -- becomes the Text to Match of a rule.

Importance of Text to Match TTM opens the door to the rulebase  Without a word or phrase to match, the knowledge of the rulebase is unavailable. M.A.I. system programmatically creates a starter rulebase  Identity rules – exact match to thesaurus term  Synonym rules – exact match to NonPref termStarting point for a rulebase – Ready for finetuning

M.A.I. out of the box  Estimate 60% accuracy  Success depends on:  Style of thesaurus terms  Writing style of documents  Addition of synonyms

If only…Document authors wroteusing the language of thesaurus terms,then the starter rulebase would be sufficient…but...

Editors make M.A.I. rules smarter 1. Modify the Text to Match 2. Modify the rule body

1. Modify the Text to Match Words with the same root crystal ~ crystallize ~ crystalline ~ crystallization ~ crystal-forming Text to match: crystal* Words in inverted sequence Power, Solar = Solar power Text to match: solar Phrases with same meaning, different syntax Pollution control = Control of pollution Text to match: pollution

2. Modify the rule body Starter rules (identity and synonym) specify term to be used – no ifs, ands or buts You can  establish conditions or limits on the suggestion of the indexing term(s)  direct M.A.I. to ignore a word or phrase in text (NULL rule)

Two basic types of rules 1. Simple rules (starter rules) no conditions to limit the use of the indexing term 2. Condition rules where rules get interesting!

Simple rules – how they work The prompt word in the text suggests the same indexing term every time that word occurs No IFs qualify the use of the indexing term Text to Match in the document  USE Indexing term

3 Types of simple rules 1. Identity rules 2. Synonym rules 3. NULL rules

Simple rules – identity ruleText to Matchis identical tothesaurus termin therule body --No conditions

Simple rules – identityText to match: irrigation USE IrrigationText to match: Lake Michigan USE Lake MichiganText to match: marriage and divorce records USE Marriage and divorce records

Identity rules are created programmatically

Simple rules – synonym rule Show term equivalents (Use/Used for)Text to match: jobless USE UnemploymentText to match: fish farm USE AquacultureText to match: Y2K USE Y2K issueText to match: parish USE CountyText to match: e-business USE Ecommerce

Simple rules – synonym rule Simplify morphological, punctuation, spelling, and sequencing variationsText to match: worker’s compensation workman’s compensation workmen’s compensation work* comp* USE Worker’s compensationText to match: e-commerce USE Ecommerce

A synonym rule for the Text to Match ―jobless‖suggests … USE Unemployment When M.A.I. is integrated with Thesaurus Master, synonym rules for Non Preferred terms are generated programmatically.

Simple rules – synonym rule Separate out compound termsText to match: fishing USE Fishing and huntingText to match: hunting USE Fishing and huntingText to match: adoption USE Adoption and foster careText to match: divorce USE Marriage and divorce records TIP: Trim TTM down to one core element

Simple rules – NULLIgnore a thesaurus word that occurs • as part of an irrelevant phrase ―physician’s orders‖ • as part of an idiom ―in light of…‖ ―a bird in hand‖ ―looking back...‖ Text to match: in light of Rule: NULL

NULL rule – Do not index with the thesaurus term ―Light‖ in this instance.

Two basic types of rules 1. Simple rules (starter rules) no conditions limit the use of the indexing term 2. Condition rules where rules get interesting!

Dealing with ambiguity

Jay Leno’s headlines Police Begin Campaign to Run Down Jaywalkers Local High School Dropouts Cut in Half Red Tape Holds Up New Bridges Include Your Children When Baking Cookies Kids Make Nutritious Snacks Iraqi Head Loses Arm

How would you disambiguate…• bush – What other words and/or conditions should lead to using the term  Shrubs – OR  U.S. presidents balloon  Aerostatic aviation – OR  Party supplies will(s)  Jurisprudence, Last will and testament, Living wills  (auxiliary verb)

Example: routing vehicles (direction) work (workflow) people, data, stuff (distribute, disperse) the other team (overwhelming defeat) wood (using power tool)

Example: Technology – Need conditions?  Top term  Narrow terms Engineering Information technology Medical technology Technology transfer Radio frequency identification technology  Scope note The practical use of scientific knowledge in industry and everyday life; the scientific method and material used to achieve a commercial or industrial objective  Related terms Technology assessment Technology researchSet conditions on using term Technology? ―new fangled technology‖ ―cooking technology‖ ―report from the Massachusetts Institute of Technology‖

When the prompt wordis ambiguous Could prompt word be interpreted differently?  Indian leaders are asking the government…  balloon  bush  bridge  adoption Under what conditions would another interpretation be correct?

Thinking conditionally –let the IFs begin... Convergent thinking What other words in text would confirm your interpretation of the text-to-match meaning and your proposed indexing term? Divergent thinking What words in text would contradict your interpretation?

Condition rules – IF rules For ambiguous word meanings, editor can set IF conditions that must be met for rules to suggest an indexing term. Can incorporate conditions from Scope Notes Editor can set one or more conditions, joined with Boolean operators AND, OR, and NOT.

Example: Sniffer BT Malicious code SN A program that intercepts routed data and examines each packet in search of specified information, such as passwords transmitted in clear text. M.A.I. rule TTM: sniffer USE Sniffer “Customs used a sniffer dog to identify the contraband …”

In a botany taxonomy, ―bushes‖ is a NonPref Termthat prompts the preferred term ―Shrubs‖ --even if the text is about (former) President Bush.When a simple rule won’t do, set conditions in therule to increase precision Hits and decrease Noise.

Simplify the TTM – then add conditions in the rule body

4 types of conditions1. Proximity of rule’s TTM to quoted word from document text (4 levels of proximity)2. Capitalization of TTM3. Exact MATCH of TTM to word in text4. TTM begins or ends a sentence Mix and match conditions with Boolean operators: AND, OR, NOT

Condition rules – Proximity Text to match: safetyIF (NEAR “security”) WITHIN 3 WORDS USE Crime preventionENDIFIF (WITH “community”) WITHIN SENTENCE USE Public safetyENDIFIF (AROUND “product”) WITHIN 50 WORDS USE Product safetyENDIFIF (MENTIONS “food”) WITHIN 250 WORDS USE Food handling and safetyENDIF

Condition rules – Proximity Text to match: bear IF (NEAR “Chicago” OR WITH “football”) USE Chicago Bears ENDIF IF (NEAR “market” OR AROUND “stock”) USE Stock market ENDIF IF (MENTIONS “forest” OR MENTIONS “woods”) USE Wild animals ENDIF

Example: DocumentationText to match: documentationUSE Documentation Identity rule created problems Add conditions for greater precision: IF (AROUND "software" OR WITH "application" OR AROUND "hardware" OR WITH "instruction“) USE Documentation ENDIF

Condition rules – Negation Text to match: wages IF (NOT WITH “war”) USE Wages and salaries ENDIF• Text to match: web IF (NOT WITH “spin*”) USE Internet ENDIF (“spider” no longer differentiates internet from arachnids)

Condition rules – Case Text to match: aids IF (ALL CAPS) USE AIDS and HIV ENDIF Text to match: masters IF (INITIAL CAPS AND MENTIONS “poet*”) USE Edgar Lee Masters ENDIF

Condition rules – Match Text to match: employ* IF (MATCH “employment”) USE Employment ENDIF IF (MATCH “employee” AND (WITH “municipal” OR WITH “city” OR WITH “town”)) USE Municipal employees ENDIF

Condition rules – Sentence position  IF (BEGIN SENTENCE)  IF (END SENTENCE)

Conditions in rules help increase precision Hits decrease Noisefor more precise information retrieval. Conditions depend on human logic.

M.A.I. can save illogical statements  bad results.M.A.I. can not save a rule with incorrect syntax.Rule Check and Save check the syntax of a rule.Error warning – explains syntax problems – shows line location Closing parenthesis missing

Mind your IFs and ( )s – come in 2s IF starts the system thinking about a condition; ENDIF completes the thought. Every IF condition goes in ( )s. Every ( must close with ) -- multiple ( )s are OK. Every IF condition must close with an ENDIF. Every ― must close with ‖. Function words must be spelled correctly.

Kicking rules up a notch Rules can express  Multiple concepts  Alternative concepts  Contingent concepts

Condition rules – IF-IFText to match: housingIF (AROUND “afford*”) USE Affordable housing IS DIFFERENT FROMENDIFIF (AROUND “public”) Text to match : housing USE Public housing IF (AROUND “afford*”)ENDIF USE Affordable housing IF (AROUND “public”)Independent conditions USE Public housing ENDIF ENDIF Contingent conditions

Condition rules – IF-IFText to Match: agricultur* Text to Match: agricultur*IF (WITH “products”) IF (WITH “products”) USE Agricultural products USE Agricultural products IF (WITH “programs”) ENDIF USE Agricultural programs IF (WITH “programs”) ENDIF USE Agricultural programsENDIF ENDIFAgricultural programs is available ONLY IF BOTH terms may be used—Agricultural products they are independent condition is met.

Condition rules – IF-IFText to Match: agricultur*IF (WITH “products”) USE Agricultural products IF (WITH “programs”) USE Agricultural programs ENDIFENDIFIndentation emphasizes contingent condition

Condition rules – IF-ELSE 1 IF - ELSE provides further options in rules, a default if the first condition is not met. It may be used without condition Text to match: technology IF (AROUND “transfer*”) USE Technology transfer ELSE USE Technology ENDIF

Condition rules – IF-ELSE 2 Text to match: norwegian IF (AROUND “language” OR WITH “speak*”) USE Norwegian language ELSE USE Norway ENDIF

Condition rules – IF-ELSE IF  IF - ELSE IF or add extra conditions Text to match: norwegian IF (MENTIONS “language”) USE Norwegian language ELSE IF (MENTIONS “country”) USE Norway ENDIF ENDIF

You can...  Truncate a single word with * e.g. agri*  Use * as a wild card between words, e.g. drinking * driving  Truncate in the text to match and/or in the rule body

And you can... Include multiple conditions in a rule, starting from a single text-to- match tax*Text to match:IF (WITH “business”) USE Business taxesIF (WITH “income”) USE Income taxesIF (WITH “sales”) USE Sales taxesIF (AROUND “forms”) USE Tax formsIF (AROUND “law*” OR AROUND “legis*” OR AROUND “legal”) USE Tax laws

And you can... Use multiple Boolean operators in rules Embed clauses within clauses using Boolean operators Text to match: activit* IF (WITH “extracurricular” OR (WITH “school” AND (WITH “after” OR WITH “before” OR WITH “outside”))) USE Extracurricular activities ENDIF Watch the ( )s!

M.A.I. in action(105 ILCS 45/1-20) Sec. 1-20. Enrollment. If the parents or guardians of a homelesschild or youth choose to enroll the child in a school other than theschool of origin, that school immediately shall enroll the homelesschild or youth even if the child or youth is unable to produce recordsnormally required for enrollment, such as previous academic records,medical records, proof of residency, or other documentation. Nothing inthis subsection shall prohibit school districts from requiring parentsor guardians of a homeless child to submit an address or such othercontact information as the district may require from parents orguardians of nonhomeless children. It shall be the duty of theenrolling school to immediately contact the school last attended by thechild or youth to obtain relevant academic and other records. If thechild or youth must obtain immunizations, it shall be the duty of theenrolling school to promptly refer the child or youth for thoseimmunizations.(Source: P.A. 88-634, eff. 1-1-95; 88-686, eff. 1-24-95.)

Original identity rule for “Children and youth” Modify rule for “Children and youth” to Text to Match: child*

M.A.I. Statistics let you track performanceas you fine-tune the Knowledge Base. M.A.I.’s Statistics Collector gathers and stores indexing experience. Statistics compare editor’s indexing results to M.A.I.’s suggestions  Hits, Misses, Noise Statistics prioritizes the terms for which rules need fine-tuning.

M.A.I. statistics Hits System suggests indexing terms that are chosen by the editor--good! Misses System misses terms editor uses Noise  System suggests terms not used by editorMisses and Noise … need more rule-building

Open Misses to reveal thesaurus terms usedby an editor but not suggested by M.A.I. Buddhism was used by editors for indexing 3 records, but was not suggested by M.A.I.

Open the key beside the term to see the listof records where the term was used... The file name, record number and editor’s name are stored with each record.

Click to highlight any record line on the left.The full record appears on the right, withM.A.I.’s Suggested Terms and the editor’sUsed Terms.

In this record, M.A.I. interprets ―devotion‖ andsuggests the indexing term ―Prayer‖ -- Hit.The editor used ―Buddhism‖ though M.A.I.did not suggest the term -- Miss.M.A.I. suggested ―Libraries‖ and ―Religions‖though the terms were not used -- Noise.For this record, M.A.I. scored• 3 Hits -- Prayer, Sri Lanka, Religious beliefs• 1 Miss -- Buddhism• 2 Noise -- Religions, Libraries

The word ―Buddhism‖ does not appearin the record, although ―Buddha‖ does.The editor’s use of the thesaurus termBuddhism to index the record isappropriate.M.A.I.’s Knowledge Base can be fine-tunedto reflect human knowledge andinterpretation of the text.

Search the Knowledge Base for rules for Buddha. (Truncate buddh* to widen the search.)Click Search,results appear

Rules exist for ―Buddhism‖ and ―Buddhist‖ but not for ―Buddha,‖ which is in the text. You can easily create a new rule … Text to Match: Buddha IF (MENTIONS “religion”) USE Buddhism ENDIFIf ―buddha‖ and ―religion‖ are both in the text,M.A.I. suggests the indexing term Buddhism.

Enter a rule for Text to Match: buddha ... Better yet: combine all 3 rules by using Text to Match: buddh*

Click Save, OK to verify, and then Retry...

The new rule Text to Match: buddha promptsBuddhism in Suggested Terms for indexing.

At any time, you can: modify a rule check the rule for syntax save the rule see the rule’s history add an editorial note find a word clear the screen delete the rule

Each rule in the Knowledge Base that theeditor fine-tunes increases M.A.I.’s• ability to recognize synonyms,• find connections between non-contiguous words• interpret idioms,• make sense of allusions,• ―read between the lines‖ Over time, statistics for Hits increase, while Misses and Noise decrease.

M.A.I.’s Statistics Report summarizes Hit/Miss/Noise figures over time

When to make rules Before processing documents  Proactive rule building provides head start  Increases hits from the start After processing documents  Statistics report lets indexer see what rules need fine-tuning to improve Hits, avoid Misses, and decrease Noise, based on comparison of M.A.I. suggestions with editor’s indexingRule-building is an on-going process  Frequency diminishes, results improve

Custom configure M.A.I. How many term suggestions? Limit use of a term to n documents? How much text to scan? Treat singular the same as plural? Ignore stopwords? Quote marks? Plural=Singular? Most specific term only? Suggest Candidates?

M.A.I. measurably improves indexing results: • Consistency same term suggested under same text conditions • Indexing coverage terms reflect full range of indexable concepts in data • Indexing depth terms reflect the granularity and precision of deeper levels of thesaurus • Faster throughput nearly 7 times faster indexing

M.A.I. mines the full depth of yourthesaurus, suggesting the most specificand appropriate indexing term.M.A.I. can also filter indexing terms,displaying more general Broad Terms,while retaining the more precise indexingterms stored with the document.

Pairing Machine Aided Indexer with Thesaurus Master as MAIstro provides • simple thesaurus construction and maintenance • faster indexing • deeper indexing • greater concept coverage • more consistent indexing Efficiency and Economy in document storage and retrieval

Machine Aided Indexer

by accessinnovations on Feb 14, 2012

Accessibility

Categories

Tags

Upload Details

Usage Rights

Statistics

Machine Aided Indexer — Presentation Transcript