Dealing the Cards

Dealing the Cards

Marjorie Hlava, President
Access Innovations, Inc.
www.accessinn.com
Monday October 31, 2011
© 2011. Access Innovations, Inc. All Rights Reserved.

Overview of the Presentation
 The basics
 30 minutes
 “Taxonomatch”
 15 minutes
 Dealing the cards
 Implementation and applications
 30 minutes
 “A Taxing Situation”
 The new board game!
 15 minutes


The Basics – 30 minutes

 What is a taxonomy?
 What are the parts of a taxonomy?
 How do you build one?
 Guidelines for the terms
 Subject Matter Experts (SME’s)
 40 slides


What is a Taxonomy?
ANSI/NISO Z39.19-2005
controlled

“A collection of controlled vocabulary terms
organized into a Yes!

hierarchical structure.”
Missing:
equivalence, associative relationships, and notes


The Semantic Roadmap:
Knowledge Organization Systems
•Complex Semantic network •Linked Entities
•High value •Contextual Specificity
Ontology
Thesaurus
Taxonomy
Controlled vocabulary
Synonym set/ring
Name authority file
Uncontrolled list list
 Uncontrolled
•Simple •Unrelated Entities
•Low Value •Ambiguity
Highest Cost over Time!


Basic features - The term record
 Main Term (MT) = subject term, heading, node,
category, descriptor, class
 Top Term (TT)
 Broader Terms (BT)
TAXONOMY
 Narrower Terms (NT) ONTOLOGY
 Related Terms (RT)
 See also (SA) THESAURUS
 Non-Preferred Term (NP)
 Used for (UF), See (S)
 Synonyms
 Scope Note (SN)
 History (H)


Taxonomy? Thesaurus?
 Often used interchangeably
 Thesaurus is a taxonomy with extras
 Related Terms
 Non-preferred Terms (USE/Used for)
 Scope Notes
 More
 Taxonomies often have the actual
information object at the final node.
 CMS and SharePoint tend to the
hierarchical view only, definition, and USE


Taxonomy Thesaurus
view Term Record
view

Copyright © 2005 - Access
© 2011.
Innovations, Inc.
Access Innovations, Inc. All Rights Reserved.

How do you build a taxonomy ?
• Define subject field
• Collect terms
• Organize terms
• Fill in gaps
• Flesh out and interrelate terms
• Apply to your data
You’re done!


Define subject field
 Review representative collection of content
 Determine:
 Core areas
 Peripheral topics Sociology

Psychology
Education
Law
 Scope can be modified later


Build, buy, augment?
 Survey existing thesaurus/taxonomy resources for your
domain
 Test for
• Scope
• Depth
• Make-or-break terms
• Cost
 Adoption of existing taxonomies
 Term registries
 Taxobank
 Taxonomy Warehouse
 Other resources
Don’t reinvent the wheel!

Foundations
 Start with what is known
 Build from there
 Use the literature, your data
 Use the lists you already have internally
 Built-in continuous review throughout the
process, and beyond
 Who is involved?
 Taxonomists
 Subject matter experts
 Project management
 Users

Collect terms
 Your documents and databases
 Departmental terminology
 Text books and their indexes
 Book tables of contents and indexes
 Journal quarterly indexes
 Encyclopedias
 Lexicons, glossaries on the topic
 Web resources
 Users and experts
 Search logs

Gather terms from search logs

 Top ~100 search terms from search logs
 Terms used more than 50 times
 Match to web site with appropriate
answer
 Basis for favorites or best bets, presented
at the top of results list.
 Behavior-based taxonomy


How do you choose terms?
 Importance in the subject area
 Use in the literature, by the organization
or community
 Necessary degree of specificity or detail
 Relationship with other controlled
vocabularies
 Single concept = single term


One term / one concept
 Terms represent simple or unitary
concept
 A unit of thought
 May be a single-word term
 May be a multiword term is required to
represent the concept
“A unit of thought, formed by
 Three main categories mentally combining some or all
– Concrete entities of the characteristics of a
concrete or abstract, real or
– Abstract concepts imaginary object. Concepts
– Proper nouns exist in the mind as abstract
entities independent of terms
used to express them.”

Concrete entities as terms
• Things and their physical parts
– Birds
• Feathers
• Buildings
• Floors
• Materials
– Cement
– Wood
– Lead
– Cards and Chips


Abstract concepts as terms
• Actions and events
– evolution, skating, management, ceremonies
• Abstract entities
– law, theory
• Properties of things, materials, and
actions
– strength, efficiency
• Disciplines and sciences
– physics, meteorology, mathematics
• Units of measurement
– pounds, kilograms, miles, meters, nanoseco
nds


Proper nouns as terms

 Individual entities – “classes of one” –
expressed as proper nouns
 San Francisco, Lake Michigan

Thesaurus standards exclude proper
names, persons, and trade names 
authority files.
Taxonomies include them as final nodes.


Organize terms – roughly
 Sort terms into several major categories –
logical groups of similar concepts as Top
Terms
 Identify core areas and peripheral topics
 10 – 20 to start
 Consider moving proper names to authority files
 Result: loose collection of terms under
several main headings
 Rough and tentative – see how it fits as you go
 Initial gap analysis
 Add / modify / delete as needed


How do terms relate?

 Hierarchical relationships
TAXONOMY
-- Parents and their children
 Equivalence relationships
-- Aliases THESAURUS
 Associative relationships
-- Cousins
-- See Also’s


Hierarchical relationships
 Broader Term represents the
class, whole, or genus
 Narrower Term is a member, part, or
species
 Generic relationship
 Whole-part relationship
 Instance relationship
 NT inherit all the BT characteristics
 BTs/NTs have a reciprocal relationship


Broader to Narrower Terms

Politics

Elections
Presidential elections
Gubernatorial elections
Mayoral elections


Hierarchy –
Whole-part relationship

 Four general types
– Body systems and organs
• Ear  Middle ear
– Geographical locations
• Bernalillo County  Albuquerque
– Fields of study
• Geology  Physical geology
– Hierarchical social structures
• Ontario  Manitoulin District


Hierarchy – Instance relationship
 General category (common noun) as BT,
with individual example (proper noun) as
NTI (Narrower Term Instance)
Seas French cathedrals
Baltic Sea Chartres Cathedral
Caspian Sea Rheims Cathedral
Mediterranean Sea Rouen Cathedral

Essentially identical to “final node” in taxonomies


Polyhierarchical relationship
• Term can logically fit under more than one
Broader Term – can have Multiple Broader
Terms (MBT)
• Part of ISO standards, new to ANSI/NISO

Nurses Health administrators
Nurse administrators Nurse administrators
Finance Careers
Accounting Accounting

Copyright © 2009 - Access
© 2011. Innovations, Inc.
Access Innovations, Inc. All Rights Reserved.

Generic relationship test – 1
• Both terms in same fundamental category
• “All-and-some” test
Rodents
SOME ALL
Squirrels

Pests
SOME NOT ALL
Squirrels

Inheritance or inclusion – what’s true of the parent (BT)
is true for all children (NTs)


Generic relationship test – 2

Rodents
Squirrels Pests

 ALL squirrels are rodents
x NOT ALL squirrels are pests
x NOT ALL pests are rodents


Equivalence relationship
• Preferred Term
– Thesaurus term and valid for indexing
– Thesaurus notation: USE

• Non-Preferred Term
– Not valid for indexing
– An alias or imposter
– Entry point, directs user to Preferred Term
– Thesaurus notation: UF or NPT
Spiders Plant pathology
UF Arachnids USE Phytopathology


Equivalence – when to use
 Synonyms, slang, quasi-synonyms
 Scientific and trade names
 Ibubrofen UF Motrin™
 Lexical variants
 Fiber optics UF Fibre optics
 Mouse UF Mice
 Upward posting of narrow concepts not specified
in taxonomy or thesaurus
 Social class UF Elite, Middle class, Working class

Get equivalent terms from search logs, brainstorming…

Associative relationship
 Related Terms (RTs) – cousins
 “…terms related conceptually but not
hierarchically, and are not part of an equivalence
set” (i.e. not synonyms)
 Both valid for indexing
 Reciprocal relationship with each other
 Expands user’s awareness, reflects
thesaurus coverage of unanticipated areas
 Main basis for the ontology
 14 main options offered in Z39.19

Scope Notes (SN)
 Indicate meaning of the term in the context of
this thesaurus, for this audience
 Stress – Metal, Psychological, Physiological
 Could be the definition or glossary
 Indicate any restriction in meaning
 Indicate range of topics covered
 Provide direction for indexers; for terms often
confused, may suggest an alternative term
 Use as needed – may not be for every term
 Use a style guide
 Be concise


Stating the terms
• Term format
• Grammatical issues
• Singular and plural forms
• Spelling
• Abbreviations and acronyms
• Capitalization
• Other punctuation
• Consistency


Term format
 KISS – Keep it short and simple
• 1-2-3 words
• Effect on search
• Pre and Post Coordination
 Establish a policy
• follow Chicago Manual of Style
 Grammatical issues
• Nouns and noun phrases
• Verbs  Gerunds
• Adjectives - no
• Adverbs - no
• Initial articles – no


Compound Terms – Nope!
 “Terms in a thesaurus should represent
simple or unitary concepts…” (ISO standard)
 “Compound terms should be factored
(split) into simple elements…” (ANSI/NISO
standard)
 Term phrases are okay (bigrams)
 Adjective Noun
 American history
 Two concepts combined are not
 Aromatherapy for bloating


Pre and Post Coordinate Terms
 Pre coordinates – two concepts
 Subject headings – Library of Congress
 American history – Civil War
 Back of the book
 Put together in advance by the publisher
 Post Coordinate
 Taxonomy terms
 Single concept
 Put together by the user / searcher


So far you’ve got
 Hierarchy
– Broader and Narrower Terms
• Polyhierarchies when needed
– Preferred/Non-Preferred Terms
– Equivalence relationships
– Related Terms
– Associative relationships
– Scope Notes
– Complete term records
– Correct term format

Review, edit, test, edit,
use, edit, and maintain, i.e. edit
 Review  Edit and maintain
Users Add term
Expert reviewers Change existing term
 Test Change term status
Index 500+ documents (more Delete term
for variable writing style; Add term relationship
fewer for strict style) Delete term relationship
Monitor search log Add/modify Scope Note
Change overall structure

Consider automated / assisted indexing software


Subject Matter Experts
 Work first from the literature
 Establish literary warrant for terms
 Some one else do the clerical work
 Differentiate the lexicography work
 From the Subject Matter expert work
 Let SMEs do the review and tailoring
 Expert review ensures the proper term
use and application
 Advisory Board…advisable!

 Designed to enhance understanding and retention of the
vocabulary concepts necessary for creating a taxonomy,
ontology, thesaurus, or controlled vocabulary.
 Game supplies:
 1 Deck of Orange Question and Challenge Cards
 1 Deck of Green Answer Cards
 Game setup:
 Shuffle the deck of Green Answer cards,
 Deal the entire deck to the players.
 Shuffle the deck of Orange Question and Challenge cards
 Place them facedown in a pile in the middle of the table so that all
players can reach the pile.

 Reinforce what you just heard!
 Have fun!


1. Play moves to the left of the dealer 7. Discussion among the players to arrive at
2. Draw a card from the top of the Orange the correct answer is permissible and
cards. Read it aloud to all of the players. encouraged!
3. The player who read the card says out loud 8. If players do not arrive at a consensus
what they think the answer is. regarding the correct answer, the Orange
4. Each player looks at the Green Answer Question and Challenge card may be
cards in their hand. returned to the bottom of the pile, and play
passes to the person to the left of the player
1. If they have the correct answer to the who drew the previous card.
Question or Challenge, they show
their card to everyone at the table. 9. When all of the Orange Question and
Challenge cards have been drawn, read
2. If everyone agrees that the answer is aloud, and matched with their Green
correct, the player holding the correct Answer cards, the game ends.
answer card gives it to the player who
read the Question or Challenge card. 10. If there are any Orange Question and
Challenge cards remaining to which players
5. The player places their associated pair of cannot agree on an answer, players may
cards – one Orange Question and consult their notes or ask the session
Challenge card and one Green Answer card speaker.
– face up on the table in front of them.
6. Play passes to the person who held the
correct Green Answer card in their hand.
Play continues as in step 2 above.

Implementation and applications
 Adding the terms to the information
objects
 Search and other applications
 Taxonomy use cases – implementation
 Opportunities and Obstacles
 – 30 minutes


Parts of the puzzle
 The taxonomy
 The words to use
 In the order you want the users to browse
 Applications
 Search, CMS, SharePoint etc
 Implementation / actions
 Making the links
 Adding terms to information objects
 Most people confuse the parts and they act
very differently


The Workflow MOSS
Fully integrated with
Build Create
Gather Tag and Put in
Search user
source Create data base
inverted interface
data metadata with tags
index

Client Data Automatic
Summarization
Full Text Search
HTML, PDF,
Machine Aided
Presentation
Data
Indexer Layer
Feeds, etc. (M.A.I.™)
Search
Database Software Increases
Inline Tagging Repository accuracy
Client Browse by Subject
Client Taxonomy
taxonomy Metadata and Auto-completion
Entity Extractor Broader Terms
Narrower Terms
Thesaurus Related Terms
Master

44

Adding terms to information objects
 Part of the record
 XML
 MARC
 A relational table pointing the terms to a
record ID number (Secondary key)
 Adding data to the HTML
 META NAME KEYWORD Element
 Many other options


Part of the record - XML
 Added as an element in the XML record
 Need an element to put the data in
 <Taxonomy Term>
 Capture the terms when creating the
records


Editorial Workflow Integration
Author Submission Module
The author fills in the data to the document template, attaching images
and graphs as necessary.

An API calls Data Harmony and generates a list of indexing terms
based on the content.


Editorial Workflow Integration
Author Submission Module

Authors review the
indexing and may
change it.

Content is stored
into a data
repository as
HTML, XML, etc.


In the HTML record
 Makes it crawl able for the internet
 Used in CMS applications
 Content Management Systems
 Add to the HTML
 Manually
 In Dreamweaver
 In your CMS like Extron
 Author Submissions Example
 Do the same with SharePoint

META NAME “KEYWORDS”


In Relational Database Table
 Primary Key – the record
 Secondary key all the metadata
 Like taxonomy terms
 Like author
 Like publication date
 Used in Oracle, SQL, etc
 Need filed to put the taxonomy data in
 Supports “Faceted Search”
 each item in a separate field or element or table


Relational database diagram


Using taxonomies in applications
• Improve search • In “indexing” or
• Subject browsing categorizing, as subject
• Mobile intelligence metadata
• Targeted resources based • In content management
on subject or user role systems
• Link to society resources • In SharePoint
• Author submission module • In mashups
• Author authority database • In social networking sites
• Expert reviewer • In author tagging
identification • In filtering data –
• Member profiles e.g., spam filters and RSS
• Data visualization feeds
• More like this • In web crawlers
 Social media - community

Why does search fail?
 Most large organizations have 5 different
search software's
 All disappointing and on the shelf
 Inconsistent results
 Unclear path to results
 Lack of single unified clear consistent
vocabulary
 Not tied to data governance
 Taxonomy
 Other metadata

Parts of Search
 Search software
 Inverted Index
 Search algorithms
 Presentation layer
 Search box
 Autocompletion
 Related and narrower terms
 Hierarchical display


Sample DOCUMENT
Outline of Presentation
1 Define key terminology
2 Thesaurus tools
Creating
 Features
an  Functions
Inverted 3 Costs
File Index  Thesaurus construction
 Thesaurus tools
4 Why & when?

Simple inverted file index
The terms from the “outline”
& key
1 of
2 outline
3 presentation
4 terminology
construction thesaurus
costs tools
define when
features
why
functions


Complex inverted file index
Placement location
key - L2, P2, H
& - Stop of - Stop
1 - Stop outline - L1, P1, T
2 - Stop presentation - L1, P3, T
3 - Stop terminology - L2, P3, H
4 - Stop thesaurus - (1) - L3, P1, H
construction - L7, P2, SH (2) - L7, P1, SH
costs - L6, P1, H (3) - L8, P1, SH
define - L2, P1, H tools - (1) - L3, P2, H
features - L4, P1, SH (2) - L8, P2, SH
functions - L5, P1, SH when - L9, P3, H
why - L9, P1, H


Subject Browsing


Targeted resources based on
subject or user role

CONFIDENTIAL

Linked Data
CME Activity
on Topic A Upcoming
Other Journal Conference
Articles on on Topic A
Topic A

Job Posting
Journal for Expert
Article on on Topic A
Topic A

Grant Available for Podcast Interview
Researchers with Researcher
Working on Topic A Working on Topic A

Author Networks
Social Networking


Link to Society Resources
Cancer Epidemiology Biomarkers & Prevention Related Press Releases
•How What and How Much We Eat (And Drink) Affects Our
Vol. 12, 161-164, Risk of Cancer
February 2003 •Novel COX-2 Combination Treatment May Reduce Colon
© 2003 American Association for Cancer Research Cancer Risk Combination Regimen of COX-2 Inhibitor and
Fish Oil Causes Cell Death
Short Communications •COX-2 Levels Are Elevated in Smokers

Alcohol, Folate, Methionine, and Risk of Incident Breast
Cancer in the American Cancer Society Cancer Prevention Related AACR Workshops and Conferences
•Frontiers in Cancer Prevention Research
Study II Nutrition Cohort •Continuing Medical Education (CME)
Heather Spencer Feigelson1, Carolyn R. Jonas, Andreas S. •Molecular Targets and Cancer Therapeutics
Robertson, Marjorie L. McCullough, Michael J. Thun and Related Meeting Abstracts
Eugenia E. Calle Department of Epidemiology and Surveillance •Association between dietary folate intake, alcohol intake, and
methylenetetrahydrofolate reductase C677T and A1298C
Research, American Cancer Society, National Home polymorphisms and subsequent breast
Office, Atlanta, Georgia 30329-4251 •Folate, folate cofactor, and alcohol intakes and risk for
colorectal adenoma
•Dietary folate intake and risk of prostate cancer in a large
Recent studies suggest that the increased risk of breast cancer prospective cohort study
associated with alcohol consumption may be reduced by
adequate folate intake. We examined this question among Related Education Book Content
66,561 postmenopausal women in the American Cancer Society
Related Working Groups Think Tank Report Oral Contraceptives, Postmenopausal
•FinancePrevention Study II NutritionRelated Think Tank Report
Cancer Cohort. Hormones, and Breast Cancer
•Charter Content Physical Activity and Cancer
•Molecular Epidemiology Webcasts Hormonal Interventions: From Adjuvant Therapy to
Related Awards Related Webcasts Breast Cancer Prevention
•AACR-GlaxoSmithKline Clinical Cancer Research
Scholar Awards
•ACS Award
•Weinstein Distinguished Lecture

Authors at a Place


Member Profile Tagging

User pastes or
uploads CV

Button to auto-
extract taxonomy
attributes


User uploads a document
to SharePoint space
Adding terms
to SharePoint

Before uploading to Data Harmony
SharePoint server, the automatically attaches
EventHandler sends the indexing terms before
document to Data uploading to MOSS
Harmony.

TaxoTerm Server Microsoft
Data Harmony Returns subject SharePoint
(M.A.I.) metadata Server 2010

66


SharePoint 2010 only shows 10 lines of
the taxonomy
This add on makes it all viewable

67

Taxonomies added in
search example
Core Architectural Components
Administrator’s
Dashboard

FAST MANAGEMENT API

Web WEB SEARCH
Content CRAWLER SERVER Vertical
Pipeline

QUERY API
Query Applications
FILE Pipeline

PROCESSOR
Files,
TRAVERSER

QUERY
Documents
CONTENT API

Portals
DATABASE
PROCESSOR
DOCUMENT

Databases CONNECTOR Index DB
Results Custom
EMAIL FILTER Alerts Front-Ends
Email,
Groupware CONNECTOR SERVER

Mobile

Search harmony
Custom Content CUSTOM
Devices
Applications Push CONNECTOR

Agent DB
MAIstro

68
Use taxonomy terms here
Data Harmony Governance API


Autosuggestion of taxonomy terms
Allow for manual
review of auto-
Populate
tagging for
Keywords, Des
quality
criptors, Indexi
assurance.
ng terms, etc.

69


More Innovations!
 Link topic to article to author to event
 Make visual links within domain
 Enable authors to submit and categorize
conference submissions
 Create author authority database linking to co-
authors, topics, locations, etc.
 Create expert reviewer database
 Create member profiles with alternate names,
publications, tagged by topic
 Visualize data and domain distribution
 Display interest connections in social network
 Deliver accurate targeted information through
mobile applications
 Etc.

Taxonomy standards at 5:00
 Z39.19 (2005) Controlled Vocabularies
 BS 8723 Parts 1 – 5
 ISO25964 Parts 1 - 4
 TAG 37 and 46 standards
 SKOS - Simple Knowledge Organization
System
 OWL - Web Ontology Language
 AND more!


IT is often Fire, Ready, Aim!
 Choose the hardware
 Choose the software
 Decide on the format
 Convert the data
 Fix the data
 Tack on a taxonomy
 Ignore the standards


Change to Ready, Aim, Fire!

 Follow the data
 Look at the data, format and content
 Design taxonomy for data
 Leverage the standards
 Use taxonomy to tag data
 Choose search and repository software for
data
 Load the data into the system
 Keep your eye on the target

 The New Board Game
 Applications
 Implementation
 The taxonomy


Summary
 We covered the basics
 We talked about the implementation
 Application of the terms to your content
 We reinforced the learning with activities
 No go hear the case studies of the next
two days!


Okay Now deal the cards!

Marjorie M.K. Hlava
Alice Redmond Neal President
Chief Taxonomist Access Innovations, Inc.
Heather M. Kotula mhlava@accessinn.com
Game Meister © 2011. Access Innovations, Inc. All Rights Reserved. 505-998-0800

Dealing the Cards

More Related Content

Viewers also liked

Similar to Dealing the Cards

More from TSoholt

Recently uploaded

Dealing the Cards

Editor's Notes