LS 500 Lecture 9 Verbal Subject Analysis II: Periodical and Other Databases AKA - The “Human Indexing” Lecture Steven L. MacCall, Ph.D. Associate Professor School of Library and Information Studies The University of Alabama

Subject Cataloging versus Indexing Both are related to the subject analysis of information packages. Subject cataloging is term used for the subject analysis operations in library cataloging. Indexing is term generally used for the subject analysis operations in various other information organization contexts, including article- and webpage-surrogate record collections.

Both are related to the subject analysis of information packages.

Subject cataloging is term used for the subject analysis operations in library cataloging.

Indexing is term generally used for the subject analysis operations in various other information organization contexts, including article- and webpage-surrogate record collections.

Brief History of Periodical Indexes Around the turn of the 20 th century, the library community decided not to add article citations to the catalog. This development led to the growth of the commercial indexing industry. The result of this has been: Split files Fees for licensing database content Difficulty fulfilling Cutter’s 2 nd objective

Around the turn of the 20 th century, the library community decided not to add article citations to the catalog.

This development led to the growth of the commercial indexing industry.

The result of this has been:

Split files

Fees for licensing database content

Difficulty fulfilling Cutter’s 2 nd objective

Analytical Cataloging Analytical cataloging techniques are needed in order to provide access to the component parts of composite information packages, most commonly: Book chapters Proceedings articles (usually of academic meetings) Journal articles Definition from AARC2 (Chapter 13): Analysis is the process of preparing a bibliographic record that describes a part or parts of an item for which a comprehensive entry is made.

Analytical cataloging techniques are needed in order to provide access to the component parts of composite information packages, most commonly:

Book chapters

Proceedings articles (usually of academic meetings)

Journal articles

Definition from AARC2 (Chapter 13): Analysis is the process of preparing a bibliographic record that describes a part or parts of an item for which a comprehensive entry is made.

Analytical Cataloging Techniques Complex entries made within the record of composite work: Analytical added entries: Use 740 tag for second of two works mentioned in title of item Bishop Berkley – Principles of Human Knowledge Note area for comprehensive entry of larger work: Use 505 tag for structured display of table of contents Patricia Ratkovich – Innovative Redesign… Separate records created for the component parts of composite works (“In” Analytics): Use 773 to trace the component part record to parent record Harrison – Principles of Internal Medicine Dyspnea and pulmonary edema in title field Longo in author field

Complex entries made within the record of composite work:

Analytical added entries:

Use 740 tag for second of two works mentioned in title of item

Bishop Berkley – Principles of Human Knowledge

Note area for comprehensive entry of larger work:

Use 505 tag for structured display of table of contents

Patricia Ratkovich – Innovative Redesign…

Separate records created for the component parts of composite works (“In” Analytics):

Use 773 to trace the component part record to parent record

Harrison – Principles of Internal Medicine

Dyspnea and pulmonary edema in title field

Longo in author field

Analytical Access to Journal Content Decision to not provide analytical access to journal content (i.e., directly to articles) was because of the expense: Excessive number of records would have to be created Additional authority work would need to be done As a result, through the 20 th Century, cataloging and periodical indexing/bibliography creation techniques evolved separate approaches.

Decision to not provide analytical access to journal content (i.e., directly to articles) was because of the expense:

Excessive number of records would have to be created

Additional authority work would need to be done

As a result, through the 20 th Century, cataloging and periodical indexing/bibliography creation techniques evolved separate approaches.

Overview Comparison Catalog: Authority work Cataloging records represents the holdings of a library Periodical indexes: Subject indexes are extensive topical bibliographies (often include books and book chapters, too), usually covering large swaths of “territory” Domain-wide indexes (e.g., Index Medicus) attempt to capture an entire discipline (may include book chapters, too) No single library could ever own all items referred to in exhaustive bibliographies/indexes, thus leading to ILL services Authority work nonexistent (except controlled vocabularies)

Catalog:

Authority work

Cataloging records represents the holdings of a library

Periodical indexes:

Subject indexes are extensive topical bibliographies (often include books and book chapters, too), usually covering large swaths of “territory”

Domain-wide indexes (e.g., Index Medicus) attempt to capture an entire discipline (may include book chapters, too)

No single library could ever own all items referred to in exhaustive bibliographies/indexes, thus leading to ILL services

Authority work nonexistent (except controlled vocabularies)

Surrogate Records in Periodical Databases As is the case with library catalogs, periodical databases contain structured surrogate records. This structuring is fairly consistent across periodical databases, both in terms of stored records (two part metadata model holds) and how records are displayed. There is some authority control at work, but not in ways that you might think.

As is the case with library catalogs, periodical databases contain structured surrogate records.

This structuring is fairly consistent across periodical databases, both in terms of stored records (two part metadata model holds) and how records are displayed.

There is some authority control at work, but not in ways that you might think.

Collocation in Periodical Databases By subject – what about vocabulary control? By author – what about authority control? By journal – what about authority control? By language. By publication type. By date … etc etc.

By subject – what about vocabulary control?

By author – what about authority control?

By journal – what about authority control?

By language.

By publication type.

By date … etc etc.

In all Collocation Contexts: MATCH! Examples: Indexers  author name  match  author name  users Indexers  journal name  match  journal name  users Indexers  vocabulary  match  vocabulary  users The computer is getting a little “smarter:” Misspellings, e.g., http:// www.gogle.com Mapping entry terms to authorized terms of a controlled vocabulary Today: Various controlled vocabularies.

Examples:

Indexers  author name  match  author name  users

Indexers  journal name  match  journal name  users

Indexers  vocabulary  match  vocabulary  users

The computer is getting a little “smarter:”

Misspellings, e.g., http:// www.gogle.com

Mapping entry terms to authorized terms of a controlled vocabulary

Today: Various controlled vocabularies.

Inverted File Structures How surrogate records are physically stored in the index of a database. Each surrogate record has a unique identifier (also called a pointer ). Each word and phrase of the index has a record in the index; each record contains the UI for each surrogate record that contains that word or phrase: Dog: 235 ; 527 ; 5,345,672 ; 117,127,923 Cat: 127 ; 2,753 ; 917,538 ; 327,543,238

How surrogate records are physically stored in the index of a database.

Each surrogate record has a unique identifier (also called a pointer ).

Each word and phrase of the index has a record in the index; each record contains the UI for each surrogate record that contains that word or phrase:

Dog: 235 ; 527 ; 5,345,672 ; 117,127,923

Cat: 127 ; 2,753 ; 917,538 ; 327,543,238

Subject Indexing in Periodical Databases Indexing approach is “information access,” therefore depth indexing is the general rule. Indexers index to the most specific, therefore, hierarchies remain important in controlled vocabularies. Pre-coordination and post-coordination are important concepts.

Indexing approach is “information access,” therefore depth indexing is the general rule.

Indexers index to the most specific, therefore, hierarchies remain important in controlled vocabularies.

Pre-coordination and post-coordination are important concepts.

How is Surrogate Information Stored? Print periodical indexes and bibliographies. Online periodical databases: Examine sample database record for left side metadata elements Examine advanced search interface Examples: PubMed MEDLINE Library Literature ALWAYS KNOW THE START DATE OF YOU ONLINE PERIODICAL DATABASE! Manual search of the literature is often needed for exhaustive searches Retrospective conversion of print indexes to online is not generally undertaken by database providers due to expense

Print periodical indexes and bibliographies.

Online periodical databases:

Examine sample database record for left side metadata elements

Examine advanced search interface

Examples:

PubMed MEDLINE

Library Literature

ALWAYS KNOW THE START DATE OF YOU ONLINE PERIODICAL DATABASE!

Manual search of the literature is often needed for exhaustive searches

Retrospective conversion of print indexes to online is not generally undertaken by database providers due to expense

Periodical Database Characteristics They tend to hold more records than a library catalog. Info packages (i.e., journal articles) contain less information than the info packages in library catalogs and there are no detailed secondary navigation aids such as book indexes. More fields (i.e., left side elements) available for search word qualification. Important to distinguish database producing companies/organizations from database interface companies: Some companies/organizations provide both, e.g., PubMed MEDLINE Other companies provide interface services, such as Dialog or EBSCO

They tend to hold more records than a library catalog.

Info packages (i.e., journal articles) contain less information than the info packages in library catalogs and there are no detailed secondary navigation aids such as book indexes.

More fields (i.e., left side elements) available for search word qualification.

Important to distinguish database producing companies/organizations from database interface companies:

Some companies/organizations provide both, e.g., PubMed MEDLINE

Other companies provide interface services, such as Dialog or EBSCO

UIs in Periodical Databases Common UIs employed in periodical databases: ISSN – uniquely numerical identification for individual serial publications Internal numbering systems within a periodical database (good for whacking the db) The most important UI is pre-Web and that is the “address” of an article in the bibliographic universe (also know as the citation information) – also good for whacking the db: Journal name (or better, but less commonly used, the ISSN) Volume number (occasionally, also, the issue number) First page number

Common UIs employed in periodical databases:

ISSN – uniquely numerical identification for individual serial publications

Internal numbering systems within a periodical database (good for whacking the db)

The most important UI is pre-Web and that is the “address” of an article in the bibliographic universe (also know as the citation information) – also good for whacking the db:

Journal name (or better, but less commonly used, the ISSN)

Volume number (occasionally, also, the issue number)

First page number

Authority Control in Periodical Databases Titles – not controlled. Authors – somewhat controlled: Indexers generally enter author name from the information package Control rests with periodical editors, who often have policies on author names that may be different than other periodical editors Subjects – controlled: Controlled vocabularies are imposed across periodicals and over time by indexers However, subject searching is still subject to the problems associated with the “ Great Pop versus Soda Controversy .”

Titles – not controlled.

Authors – somewhat controlled:

Indexers generally enter author name from the information package

Control rests with periodical editors, who often have policies on author names that may be different than other periodical editors

Subjects – controlled:

Controlled vocabularies are imposed across periodicals and over time by indexers

However, subject searching is still subject to the problems associated with the “ Great Pop versus Soda Controversy .”

Author Indexes in Periodical Databases Examine how author data is entered into surrogate records: Generally taken from the information package in hand PubMed MEDLINE is an exception Some databases will provide lists of author names from which to choose: Indicator of authority work? Library Literature is an example

Examine how author data is entered into surrogate records:

Generally taken from the information package in hand

PubMed MEDLINE is an exception

Some databases will provide lists of author names from which to choose:

Indicator of authority work?

Library Literature is an example

Other Indexes in Periodical Databases A-Z lists of words used in the periodical database. Words other than thesaurus-based subject terms are not controlled: WilsonWeb ( Library Literature ) example EBSCO ( ERIC ) example

A-Z lists of words used in the periodical database.

Words other than thesaurus-based subject terms are not controlled:

WilsonWeb ( Library Literature ) example

EBSCO ( ERIC ) example

Subject Indexes in Periodical Databases Depth indexing: General goal is to provide subject access to the information contained in an article However, this practice is not universal across database producers; therefore, determine the depth of indexing of the database you are searching by examining existing records Examples: PubMed MEDLINE Library Literature Be aware of the lag time related to subject indexing of articles.

Depth indexing:

General goal is to provide subject access to the information contained in an article

However, this practice is not universal across database producers; therefore, determine the depth of indexing of the database you are searching by examining existing records

Examples:

PubMed MEDLINE

Library Literature

Be aware of the lag time related to subject indexing of articles.

Management of Controlled Vocabularies Homonymy: Addressed by domain specificity of most periodical databases Various forms of qualification are used, including parenthetical, hierarchy, and scope notes New concepts: Literary warrant is generally not employed in periodical database vocabularies New terms are added after new concepts have establish themselves in the literature This poses a challenge if you are searching at a “research front” (may need to perform a keyword search strategy of the abstract field)

Homonymy:

Addressed by domain specificity of most periodical databases

Various forms of qualification are used, including parenthetical, hierarchy, and scope notes

New concepts:

Literary warrant is generally not employed in periodical database vocabularies

New terms are added after new concepts have establish themselves in the literature

This poses a challenge if you are searching at a “research front” (may need to perform a keyword search strategy of the abstract field)

MeSH: A Detailed Vocabulary Features of the MeSH Vocabulary. Overview Entry vocabulary MeSH tree structures ( 2006 MeSH tree ) Vocabulary management (year to year with new editions): New descriptors Changed descriptors Deleted descriptors New Descriptors by Tree Subcategory Concept specification (i.e., riding the rails): Qualifiers Qualifiers by Allowable Category Qualifier Hierarchies Publication types .

Features of the MeSH Vocabulary.

Overview

Entry vocabulary

MeSH tree structures ( 2006 MeSH tree )

Vocabulary management (year to year with new editions):

New descriptors

Changed descriptors

Deleted descriptors

New Descriptors by Tree Subcategory

Concept specification (i.e., riding the rails):

Qualifiers

Qualifiers by Allowable Category

Qualifier Hierarchies

Publication types .

MeSH Tools Print: Annotation MeSH Tree Structures Permuted MeSH Online: NLM MeSH Browser PubMed MeSH Database

Print:

Annotation MeSH

Tree Structures

Permuted MeSH

Online:

NLM MeSH Browser

PubMed MeSH Database

Other Controlled Vocabulary Examples ERIC: EBSCO example Compare thesaurus with descriptor index Library Literature: WilsonWeb example Compare thesaurus with descriptor index

ERIC:

EBSCO example

Compare thesaurus with descriptor index

Library Literature:

WilsonWeb example

Compare thesaurus with descriptor index

Indexing in Context Obtain information package. Describe information package in surrogate record. Subject analyze information package in surrogate record: Verbal Classification

Obtain information package.

Describe information package in surrogate record.

Subject analyze information package in surrogate record:

Verbal

Classification

Indexing Process Two steps: Analyze information package to generate list of candidate concepts that describe its subject content Translate those concepts into the controlled vocabulary of the database ISO Standard for article indexing – special attention should be paid to certain sources of information: Title Abstract (when provided) Introduction; opening and concluding paragraphs Illustrations, diagrams, etc and their captions Words or groups of words that are underlined, bold, etc

Two steps:

Analyze information package to generate list of candidate concepts that describe its subject content

Translate those concepts into the controlled vocabulary of the database

ISO Standard for article indexing – special attention should be paid to certain sources of information:

Title

Abstract (when provided)

Introduction; opening and concluding paragraphs

Illustrations, diagrams, etc and their captions

Words or groups of words that are underlined, bold, etc

Other Common Controlled Vocabularies Art and Architecture Thesaurus: Union List of Artist Names (search "van Gogh") Thesaurus of Geographic Names (compare "Soviet Union" and "Russia") Subject Terms (search "cubist") Alzheimer's Disease Bibliographic Database Thesaurus Dublin Core: Specification of subject element DC Vocabulary Qualifiers

Art and Architecture Thesaurus:

Union List of Artist Names (search "van Gogh")

Thesaurus of Geographic Names (compare "Soviet Union" and "Russia")

Subject Terms (search "cubist")

Alzheimer's Disease Bibliographic Database Thesaurus

Dublin Core:

Specification of subject element

DC Vocabulary Qualifiers

Other Contexts for Human Indexing A-Z Web Indexes: NIH Health Information

A-Z Web Indexes:

NIH Health Information