WGBH Open Vault
New Collections and Features
Open Vault

Shifting Technology
•
•
•
•

Using WordPress
Promotion Using Blog
Social Media
Streamlined Workflow

© 2013 WG...
New Collections

Rock & Roll

© 2013 WGBH

The Advocates

3

War and Peace
In the
Nuclear Age
Digitized Tapes

© 2013 WGBH

4
Posting Full Interviews

Benefits
• Full Interviews
• Sync-able Transcript
• Providing Access

© 2013 WGBH

5

Challenges
...
Rock and Roll

166 Interview Tapes and Transcripts
© 2013 WGBH

6
Rock and Roll

7

Transcripts
•
•
•
•

© 2013 WGBH

Floppy Disks
Convert to XML
Fix Glitches
Add Metadata
Rock and Roll

Interviews
•
•
•
•
•
•

Shot on Film
Betacam Transfers
Digitize
Preserve
Sync to Transcript
Stream

© 2013 ...
Rock and Roll

Editing Content
•
•
•
•

Check Paperwork
Edit
Re-Sync
Add New Metadata

© 2013 WGBH

9
The Advocates

62 Complete
Programs
© 2013 WGBH

10
The Advocates

11

Transcripts
•
•
•
•
•

© 2013 WGBH

Archived Paper Copies
Scanned
Conversion Software
Convert to XML
Ad...
The Advocates

Programs
•
•
•
•
•

Relevant Topics
Length of Programs
Longer Transcripts
Larger Files
Third Party Footage
...
The Advocates

Most Viewed Programs
• Should Marriage Between Homosexuals Be Permitted?

13

Views
781

• Should The Feder...
The Advocates

Promotion
• Current Events
• idebate.org
• Presidential Election

© 2013 WGBH

14
War and Peace in the Nuclear Age

© 2013 WGBH

328 Interviews and Transcripts
28 Hours of B-Roll Footage
147 Stock Footage...
War and Peace in the Nuclear Age

Challenges
•
•
•
•

Merging Video
Extremely Large Files
Editing Content
“Off Record”

© ...
War and Peace in the Nuclear Age

Transcripts
• Unprocessed Paper
• 1986 – 1989
• Production Copies

© 2013 WGBH

17
War and Peace in the Nuclear Age
Paper to synced transcript
Overview
•ABBYY FineReader OCR
•PDF to RTF
•RTF to clean DOC
•...
War and Peace in the Nuclear Age

19

OCR cleanup

RTF
© 2013 WGBH
War and Peace in the Nuclear Age
Normalizing documents
First pass

DOC

© 2013 WGBH

•Merge interview pieces
•More OCR cle...
War and Peace in the Nuclear Age

21

TEI conversion

TEI

Second Pass
•In-depth checking names,
acronyms, terms, etc.
•Mo...
War and Peace in the Nuclear Age

22

SMIL sync tool

https://github.com/cbeer/ave-sync
© 2013 WGBH
War and Peace in the Nuclear Age

23

SMIL, synced

TEI +
SMIL

© 2013 WGBH
War and Peace in the Nuclear Age
Synced transcript
Results
•Full-text search of every transcript
• Across Open Vault
• Wit...
War and Peace in the Nuclear Age

Using Descriptions to
Make Media More Accessible
• High level of description
• Relevant ...
War and Peace in the Nuclear Age

Scholarly Advisor
Malcolm Byrne
Deputy Director of the National Security Archive
George ...
War and Peace in the Nuclear Age

© 2013 WGBH

27
War and Peace in the Nuclear Age

Summaries
• Cover the points
• Capture the tone
• Highlight uniqueness

© 2013 WGBH

28
War and Peace in the Nuclear Age

© 2013 WGBH

29
War and Peace in the Nuclear Age

© 2013 WGBH

30
War and Peace in the Nuclear Age

Chapter Headings
• Broad topic areas
• Within the scope of the
interview
• Don’t sweat t...
War and Peace in the Nuclear Age

© 2013 WGBH

32
War and Peace in the Nuclear Age

© 2013 WGBH

33
War and Peace in the Nuclear Age

Subject Heading
• Events, Topics, People,
and Organizations
• LOC Authority headings
• R...
Mellon

The Andrew W. Mellon Foundation

Digitizing & Providing Scholarly Access
to Over 157 Hours of Content
© 2013 WGBH
...
Mellon

Goals
•
•

Launch Catalog
On Demand Digitization
and Transcription
• Incorporation of User
Generated Metadata
• Cu...
Mellon

37

Goals
•
•

Launch Catalog
On Demand Digitization
and Transcription
• Incorporation of User
Generated Metadata
...
Mellon

38

Goals
•
•

Launch Catalog
On Demand Digitization
and Transcription
• Incorporation of User
Generated Metadata
...
Mellon

39

Goals
•
•

Launch Catalog
On Demand Digitization
and Transcription
• Incorporation of User
Generated Metadata
...
Mellon
•

•

•

Solicit Participation
- H-Net.org: Humanities and Social Sciences Online
H-NewEngland: New England History...
Mellon
•

•
•

Elements of a Collection
- Introduction
- Article
- One Audio-Visual Media Item
- Biography
- Links to Rela...
Mellon

42

Joyce Chen Cooks
•Starred Joyce Chen, a Boston local chef & restaurateur
•Produced by WGBH in 1966
•26 Episode...
Mellon

43

Museum Open House
•Starred Russell Connor
•Co-Produced by the MFA and WGBH for multiple seasons: 1963 – 1966+
...
Mellon

44

Erica
•Starred Erica Wilson
•Produced by WGBH for two seasons
•Season 1: 1971 with 26 episodes
•Season 2: 1975...
Mellon
Poetry from M.I.T.
•Produced by M.I.T. and broadcast by WGBH 1962-1963
•There were 9 poets featured: Robert Penn Wa...
Thank You
openvault.wgbh.org
@wgbharchives
facebook.com/wgbharchives
Upcoming SlideShare
Loading in …5
×

WGBH Open Vault AMIA 2013

2,046 views

Published on

WGBH Media Library and Archives Open Vault PowerPoint presentation from AMIA 2013.

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,046
On SlideShare
0
From Embeds
0
Number of Embeds
17
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Binder holes to giant letter Os
  • Doesn’t that just feel better?
  • Once formatted for TEI, check for valid XML. Parser considered incidents like [BACKGROUND COMMENT] spoken text, or didn’t catch them and left them in the middle of paragraphs. had to change tags.
  • Briefly how this works. Runs in browser.
  • Point out where timecode is added
  • Sync points correspond to timecode from last slide
  • WGBH Open Vault AMIA 2013

    1. 1. WGBH Open Vault New Collections and Features
    2. 2. Open Vault Shifting Technology • • • • Using WordPress Promotion Using Blog Social Media Streamlined Workflow © 2013 WGBH 2
    3. 3. New Collections Rock & Roll © 2013 WGBH The Advocates 3 War and Peace In the Nuclear Age
    4. 4. Digitized Tapes © 2013 WGBH 4
    5. 5. Posting Full Interviews Benefits • Full Interviews • Sync-able Transcript • Providing Access © 2013 WGBH 5 Challenges • Locating Material • Rights Issues • Workflow
    6. 6. Rock and Roll 166 Interview Tapes and Transcripts © 2013 WGBH 6
    7. 7. Rock and Roll 7 Transcripts • • • • © 2013 WGBH Floppy Disks Convert to XML Fix Glitches Add Metadata
    8. 8. Rock and Roll Interviews • • • • • • Shot on Film Betacam Transfers Digitize Preserve Sync to Transcript Stream © 2013 WGBH 8
    9. 9. Rock and Roll Editing Content • • • • Check Paperwork Edit Re-Sync Add New Metadata © 2013 WGBH 9
    10. 10. The Advocates 62 Complete Programs © 2013 WGBH 10
    11. 11. The Advocates 11 Transcripts • • • • • © 2013 WGBH Archived Paper Copies Scanned Conversion Software Convert to XML Add Metadata
    12. 12. The Advocates Programs • • • • • Relevant Topics Length of Programs Longer Transcripts Larger Files Third Party Footage © 2013 WGBH 12
    13. 13. The Advocates Most Viewed Programs • Should Marriage Between Homosexuals Be Permitted? 13 Views 781 • Should The Federal Government Subsidize Political Campaigns and Limit Individual Contributions? 469 • Should The Government Drop The Charges Against Daniel Ellsberg? 383 • Should the Law Allow Birth Control Treatment for Teenagers Without Their Parents’ Consent? 320 © 2013 WGBH
    14. 14. The Advocates Promotion • Current Events • idebate.org • Presidential Election © 2013 WGBH 14
    15. 15. War and Peace in the Nuclear Age © 2013 WGBH 328 Interviews and Transcripts 28 Hours of B-Roll Footage 147 Stock Footage Tapes 15
    16. 16. War and Peace in the Nuclear Age Challenges • • • • Merging Video Extremely Large Files Editing Content “Off Record” © 2013 WGBH 16
    17. 17. War and Peace in the Nuclear Age Transcripts • Unprocessed Paper • 1986 – 1989 • Production Copies © 2013 WGBH 17
    18. 18. War and Peace in the Nuclear Age Paper to synced transcript Overview •ABBYY FineReader OCR •PDF to RTF •RTF to clean DOC •Merged DOCs •Text to TEI tool •SMIL sync tool PDF © 2013 WGBH 18
    19. 19. War and Peace in the Nuclear Age 19 OCR cleanup RTF © 2013 WGBH
    20. 20. War and Peace in the Nuclear Age Normalizing documents First pass DOC © 2013 WGBH •Merge interview pieces •More OCR cleanup • DPCustomMono • TextWrangler + RegEx •Initial spelling, name fixes •Prepare for parsing • Q/A formatting • Paragraph spacing 20
    21. 21. War and Peace in the Nuclear Age 21 TEI conversion TEI Second Pass •In-depth checking names, acronyms, terms, etc. •More reference sources •Change <incident> tags •Well-formed TEI © 2013 WGBH
    22. 22. War and Peace in the Nuclear Age 22 SMIL sync tool https://github.com/cbeer/ave-sync © 2013 WGBH
    23. 23. War and Peace in the Nuclear Age 23 SMIL, synced TEI + SMIL © 2013 WGBH
    24. 24. War and Peace in the Nuclear Age Synced transcript Results •Full-text search of every transcript • Across Open Vault • Within each interview •Hundreds of access points •Search + sync = almost video search Conclusions •Multiple proofreading passes effective •Semi-automated, still labor intensive •Consistent style across collection a challenge Open Vault © 2013 WGBH 24
    25. 25. War and Peace in the Nuclear Age Using Descriptions to Make Media More Accessible • High level of description • Relevant and accurate • Engaging © 2013 WGBH 25
    26. 26. War and Peace in the Nuclear Age Scholarly Advisor Malcolm Byrne Deputy Director of the National Security Archive George Washington University © 2013 WGBH 26
    27. 27. War and Peace in the Nuclear Age © 2013 WGBH 27
    28. 28. War and Peace in the Nuclear Age Summaries • Cover the points • Capture the tone • Highlight uniqueness © 2013 WGBH 28
    29. 29. War and Peace in the Nuclear Age © 2013 WGBH 29
    30. 30. War and Peace in the Nuclear Age © 2013 WGBH 30
    31. 31. War and Peace in the Nuclear Age Chapter Headings • Broad topic areas • Within the scope of the interview • Don’t sweat the small stuff © 2013 WGBH 31
    32. 32. War and Peace in the Nuclear Age © 2013 WGBH 32
    33. 33. War and Peace in the Nuclear Age © 2013 WGBH 33
    34. 34. War and Peace in the Nuclear Age Subject Heading • Events, Topics, People, and Organizations • LOC Authority headings • Represented across the collection © 2013 WGBH 34
    35. 35. Mellon The Andrew W. Mellon Foundation Digitizing & Providing Scholarly Access to Over 157 Hours of Content © 2013 WGBH 35
    36. 36. Mellon Goals • • Launch Catalog On Demand Digitization and Transcription • Incorporation of User Generated Metadata • Curated Collections © 2013 WGBH 36 Challenges  Incorporation of text only records  Search functionality for records with limited metadata  Programs vs. Assets
    37. 37. Mellon 37 Goals • • Launch Catalog On Demand Digitization and Transcription • Incorporation of User Generated Metadata • Curated Collections © 2013 WGBH Challenges     Request Guidelines Transaction Process Program Rights Restrictions Cost & Sustainability
    38. 38. Mellon 38 Goals • • Launch Catalog On Demand Digitization and Transcription • Incorporation of User Generated Metadata • Curated Collections © 2013 WGBH Challenges       Participant Requirements Available Fields Data Addition or Substitution Tracking Changes Approval Process Crediting System
    39. 39. Mellon 39 Goals • • Launch Catalog On Demand Digitization and Transcription • Incorporation of User Generated Metadata • Curated Collections © 2013 WGBH Challenges       Solicit Participation Access to Catalog Access to Audio-Visual Materials Elements of a Collection Rights Clearance Advisory Process
    40. 40. Mellon • • • Solicit Participation - H-Net.org: Humanities and Social Sciences Online H-NewEngland: New England History and Culture H-Afro-Amer: African American Studies H-Women: Women’s History H-Animal: Animal Studies Access to the Catalog - Archival Visits when possible - Research done by staff Access to Audio Visual Materials - Watermarked Video - DVD/CD loan system © 2013 WGBH 40
    41. 41. Mellon • • • Elements of a Collection - Introduction - Article - One Audio-Visual Media Item - Biography - Links to Related Media - Metadata & Summaries Rights Clearance Advisory Process - Scholar Selected - Paid - Submission of edits and questionnaires - Optional Revision Period © 2013 WGBH 41
    42. 42. Mellon 42 Joyce Chen Cooks •Starred Joyce Chen, a Boston local chef & restaurateur •Produced by WGBH in 1966 •26 Episodes Senior Collection Curator: Dana Polan •Doctorat d’Etat in Letters from the Sorbonne Nouvelle •Ph.D. in Modern Thought from Stanford. •Professor of Cinema Studies in the Tisch School of the Arts at NYU. •Author of 8 books in film and media, including, most recently, Julia Child's The French Chef Curated Collection Topic: •Joyce Chen came along after the success of the French Chef with Julia Child. Though different in personality, both set out to mediate foreign food for American palates and they enable us to pinpoint the regularities in cooking pedagogy at the time.
    43. 43. Mellon 43 Museum Open House •Starred Russell Connor •Co-Produced by the MFA and WGBH for multiple seasons: 1963 – 1966+ Invitation to Art •Starred Brian O’Doherty •Co-Produced by the MFA and WGBH for multiple seasons: 1959 – 1960+ Bengtz on Drawling •Starred Ture Bengtz •Co-Produced by the MFA and WGBH in 1958 Collection Curator: Museum of Fine Arts, Boston •Est. July 4, 1876 •One of the most comprehensive art museums in the world with a collection encompassing nearly 450,000 works of art.
    44. 44. Mellon 44 Erica •Starred Erica Wilson •Produced by WGBH for two seasons •Season 1: 1971 with 26 episodes •Season 2: 1975-1976 with 13 episodes Collection Curator: Amanda Grace Sikarskie •Ph.D Michigan State University •Adjunct Assistant Professor: Museum Studies Program at Michigan State University •Adjunct Assistant Professor: Dept. of History at Western Michigan University •Research Associate with the Quilt Index: online archive for images & metadata of over 60,000 quilts Curated Collection Topic: •Explores Erica Wilson’s work, legacy and her tremendous impacts both on needlework and on public television.
    45. 45. Mellon Poetry from M.I.T. •Produced by M.I.T. and broadcast by WGBH 1962-1963 •There were 9 poets featured: Robert Penn Warren, Mark Van Doren, Richard Wilbur, Robert Graves, John Ciardi, David Ferry, Denise Levertov, Theodore Weiss & X.J. Kennedy Collection Curator: Jim Cocola •Ph.D. in English from the University of Virginia •Assistant Professor of Literature, Film, and Media: Dept. of Humanities & Arts at Worcester Polytechnic Institute •His essays have appeared and are forthcoming in College English, College Literature, Discourse, the Minnesota review, n+1, •SEL: Studies in English Literature 1500-1900 and The Worcester Review. Curated Collection Topic: •These media events occurred during the collision between American poetry and an increasingly scientifically-oriented public culture. In this setting, poets took up the rare opportunity to speak as poets, on behalf of poetry, while confronting one of the primary seats of science and technology. 45
    46. 46. Thank You openvault.wgbh.org @wgbharchives facebook.com/wgbharchives

    ×