This document discusses NewsScape, an archive of international television news maintained by UCLA. It contains over 196,000 news program recordings from over 20 sources captured since 2010. Programs are digitized, analyzed, and indexed with closed captions and images to enable search and access. The archive aims to further teaching, research, and publication through an expanding collection of television news content and tools for multi-modal analysis. Key challenges addressed include obtaining and providing access to copyrighted news content while staying within fair use guidelines.

1. UCLA NewsScape: The Archive of
International Television News
A Transformative Approach to Using the News
in Teaching, Research, and Publication
Sharon E. Farb
Todd Grappone
Add slideshare link UCLA

2. What is NewsScape? A UCLA Broadcast
(and more) News Archive
• Expanding archive of over 196,000 distinct recordings
of news programs captured and digitized
• Searching of program-level metadata as well as actual
program content, utilizing the more than 1.1 billion
words of closed-caption texts, as well as on-screen
texts, detected visual shapes, and other attributes of
the audiovisual stream
• Over 11 Billion Images
– 44 million snapshot images, taken once every 10 seconds
to aid in visual navigation of each recording
• Grows at about 1TB per month

3. It all starts with the mission…
UC Policy on Copyright Ownership
 Section I.
 Preamble
 “The creation of copyrighted works is one of the ways the University
fulfills its mission of contributing to the body of knowledge for the
public good. The University encourages the creation of original works of
authorship and the free expression and exchange of ideas.”
 http://www.universityofcalifornia.edu/copyright/systemwide/pcoi.html
Intellectual Property in the Digital Age
Series

4. The Mission of Higher Education
• 4 Principles (Pelikan, 1992)
• The advancement of knowledge through research
• The extension of knowledge through teaching
• The preservation of knowledge in libraries, galleries and
museums
• The diffusion of knowledge through scholarly publication
• Jaroslav Pelikan, The Idea of the University: A Reexamination, 1992
CLIR Postdoctoral Fellows 2008

5. UCLA TV News Archive Infrastructure
Web Searching & browsing
Account Access
server control serve Playback requests Users
r
Audio
and
video
Search
index &
DB
Scheduler
Capture Authorized
videos
Encoder Requests
Encoded Low-
video
latency Streaming
storage Videos server
Snapshots
Analysis
scripts
Remote High-
backup Mirroring capacity
storage

6. Sources of TV news videos
Terrestrial
broadcast,
cable, or
satellite TV
signal.
Contains
video, audio
and closed
captioning
streams.

7. Video capture scheduling and monitoring
Audio
and
video
Scheduler
Capture
Scheduler interface to select programs for recording

8. Video capture, encoding, and storage
Audio
and
video
Raw ATSC video (approx. 60-70 GB/hour)
compressed to
Scheduler
Capture H.264 448x336, AAC at 96 Kbps (250 MB/hour)
Encoder
Encoded Low-
video
latency Isilon X200
storage network-attached
Snapshots
Analysis disk storage array
scripts
Images taken at 10-second intervals to enable visual navigation

9. Metadata updates
TOP|20110204130001|2011-02-
04_0500_KCET_BBC_World_News
COL|Communication Studies Archive, UCLA
UID|d9149328-3062-11e0-8555-001517add60e
Audio DUR|0:29:49.48
and
video
Search
The Apache Solr search index
index &
is updated in real-time
DB
Scheduler
Capture
CC1|20110204130013|>> THIS IS "BBC WORLD NEWS."
CC1|20110204130016|FUNDING FOR THIS PRESENTATION
Encoder CC1|20110204130018|IS MADE POSSIBLE BY THE FREEMAN
CC1|20110204130023|FOUNDATION OF NEW YORK, STOWE,
Encoded Low-
videoCC1|20110204130024|VERMONT, AND HONOLULU.
latency
CC1|20110204130027|NEWMAN'S OWN FOUNDATION.
storage
CC1|20110204130028|THE JOHN D. AND CATHERINE T.
CC1|20110204130029|MACARTHUR FOUNDATION.
Snapshots
Analysis
CC1|20110204130030|AND UNION BANK.
scripts CC1|20110204130058|>> AND NOW, "BBC WORLD NEWS."
CC1|20110204130104|>> EGYPT'S PROTESTERS CALL THIS
CC1|20110204130110|THE DAY OF DEPARTURE.
CC1|20110204130111|THEY WANT THE PRESIDENT TO STEP
CC1|20110204130113|DOWN IMMEDIATELY.

10. Video data backup
Audio
and
video
Search
index &
DB
Scheduler
Capture
Encoder
Encoded Low-
video
latency
storage
Snapshots
Analysis
scripts
Remote High-
backup Mirroring capacity
storage

11. User interaction and video selection
Web Searching & browsing
serve Users
r
Audio
and
video
Search
index &
DB
Scheduler
Capture Authorized
videos
Encoder
Encoded Low-
video
latency
storage
Snapshots
Analysis
scripts
Remote High-
backup Mirroring capacity
storage

12. Archive search interface

13. User authentication and video viewing
Web Searching & browsing
Account Access
server control serve Playback requests Users
r
Audio
and
video
Search
index &
DB
Scheduler
Capture Authorized
videos
Encoder Requests
Encoded Low-
video
latency Streaming
storage Videos server
Snapshots
Analysis
scripts
Remote High-
backup Mirroring capacity
storage

14. Search results and video playback interface

15. What is news, n. ?*
• New things; novelties. Obs.
• The report or account of recent (esp. important or
interesting) events or occurrences, brought or coming
to one as new information; new occurrences as a
subject of report or talk; tidings.
• With sing. concord. Now esp. such information as
published or broadcast.
• As predicate: a person, thing, or place regarded as
worthy of discussion or of reporting by the media.
* Oxford English Dictionary Online

17. All material must be used within Title 17 USC 108 (f) (3)
Core Collection:
ABC, CBS, NBC, CNN,
Fox News, special
news such as
Watergate, 9/11, etc
Loan requests receive
DVDs
Fees are charged to
cover costs

18. Section 108 Study Group Report Executive
Summary Television News Exemption
• The television news exemption should be amended
to allow libraries and achieves to transmit view-only
copies of television news programs electronically by
streaming and similar technologies to other section
108 eligible libraries and archives for purposes of
private study, scholarship, or research under certain
conditions, and after a reasonable period has passed
since the original transmission.
• Any amendment should not include an exception
permitting libraries and archived to transmit
downloadable copies.

19. Internet Archive: Search
and DVD Borrowing
350,000 news programs collected over
3 years from national U.S. networks
and stations in San Francisco and
Washington D.C.
The archive is updated with new
broadcasts 24 hours after they are
aired.
21 Networks

20. Fair Use: Tranformativeness
Beyond Vanderbilt
4 Factors 17 USC 107 Transformativeness
• The purpose and character • Did the unlicensed use
of the use “transform” the
• The nature of the copyrighted material by
copyrighted work using it for a different
• The amount and purpose?
substantiality of the • Was the amount and
portion used nature of the material used
• The effect of the use on the appropriate?
market or value of the
copyrighted work

21. UCLA Transformativeness
Post Capture Processing
• Selection of sources useful
in teaching and research
• Video capture
• Metadata updates
• Archive search
• Tool development
• Etc
• etc

22. NewsScape as a research archive
Mixing with other digital collections.

23. Use in Research/Best Practices
• Use Cases news archive in teaching and research
• Multi-modal research and teaching
• Comparative studies
• Using copyrighted material as the object of a
social, political, or cultural critique
• Using copyrighted material for illustration or
example
• Capturing copyrighted material incidentally or
accidentally
• Capturing, Reproducing, to memorlize or
preserve

25. • “Libraries of all kinds during the centuries of their existence have
had a common objective—one so generally accepted that it is
seldom made explicit. It is the conservation and organization of
the world’s resources of recorded thought and fact so as to make
them available for present and future users.”
• Robert D. Leigh, The Public Library in the United States, 1950

26. THANK YOU!
Contact:
Sharon E. Farb
farb@library.ucla.edu
Todd Grappone
grappone@library.ucla.edu

27. References
• 17 USC 107
• 17 USC 108
• Bill Graham Archives v. Dorling Kindersley Limited (2nd Cir. 2006)
448 F. 3d. 605
• Code of Best Practices in Fair Use for Online Video—Center for
Social Media
• Code of Best Practices in Fair Use for Academic and Research
Libraries
• Library Copyright Alliance Brief on Streaming of Films for
Educational Purposes
• Jaszi, Peter. Reclaiming Fair Use, University of Chicago Press,
2011
• Netanel, Neil W., Making Sense of Fair Use. Lewis & Clark Law
Review, Vol. 15; UCLA School of Law