All About rNews - Evan Sandhaus

rNews
Embedded Data For
The News Industry

Prepared By
Evan Sandhaus

For
The New York
Semantic Web Meetup
1

Agenda

 Why we need semantic markup.
 The Key Technologies
• RDF - Resource Description Framework
• RDFa - Resource Description Framework in Attributes
 rNews
• Class Diagram
• Classes & Properties
• Simple Example
 Call To Action
 Discussion

2

Why we need
Semantic
Markup
The Burning Question

The Problem of Structured Data
 Modern Web Sites
Built with 3 Tier
Display
Architecture
• Data Tier: Database
Tier
Where Content Lives.
• Presentation Tier:
HTML Document that is
sent to user.
• Logic Tier: Software
Logic
that reads from the Data
Tier and outputs the Tier
Presentation Tier.

Data
Tier
4

Linked Data

Data Tier Logic Tier Display Tier

Label Type Value <html>
<head>
id number 1248069162607 <title>
New Web Code Draws Concern...
Headline text New Web Code Draws Concern...
</title>
Byline text By TANZINA VEGA </head>
<body>
Date date 20101010
<div>
Body text In the next few years, a powerful... New Web Code Draws Concern...
</div>
Length number 1123
<div>
Tag text Privacy By TANZINA VEGA
</div>
Tag text Computers and the Internet
<div>
Tag text Web Browsers October 10, 2010
</div>
<div>
In the next few years, a powerful...
</div>
</body>
 Content very well structured on Data </html>

Tier, but all of this structure is lost in
translation to presentation tier.

5

Linked Data

<html>
Display Tier ?
<head>
<title>
</title>
</head>
<body>
<div>

=
</div>
<div>
By TANZINA VEGA
</div>
<div>
 Search engines, social
October 10, 2010 networks, aggregators and
</div>
<div> other sites only see the
In the next few years, a powerful...
</div> Display Tier, and cannot
</body>
</html>
leverage the underlying
structure of the data.

6

Linked Data

With Structured
Data
No Structured
Data

 Without structured data search engines, social
networks and other sites cannot attractively format
links back to our site, potentially decreasing referral
traffic.

7

The Case of the Missing Structured
Data

 How do we solve it?
 Two major approaches:
• Microformats - Tomorrow
• RDF/RDFa - Coming Right up

8

RDF

 The Resource Description Framework is a data
model for expressing (almost) any concept in the
world.
 Developed to Facilitate
• Data portability and interoperability
• Deep reasoning
 W3C Recommendation
 Represents concepts as “graphs” of triples

Deputy
Director
Schema
Standards

Person
Stuart
Myles

The
Associated
Press
Deputy
Director
Schema
Standards

Person
Stuart
Myles

The
Associated
Press
Deputy
Director Manhattan,
Schema New York
Standards

Person
Stuart
Myles

The
Associated
Press
Deputy
Director Manhattan,
Schema New York
Standards

Person
Stuart Northeastern
United States
Myles

The
Associated
Press
Deputy
Director Manhattan,
Schema New York
Standards

Person
Stuart Northeastern
United States
Myles

xxx@ap.org

The
Associated
Press
Deputy
Director Manhattan,
Schema New York
Standards

Person
Stuart Northeastern
United States
Myles

xxx@ap.org

@mr_awesome

The
Associated
Press
Deputy
Director Manhattan,
Schema New York
Standards

Person
Stuart Northeastern
United States
Myles

http:// xxx@ap.org
facebook.com/
stuart_myles

@mr_awesome

RDF - The True Nature of A Triple

Stuart
Subject
Myles

Verb

Object @mr_awesome

12


Stuart http://www.iptc.org/authority/per/
Subject
Myles stuart_myles

Verb

Object @mr_awesome

12


Subject
Myles stuart_myles

Verb http://www.iptc.org/demo/ns/twitterHandle

Object @mr_awesome

12


Subject
Myles stuart_myles

Verb http://www.iptc.org/demo/ns/twitterHandle

Object @mr_awesome “@mr_awesome”

12

RDF - Compact URIs (CURIs)

http://www.iptc.org/demo/ns/twitterHandle
+
demo = <http://www.iptc.org/demo/ns/>
=
demo:twitterHandle

13


Stuart
Subject
Myles

Verb

Object @mr_awesome

14


Stuart http://iptc.org/authority/per/stuart_myles
Subject
Myles

Verb

Object @mr_awesome

14


Subject
Myles

Verb demo:twitterHandle

Object @mr_awesome

14


Subject
Myles

Verb demo:twitterHandle

Object @mr_awesome “@mr_awesome”

14

The
Associated
Press
Deputy
Director Manhattan,

demo:worksFor
Schema New York
Standards
n
de edI
c at
m o
o: c eL
is ffi
A o
o:
m
de

http://
rdf:type demo:residesIn
demo: www.iptc.org/ Northeastern
person authority/per/ United States

stuart_myles
de
m
o:
em
s
eA

ai

demo:twitterHandle
lA
am

dd
l:s

re
ow

ss

http:// xxx@ap.org
facebook.com/
stuart_myles

@mr_awesome

RDF Triple Types

Data Triple Object Triple

http:// http://
www.iptc.org/ www.iptc.org/
authority/per/ authority/per/
stuart_myles stuart_myles
demo:twitterHandle

owl:sameAs
http://
@mr_awesome facebook.com/
stuart_myles

Literal URI

16

RDF - Writing it All Down

 Remember - RDF is a data model not a file format.
 Several file formats for serializing RDF
• Turtle
• N-Triples
• RDF/XML

17

RDF - Turtle

@prefix demo: <http://www.iptc.org/demo/ns/> .
@prefix owl: <http://www.w3.org/2002/07/owl#> .
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .

<http://iptc.org/authority/per/stuart_myles> a demo:person ;
demo:emailAddress "xxx@ap.org" ;
demo:hasTitle "Deputy Director Schema Standards" ;
demo:officeLocatedIn "Manhattan, NY" ;
demo:residesIn "Northeastern United States" ;
demo:twitter_handle "@mr_awesome" ;
demo:worksFor "Associated Press" ;
owl:sameAs <http://facebook.com/stuart_myles> .

18

RDF - RDF/XML

<?xml version="1.0" encoding="UTF-8"?>
<rdf:RDF
xmlns:demo="http://www.iptc.org/demo/ns/"
xmlns:owl="http://www.w3.org/2002/07/owl#"
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
>
<rdf:Description rdf:about="http://iptc.org/authority/per/stuart_myles">
<rdf:type rdf:resource="http://www.iptc.org/demo/ns/person"/>
<demo:hasTitle>Deputy Director Schema Standards</
demo:hasTitle>
<demo:worksFor>Associated Press</demo:worksFor>
<demo:officeLocatedIn>Manhattan, NY</demo:officeLocatedIn>
<demo:residesIn>Northeastern United States</demo:residesIn>
<demo:emailAddress>xxx@ap.org</demo:emailAddress>
<demo:twitter_handle>@mr_awesome</demo:twitter_handle>
<owl:sameAs rdf:resource="http://facebook.com/stuart_myles"/>
</rdf:Description>
</rdf:RDF> 19

RDFa - Resource Description
Framework in Attributes

 In theory RDF is a flexible extensible format for
expressing and sharing knowledge.
 Problem with the theory - The Web shares
“knowledge” using HTML.
 Solution: RDFa - a W3C standard for embedding
RDF triples within standard HTML documents.

+ <HTML/> = RDFa

20

RDFa - Facts

 Embed structured data into HTML by extending
HTML standard by overloading and introducing
attributes.
• overloaded attributes: src, href, rel, rev
• new attributes: about, content, typeof
 Format used by Facebook for open graph.
 RDFa distillers extract structured data from HTML
as RDF.

21

RDFa In Action - Stuart’s Sad
Homepage

22

Homepage
<!DOCTYPE
html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
<head>...</head>
<body>
<div class="profile">
<p>Stuart Myles</p>
<p>Title: <span>Deputy Director Schema Standards</span></p>
<p>Employer: <span>Associated Press</span></p>
<p>Office Located In: <span>Manhattan, NY</span></p>
<p>Resides In: <span>Northeastern United States</span></p>
<p>Email Address: <span>xxx@ap.org</span></p>
<p>Twitter Handle: <span>@mr_awesome</span></p>
<p><a href="http://facebook.com/stuart_myles">Facebook</a></p>
</div>
</body>
</html>

23

Homepage
<!DOCTYPE

html PUBLIC "-//W3C//DTD XHTML+RDFa 1.0//EN"

"http://www.w3.org/MarkUp/DTD/xhtml-rdfa-1.dtd">
<html>
<head>...</head>
<body>
<p>Stuart Myles</p>
</div>
</body>
</html>

24

Homepage
<!DOCTYPE
<html

xmlns="http://www.w3.org/1999/xhtml"


xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns"

xmlns:demo="http://www.iptc.org/demo/ns/" >
<head>...</head>
<body>
<p>Stuart Myles</p>
</div>
</body>
</html>
25

RDFa In Action - Stuart’s Sad http://
www.iptc.org/
Homepage authority/per/
stuart_myles

<!DOCTYPE
<html



xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns"

<head>...</head>
<body>
<div class="profile" about="http://iptc.org/authority/per/stuart_myles">
<p>Stuart Myles</p>
</div>
</body>
</html>
26

www.iptc.org/
stuart_myles

<!DOCTYPE

demo:hasTitle
<html
xmlns:owl="http://www.w3.org/2002/07/owl#" Deputy
Director
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns" Schema
xmlns:demo="http://www.iptc.org/demo/ns/" > Standards

<head>...</head>
<body>
<p>Stuart Myles</p>
<p>Title: <span property="demo:hasTitle">Deputy Director Schema Standards</span></p>
</div>
</body>
</html> 27

www.iptc.org/
stuart_myles

demo:worksFor
<!DOCTYPE
<html
Associated
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns" Press
<head>...</head>
<body>
<p>Stuart Myles</p>
<p>Employer: <span property="demo:worksFor">Associated Press</span></p>
</div>
</body>
</html> 28

www.iptc.org/
stuart_myles

demo:officeLocatedIn
<!DOCTYPE
<html
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns" Manhattan, NY

<head>...</head>
<body>
<p>Stuart Myles</p>
<p>Office Located In: <span property="demo:ofﬁceLocatedIn">Manhattan, NY</span></p>
</div>
</body>
</html> 29

www.iptc.org/
stuart_myles

<!DOCTYPE

demo:residesIn
<html
Northeastern
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns" United States
<head>...</head>
<body>
<p>Stuart Myles</p>
<p>Office Located In: <span property="demo:officeLocatedIn">Manhattan, NY</span></p>
<p>Resides In: <span property="demo:residesIn">Northeastern United States</span></p>
</div>
</body>
</html> 30

www.iptc.org/
stuart_myles

demo:emailAddress
<!DOCTYPE
<html
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns" xxx@ap.org

<head>...</head>
<body>
<p>Stuart Myles</p>
<p>Email Address: <span property="demo:emailAddress">xxx@ap.org</span></p>
</div>
</body>
</html> 31

www.iptc.org/
stuart_myles

demo:twitterHandle
<!DOCTYPE
<html
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns" @mr_awesome

<head>...</head>
<body>
<p>Stuart Myles</p>
<p>Twitter Handle: <span property="demo:twitter_handle">@mr_awesome</span></p>
</div>
</body>
</html> 32

www.iptc.org/
stuart_myles

<!DOCTYPE

owl:sameAs
<html
xmlns:owl="http://www.w3.org/2002/07/owl#" http://
www.facebook.
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns" com/
xmlns:demo="http://www.iptc.org/demo/ns/" > stuart_myles

<head>...</head>
<body>
<p>Stuart Myles</p>
<p><a rel="owl:sameAs" href="http://facebook.com/stuart_myles">Facebook</a></p>
</div>
</body>
</html> 33

www.iptc.org/
stuart_myles

<!DOCTYPE

rdf:type
<html
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns" demo:person

<head>...</head>
<body>
<div typeof="demo:person" class="profile" about="http://iptc.org/authority/per/stuart_myles">
<p>Stuart Myles</p>
<p><a rel="owl:sameAs" href="http://facebook.com/stuart_myles">Facebook</a></p>
</div>
</body>
</html> 34

Homepage
<HTML+RDFa/>

RDFa
distiller

35

Homepage
<?xml version="1.0" encoding="UTF-8"?>
<rdf:RDF
xmlns:demo="http://www.iptc.org/demo/ns/"
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
>
<rdf:Description rdf:about="http://iptc.org/authority/per/stuart_myles">
<rdf:type rdf:resource="http://www.iptc.org/demo/ns/person"/>
<demo:hasTitle>Deputy Director Schema Standards</
demo:hasTitle>
<demo:worksFor>Associated Press</demo:worksFor>
<demo:officeLocatedIn>Manhattan, NY</demo:officeLocatedIn>
<demo:residesIn>Northeastern United States</demo:residesIn>
<demo:emailAddress>xxx@ap.org</demo:emailAddress>
<demo:twitter_handle>@mr_awesome</demo:twitter_handle>
<owl:sameAs rdf:resource="http://facebook.com/stuart_myles"/>
</rdf:Description>
</rdf:RDF> 36

rNews - Timeline

 September 2010 - rNews proposed to IPTC at fall
meeting
 March 2011 - rNews draft version 0.1 approved by
IPTC at summer meeting.
 March - May 2011 - IPTC solicits feedback on draft
standard.
 June 2011 - IPTC to vote on revised standard at
summer meeting
 June - September - Implementation testing of
rNews.
 September - Final vote on rNews
38

rNews - Class Diagram
TickerSymbol Person Location

subclassOf subclassOf
hasTickerSymbol


Concept
Organization Party
createdBy
Article
createdBy
providedBy taggedBy
copyrightedBy
hasSource
contributedBy
hasAccountableParty

Comment discussedBy subclassOf

depictedBy
NewsItem
Media
Headline

Hed headlinedBy subclassOf

39

rNews - News Item

NewsItem

dateCreated
copyrightNoticeUri
dateModified
genre
description
genreUri
language
guid
thumbnailUri
version
title
commentCount
usageTerms
commentCountURI
usageTermsUri
discussionUri
copyrightNotice

40

rNews - Article

body printEditionUri
dateline printPage
printColumn printSection
printDesk section
printDeskUri sectionUri
printEdition wordCount

41

rNews - Media

mediaType
mediaTypeUri
encoding
height
transcript
transcriptUri
width

42

rNews - Headline

Headline

Hedheadline
headlineType
headlineTypeUri

43

rNews - Comment

Comment

commentText
commentTime
replyToUri

44

rNews - Tag, Party, Person,
Organization, Location

additionalName honorificSuffix latitude
givenName lastName longitude
honorificPrefix title altitude

countryName
email
fax
locality
su postalCode
Person bcl region Location
ass
Of streetAddress subclassOf
tel
url
Organization Concept


name

45

rNews - Working Example

46

rNews - Design Goals & Principles

 Guiding vision - Einstein’s Corollary to Occam’s Razor:
• “Everything should be kept as simple as possible, but no simpler.”
 Goals:
• Decision makers should see rNews implementation as an extremely
minor time commitment (1-2 days).
• Developers should be able to implement rNews without becoming
semantic web experts.
• Semantic Web Experts should be able to easily leverage rNews-
annotated documents.
 Strategy:
• Unified Namespace
• Reuse existing IPTC standards
• Use controlled vocabularies to minimize number of objects and
properties.
47

rNews Design Principle: Uniﬁed
Namespace

 Why did we choose this...

rNews:

48

Namespace

 ...instead of this?

Ontology For
Media
Resources

.vcard
49

Namespace <html 
  xmlns:foaf=
    "http://xmlns.com/foaf/0.1/"
  xmlns:dc=
<html      "http://purl.org/dc/elements/1.1/"
xmlns:rnews=   xmlns:sioc=
    "http://iptc.org/std/rNews/2011‐02‐02#"     "http://www.w3.org/2006/vcard/ns#"
>   xmlns:skos=
    "http://www.w3.org/2004/02/skos/core"
  xmlns:vcard=
    "http://www.w3.org/2006/vcard/ns#"
  xmlns:ctag=
    "http://commontag.org/ns#"
<div rel="rnews:taggedBy"> >
  <div>People</div>
  <div  <div rel="ctag:tagged">
   about="http://data.nytimes..."   <div>People</div>
   typeof="rnews:Person">   <div 
    <span     about="http://data.nytimes..."
     property="rnews:name">    typeof="foaf:Person">
      Qaddafi, Muammar el‐     <span 
    </span>      property="foaf:name">
  </div>       Qaddafi, Muammar el‐
</div>     </span>
  </div>
</div>

50

Namespace

 Problems With Multiple Namespaces
• Dramatically increases learning curve.
• Dramatically increases probability of implementation errors.
• Negative impact on implementation time.
 Problems With Single Namespace
• Reduces utility of rNews-annotated documents to many
existing semantic web tools.
 Solution
• Single namespace, but next version will include a machine-
readable mapping from rNews objects and properties to
external vocabularies.

51

rNews Design Principle: Reuse
Existing IPTC Standards
 rNews is designed with extensive reference to existing
IPTC standards.
 That is why, for instance, we use the term copyrightNotice
(from NewsML G2) instead of rights (from Dublin Core).
 IPTC Standards are widely deployed in the online
publishing world
• NewsML-G2
• EventsML-G2
• SportsML-G2
• NewsML
• News Industry Text Format
• SportsML
• IPTC 7901
• Familiar to implementors
• Familiar to IPTC
52

rNews Design Principle: Minimize Objects
& Properties With Controlled Vocabularies

 Why This

Media

53


 Instead of this

Audio Image Video

54


 Controlled Vocabulary Eliminates Need for Multiple
Classes Media

MediaType Encoding
MediaTypeUri EncodingUri

http://cv.iptc.org/newscodes/mediatype/ http://cv.iptc.org/newscodes/format/

http://cv.iptc.org/newscodes/audiocodec/

http: //cv.iptc.org/newscodes/videocodec/

55

Call To Action!
What Comes Next

56

Call To Action

 Threefold Request
• What you can do now.
• What you can do this
summer.
• What you can do this
fall.

57

Call To Action: What you can do Now

 Review the draft standard at http://dev.iptc.org/
rnews (ec2 permitting).

 Post your feedback to the forum or email us:
• Stuart (smyles@ap.org)
• Andreas (Andreas.Gebhard@gettyimages.com)
• Evan (evan@nytimes.com)

 If you want to see a standard like this supported,
encourage your vendors and providers to review
and support rNews.

58

Call To Action: What (else) you can do
Now

 Have an idea for an rNews use case tell us.

 Test your code on sample articles that we will
provide (as soon as ec2 is working again).

59

Call To Action: What (else) you can do

 This Summer
• Try implementing the next version of rNews on all or some
your site.
• Continue to provide feedback about how well the standard
is working for you: what works well, what needs
improvement.

 This Fall
• Implement version 1.0 of rNews on your site.

60

All About rNews - Evan Sandhaus

Recommended

Recommended

More Related Content

Similar to All About rNews - Evan Sandhaus

Similar to All About rNews - Evan Sandhaus (20)

Recently uploaded

Recently uploaded (20)

All About rNews - Evan Sandhaus

Editor's Notes