csvconfyasmin2017_05_03

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Using Web Archives to Enrich the Live
Web Experience Through Storytelling
Yasmin AlNoamany

University of California, B...

My son, Yousof, was 2 on
January 17, 2011
hQps://www.facebook.com/elshaheeed.co.uk/
2

No worries! MulHple iniHaHves for
documenHng the EgypHan RevoluHon
403 photos with
informaVon about the
lives of the mar...

Several studies and books about the
EgypHan RevoluHon
4 4

These repositories do not exist any more!
5 5

Luckily these sites are archived at Archive-It
in the EgypHan RevoluHon collecHon
hQp://wayback.archive-it.org/2358/201103...

Archived collecHons are important
for posterity, but there are
problems with archived collecHons
7

AOer 10 years, Yousof knows
about Archive-It
> 3,500
collecVons

~340
insVtuVons

> 10B archived
pages
Archive-It...

There is more than one collecHon about
the EgypHan RevoluHon
•  “2010-2011 Arab Spring” hQps://archive-it.org/collecVons/3...

Current browsing and searching services for
the “Egypt RevoluHon and PoliHcs” collecHon
10

Current browsing and searching services for
the “Egypt RevoluHon and PoliHcs” collecHon
11

Current browsing and searching services for
the “Egypt RevoluHon and PoliHcs” collecHon

12

CollecHon understanding and collecHon
summarizaHon are not currently supported
Not easy to answer “what’s in that collecHo...

Our early aYempts at collecHon understanding
tried to include everything…
14
“Visualizing digital collec5ons at Archive-...

1000s of seeds X 1000s of archived pages ==
Conven,onal Vis Methods Not Applicable
15

Idea:
Storytelling
16

Stories in literature
Story elements: sedng, characters, sequence, exposiVon, conﬂict,
climax, resoluVon
Once upon a Vm...

Stories in social media
“It's hard to deﬁne a story, but I know it when I see it” (Alexander, 2008)
basically, just arran...

“Storytelling” is becoming a popular
technique in social media
19

What are the limitaHons of
storytelling services?
20

The EgypHan RevoluHon on Storify
21

Bookmarking, not preserving!
22

Use interface people already know how to use
to summarize collecHons
Archived collec5ons Storytelling services
Archived e...

Hand-craOed stories to summarize the
EgypHan RevoluHon collecHon for Yousof
hQps://storify.com/yasmina_anwar/the-egypVan-r...

How do we generate this automaHcally?
25

CollecHons have two dimensions:
{Fixed, Sliding} X {Page, Time}
t1 t3 t2 t5 t4 tk
…

URI
Time
t6
26
…

…

Fixed Page, Fixed Time
A desktop Chrome user-agent
hQp://www.cnn.com/2014/02/24/world/africa/egypt-poliVcs/
index.html?hp...

Feb 1 Feb 1 Feb 2
Feb 4 Feb 5 Feb 7
Feb 9 Feb 11 Feb 11
28
Fixed Page, Sliding Time

Feb. 11, 2011
Mubarak resigns
29
Sliding Page, Fixed Time

Jan 27 Jan 31
Feb 7 Feb 4
Feb 11 Feb 11
Feb 2
Jan 25
Feb 10
30
Sliding Page, Sliding Time

The Dark and Stormy Archives (DSA) framework
Establish a
baseline
Reduce the candidate
pool of archived pages
Select good
...

Establish a baseline of
social media stories
"Characteris5cs of Social Media Stories”, TPDL 2015, IJDL 2016.
32

What is the length of a story
(the number of resources per story)?
This story has
31 resources
1
3
2
33

What are the types of resources that
compose a story?
Quotes
Video
34
This story has
•  19 quotes
•  8 images
•  ...

We found that 28 mementos is a good
number for the resources in the stories.
35

DetecHng oﬀ-topic pages
"Detec5ng Oﬀ-Topic Pages in Web Archives”, TPDL 2015, IJDL 2016.
36

More than 60% of archive copies of
hamdeensabahy.com are oﬀ-topic
May 13, 2012: The page started as
on-topic.
May 24, 20...

Based on evaluaHng 6 similarity methods, we applied the best
performing method to automaHcally detect oﬀ-topic pages
May 1...

9 mementos for news.egypt.com,
but 5 are duplicates
39

SelecHng representaHve pages for
generaHng stories
40
”Genera5ng Stories from Archived Collec5ons”, WebSci 2017.

Quality metrics for selecHng mementos
•  In the DSA, memento quality Mq is calculated as
following:

Mq = (1 − wm*D...

We prefer a higher quality memento (Dm)
hQp://wayback.archive-it.org/2358/20110201231457/
hQp://news.blogs.cnn.com/catego...

We prefer pages with aYracHve snippets
hQps://wayback.archive-it.org/2358/20110207193404/hQp://news.blogs.cnn.com/2011/02/...

Visualizing stories in Storify
44
”Genera5ng Stories from Archived Collec5ons”, WebSci 2017.

We extract the metadata of the pages
and order them chronologically
{ "elements":[
{
"permalink":"http://wayback.archive-...

Example of an automaHcally generated story
46
Notice the good
metadata: images,
titles with dates,
favicons

EvaluaHng the Dark and Stormy
Archive framework
(how good are the automaHcally generated stories?)
47

EvaluaHon is tricky!
(two perfectly good stories could have non-overlapping k=28
elements!)
•  Successful evaluaVon means:...

Our guidelines for expert archivists at Archive-It
for generaHng stories from the collecHons
49

A sample HIT
50

DSA == Human
(Human,DSA) > Random
Automatic/Human Automatic/Random Human/Random
Percentage
020406080100
Automatic Human Ra...

Understanding the archived collecHons is
important for posterity
52

Understanding the archived collecHons is
important for posterity
Thanks mom for the DSA!
53

Use interface people already know how to use
to summarize collecHons
Archived collec5ons Storytelling services
Archived e...

Backup Slides
55

We sample k mementos from N pages of the
collecHon (k << N) to create a summary story
Collec5on Y
Collec5on Z
Collec5on ...

How do we automaHcally detect
oﬀ-topic pages?
57

Textual content
cosine similarity, intersecHon of the most frequent terms,
Jaccard similarity
Method Similarity
cosine ...

SemanHcs of the text
Web based kernel funcHon using the search engine (SE)
Method Similarity
SE-Kernel 0.7
59
Sahami ...

Structural methods
no. of words, content-length
100 109
100 5
Method % change
WordCount 0.09
Method % change
Wor...

We built a gold standard data set to
evaluate the methods

61

We manually labeled 15,760 mementos
Egypt Revolu5on and Poli5cs
URI-Rs: 136
URI-Ms: 6,886
Oﬀ-topic URI-Ms: 384
Occupy ...

Evaluated 6 methods on manually
labeled 15,760
•  Textual content
•  cosine similarity
•  intersecVon of the most freq...

Cosine Similarity performed well
64
Similarity Measure Threshold FP FN FP+FN ACC F1 AUC
Cosine|WordCount 0.10|-0...

Average precision of 0.89 on 18 diﬀerent
Archive-It collecHons
65
(Cosine,WordCount) with (0.10,-0.85) thresholds

EvaluaHng the DSA
66

MT experiment setup
•  Three HITs for each story (69 HITs to evaluate 23 stories); two
comparisons per HIT:
•  HIT1: hum...

We prefer deep links over
high level domains (Sql)
Feb. 11, 2011: the homepage of BBC on Storify
Feb. 11, 2011: the home...

Social media pages may not produce
good snippets (Sqc)
hQp://wayback.archive-it.org/1784/20100131023240/hQp:/twiQer.com/Ha...

How do we dynamically divide the
collecHons into appropriate slices?
(in other words, how do we pick just 28?)
70
”Gener...

We expected most collecHons to look like this…
● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●...

This is what we found
● ● ● ●● ●●
● ● ● ●●
●
● ● ● ●● ●● ●
●●●●●●●
● ● ● ● ● ●●
●●
● ● ● ● ● ●●
● ● ● ● ● ●● ●●
●●
●●
●●
●...

We received 23 stories for 10
Archive-It collecHons
SPST is “Sliding Page, Sliding Time”
SPFT is “Sliding Page, Fixed Tim...

Remember my hand-craOed stories?
74

Remember my hand-craOed stories?
75

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1062387 views
Storytelling For The Web: Integrate... by Chiara Aliotta 980817 views
Artificial Intelligence, Data and C... by OECD Directorate ... 921734 views
How to Leverage AI to Boost Employe... by SocialHRCamp 391483 views
2024 State of Marketing Report – by... by Marius Sescu 221384 views
Everything You Need To Know About C... by Expeed Software 237443 views

View on Slideshare

1 of 75 Ad

View on Slideshare

1 of 75 Ad