Europeana GA 2016: Harnessing Crowds, Niches & Professionals in the Digital Age

You are doing it
Harnessing Crowds, Niches & Professionals
in the Digital Age
http://lora-aroyo.org u http://slideshare.net/laroyo u @laroyo
Lora Aroyo

Take home message
software is dead! long live data!
know your data - know your crowds
adapt your core strategies

1998

1998 2006
1 million dollar prize
for best algorithm

Netflix switches to streaming
20071998 2006

Team BellKor wins Netflix Prize
20071998 2006 2009

from books to data science
20061994 2003 2016

software is dead! long live data!

data is at the centre of every process

data is essential to evolve with your users

Ceci n'est pas … la mona lisa

Ceci n'est pas … la mona lisa
Louvre’s Mona Lisa
is only #14

the battle of two worlds
9,3 million
Louvre
visitors 2014 14 million
website visitors
2,3 million
social media

in the (very near) future
most visitors will be digital-born
not bound by time or location
native to new forms of co-makership
native to new media
Siebe Weide, Max Meijer and Marieke Krabshuis (2012).
Agenda 2026: Study on the Future of the Dutch Museum Sector

in the (very near) future
digital & virtual positioning is critical
traceability & recognisability is key
Siebe Weide, Max Meijer and Marieke Krabshuis (2012).
Agenda 2026: Study on the Future of the Dutch Museum Sector

data at the center of ALL your processes

know your data
variety of meanings
multitude of perspectives
abundance of sources
endless applications

crowdsourcing:
solution at scale to know your data

know your crowds
volunteers
enthusiasts
visitors on-site
visitors online
paid crowds
in-house experts

understand who are the different crowds
what can they do for your collection
know your crowds

not every crowd is equal

https://www.rijksmuseum.nl/en/rijksstudio
Engage with Co-crea0on on your Website

expertise of Rijksmuseum professionals is
in annotating their collection
with art-historical information, e.g. when they
were created, by whom, etc.

detailed domain-specific information
about depicted objects, e.g. which species the
animal or plant belongs to,
is in most cases not available

use nichesourcing, i.e. niches of people with the
right expertise, to add more specific information

use social media sources, e.g. Twitter, to find
different types of experts in certain areas, e.g.
bird lovers or ornithologists

Engage the Niche in Cultural Heritage
http://annotate.accurator.nl

Engage with Games in Cultural Heritage
training the general crowd to be a niche:
game in which players can carry out an expert
annotation tasks with some assistance

combine the crowds in a workflow:
assess the crowd’s annotation quality by allowing
another crowd to review/rate them

http://waisda.nl

engage volunteer crowds
through continuous gaming
@waisda
http://waisda.nl

engage volunteer crowds
through continuous gaming
http://spotvogel.vroegevogels.vara.nl

Paid Crowds for Video Analysis
CrowdTruth.org

Paid Crowds for Text Analysis
CrowdTruth.org

Paid Crowds for Image Analysis
CrowdTruth.org

measure & assess
ensure impact
•  be aware of the channel, e.g. Wikipedia,
Wikimedia, Facebook

88% of the tags useful for specific genres
Riste Gligorov, Michiel Hildebrand, Jacco van Ossenbruggen, Guus Schreiber, Lora Aroyo
(2011). On the role of user-generated metadata in audio visual collections. International
conference on Knowledge capture K-CAP '11, Pages 145-152
measure & assess
monitor progress
6 months 2 years
340,551 tags 36,981 tags
137.421 matches
602 items 1.782 items
555 registered players 2,017 users (taggers)
thousands of anonymous players
12,279 visits (3+ min online)
44,362 pageviews

user vocabulary
8% in professional vocabulary
23% in Dutch lexicon
89% found on Google
locations (7%)
engeland
persons (31%)
objects (57%)
measure & assess
evaluate content, compare crowds
Tags describe mainly short segments
Tags are o9en not very speciﬁc
Tags not describe programmes as a whole

campaign campaign campaign

Challenge 1: Crowdsourcing initiatives are typically
undertaken in isolation
Challenge 2: It is quite difficult to strictly control the time it
takes to complete crowdsourcing initiatives (across different
types)
Challenge 3: Crowdsourcing initiatives demand your
continuous promotional effort
Challenge 4: It is challenging for CH Institutions to
incorporate crowdsourcing results into their existing
content infrastructure
Crowdsourcing Challenges

use any opportunity collect or verify
data through crowdsourcing …
(S)
with a global strategy

… through novel interactions

… by user-driven augmentations
of your collection

… aligning the digital & physical

… achieving empowered users

… in
NextGen
Cultural Heritage
driven by data & crowds

Harnessing Crowds, Niches & Professionals
in the Digital Age
Lora Aroyo

Europeana GA 2016: Harnessing Crowds, Niches & Professionals in the Digital Age

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (20)

Similar to Europeana GA 2016: Harnessing Crowds, Niches & Professionals in the Digital Age

Similar to Europeana GA 2016: Harnessing Crowds, Niches & Professionals in the Digital Age (20)

More from Lora Aroyo

More from Lora Aroyo (16)

Recently uploaded

Recently uploaded (20)

Europeana GA 2016: Harnessing Crowds, Niches & Professionals in the Digital Age