The document discusses the Modeling Crowdsourcing for Cultural Heritage (MOCCA) project. MOCCA aims to analyze crowdsourcing projects to determine what factors lead to success and develop a tool to help design effective crowdsourcing initiatives. It lists the project team members and states the objectives are to study two past projects, answer what makes a crowdsourcing project successful, and create a crowdsourcing design tool. It also provides background on a workshop hosted by MOCCA team members to crowdsource a model for crowdsourcing cultural heritage projects.

1. M O C C A
Modeling Crowdsourcing for Cultural HeritAge

2. MOCCA
are:
• Julia
Noordegraaf,
University
of
Amsterdam
(project
leader)
• Angela
Bartholomew,
University
of
Amsterdam
(embedded
researcher)
• Ellen
Fleurbaay,
Stadsarchief
Amsterdam
(public
partner)
• Pieter
Woltjer
&
Ellen
van
Noort,
Picturae
(private
partner)
• Alexandra
Eveleigh,
University
College
London
(advisor)
[Insert
CIRCA
screenshot]

3. ObjecLves:
1. Central
quesLon:
What
determines
the
success
of
a
crowdsourcing
project?
2. Analysis
of
two
projects:
Save
a
Portrait
and
tagging
of
the
Maria
Austria
photo
collecLon
3. Outcome:
tool
for
designing
effecLve
crowdsourcing
projects

4. Crowdsourcing
Goals
Classifica9on
Contextualiza9on
Correc9on
and
Transcrip9on
Cura9on
Crea9on
Crowdfunding
Ins9tu9onally-­‐Related
Increasing
the
amount
of
digiLzed
materials
x
x
x
Set
prioriLes
for
digiLzaLon
x
x
x
Edit
content
x
IdenLficaLon
of
subject
x
x
Organize
informaLon
and
knowledge
x
x
x
Linking
x
x
x
x
Solve
problems
x
Cataloguing
x
x
x
Resource
Management
Raising
funds
to
support
project
x
Save
Lme
and
resources
of
insLtuLon
x
x
x
x
x
x
Public
Rela9ons
Gain
increased
visibility
in
new
populaLons
x
x
x
x
x
x
Gain
aZenLon
(through
media
sources)
x
x
x
x
x
x
Crowd-­‐Related
Engagement
with
collecLon
and
insLtuLon
x
x
x
x
x
x
Gain
knowledge
of
crowd
opinion
and
preferences
x
x

5. Maria
Austria
InsLtute,
Tags
en
uitleg
(tags
and
explanaLon)

10. %
%
67%
/8%9&,8% !! :*%;&.%/411&3%*+4<(%3=(%>+&?(/3%01%.+2(13%
3(+<-@%03%,0))%A(%013(2+4)%3&%=4B(%41%
(-34A)0-=('%'('0/43('%/+&,'%3=43%=4-%
013(+(-3%01%4/=0(B012%3=(%>+&?(/3%2&4)8%
"#$ :-%3=(+(%4%-(3%4<&.13%&*%'434%3&%A(%-&.+/('%&+%+(->&1-(-%3&%
A(%243=(+('C%
% %
D&8%%
%
!% E0+-3%-(3%3=(%4<&.13F%4%/+&,'-&.+/012%
>+&?(/3%0-%A(33(+%-(+B('%,03=%4%/)(4+);%
'(*01('%1.<A(+%&*%03(<-%3&%A(%>+&/(--('8%
G=0-%4))&,-%2&4)-%3&%A(%-(3%41'%
01*+4-3+./3.+4)%'(/0-0&1-%H4A&.3%3=(%4<&.13%
&*%A41',0'3=%3&%A(%*4/0)0343('@%(3/8I8%
J(-8%#&1301.(%3&%K.(-30&1%L8M8! % %
"#% 5&,%0<>&+3413%0-%01>.3%4//.+4/;%3&%3=(%>+&?(/3C% % %
%
48%N(+;%0<>&+34138%
%
!!
!
:*%;&.+%>+&?(/3%01/).'(-%4%3+41-/+0>30&1%34-O@%
&+%41&3=(+%3;>(%&*%34-O%3=43%=4-%&1);%&1(%
/)(4+%P+02=3Q%&+%P,+&12Q%41-,(+@%4//.+4/;%<4;%
A(%0<>&+34138%G=(+(%4+(%<.)30>)(%<(3=&'-%
A;%,=0/=%3&%&A3401%3=0-%)(B()%&*%4//.+4/;8%
R(*(+%3&%3=(%&'()*'*+,-,./+!01-2*8%
A8%D&3%-&%0<>&+34138% !!
!
%
:*%;&.+%>+&?(/3%01/).'(-%3422012@%&+%41&3=(+%
3;>(%&*%34-O%3=43%,&.)'%A(1(*03%*+&<%4%,0'(%
+412(%&*%01>.3%*+&<%4%'0B(+-(%/+&,'%
4//.+4/;%<4;%1&3%A(%3=(%40<%&*%3=(%>+&?(/38%
S((>012%-/4**&)'012%3&%4%<010<.<%,0))%A(%
O(;%HT((%3*4,./+!5I8%
%
3678&9:!;<!7=9>?!
K.(-30&1-%3&%'(3(+<01(%,=0/=%3;>(%&*%/+&,'%-=&.)'%A(%-&.2=3%*&+%3=(%>+&?(/38%
%
;#@ U0))%>4+30/0>413-%+(V.0+(%3+401012%3&%'&%3=(%34-OC% % %
J(-8%#&1301.(%3&%K.(-30&1%78W8% % %
D&8%TO0>%3&%K.(-30&1%78L8% % %
;#A 5&,%<./=%3+401012C% % %
48 N(+;%)033)(8%
%
!% G+401012%/41%A(%*.)*0))('%3=+&.2=%41%
01*&+<430&1%-=((3%41'%4%-=&+3%3(-3%'(<&%&1%
3,&%3&%3=+((%34-O-8%X+&B0'(%*(('A4/O%3=43%)(3-%
3=(%.-(+%O1&,%=(Y-=(%=4-%/&<>)(3('%3=(%34-O%
-.//(--*.));8%
A8 T&<(8%
%
!% G+401012%-=&.)'%A(%*.)*0))('%3=+&.2=%41%
01*&+<430&1%-=((3%41'%4%)&12(+%3.3&+04)%H3=43%
0-%1&3%&B(+);%/&<>)(ZI8%X+&B0'(%*(('A4/O%3=43%
)(3-%3=(%.-(+%O1&,%=(Y-=(%=4-%/&<>)(3('%3=(%
34-O%-.//(--*.));8%
!"##$%!&'()%*&+%#+&,'-&.+/012%#.)3.+4)%5(+0342(%
!"#$%&'&#!%()*'+$(
!"#$%#&'()#&)*$)&)*+%&,-#%)+(''$+.#&+%&/#'#0+1+$"&)(&2$.+(-%&3$.)+#%&
$'4&5*+"#&6$'7&(0&)*#&,-#%)+('%&3(%#4&*#.#&"#$4&+')(&$&1"#$.&
4+.#1)+('&0(.&)*#&4#%+8'&(0&1.(54%(-.1+'8&3.(9#1)%:&()*#.&,-#%)+('%&
*$2#&/##'&+'1"-4#4&0(.&)*#+.&.#"#2$'17&)(&0-)-.#&.#%#$.1*&+')(&
)*(%#&1$-%$"&0$1)(.%&)*$)&%*$3#&)*#&#00#1)+2#'#%%&(0&1.(54%(-.1+'8&
3.(9#1)%;(
( (
+$,&#!%(-.(#%+&#&/&#!%( ( (
-0- 7843%0-%9&.+%:1-303.30&1%;9<(=% ( (
4> $+/80?(%
@> A0@+4+9%
/> $+3%!.-(.B%
'> "38(+%!.-(.B%
(> C4))(+9%
*> D10?(+-039%
2> "38(+E%FFFFFFFFFFFFFFFFFFF%
%
!(
!(
!(
!(
!(
!(
!(
(
-01 :-%380-%38(%*0+-3%/+&,'-&.+/012%<+&G(/3%*&+%9&.+%
01-303.30&1=%
( (
H(->% !( (
I&>% !( (
-02 7843%0-%38(%-0J(%&*%38(%-34**%&*%9&.+%:1-303.30&1=%
%
( (
4>%A(--%3841%KL%-34**%B(B@(+->%
%
%
%
!(
(
(
;8(+(%4+(%B419%-M0))-%1(/(--4+9%3&%/&1'./3%38(%
34-M-%01?&)?('%01%4%/+&,'-&.+/012%<+&G(/3>%7038%
-./8%4%-B4))%-34**N%(-34@)0-8%,8(38(+%9&.+%-34**%84-%
38(%1(/(--4+9%30B(%41'%(O<(+30-(%*&+%38(%<+&G(/3>%:*%
1&3N%-((M%/&))4@&+430&1%,038%41&38(+%01-303.30&1%&+%
-((M%4%<4+31(+%,038%(O<(+0(1/(%+.11012%
/+&,'-&.+/012%<)43*&+B-%*&+%4--0-341/(>%(
@>%A(--%3841%KLL%-34**%B(B@(+->% !( P-34@)0-8%,8(38(+%9&.+%01-303.30&1%84-%-34**%
B(B@(+-%3843%84?(%38(%+0283%-M0))-N%(O<(+30-(N%41'%
&.3)&&M%3&%<4+34M(%01%38(%<)411012%41'%+.11012%&*%4%
/+&,'-&.+/012%<+&G(/3>%:*%1&3N%-((M%/&))4@&+430&1%
,038%41&38(+%01-303.30&1%&+%-((M%4%<4+31(+%,038%
(O<(+0(1/(%+.11012%4%/+&,'-&.+/012%<)43*&+B%*&+%
4--0-341/(>%(
/>%!&+(%3841%KLL%-34**%B(B@(+->% !(
(
780)(%9&.+%01-303.30&1%84-%4%)4+2(%-34**N%M((<%01%
B01'%3843%38(+(%4+(%B419%'0?(+-(%-M0))-%1(/(--4+9%
3&%.1'(+34M(%4%/+&,'-&.+/012%<+&G(/3>%P1-.+(%9&.+%
-34**%0-%<+(<4+('%,038%38(%1(/(--4+9%-M0))-%*&+%-./8%4%
<+&G(/3N%41'%0*%1&3N%/&1-0'(+%-((M012%4%<4+31(+-80<%
&+%4--0-341/(%*+&B%41&38(+%01-303.30&1%&+%4%/+(430?(%
01'.-3+9%<4+31(+N%,8&%/41%4'?0-(>%

12. Digital Strategies for Heritage (DISH) 2013
2 & 3 December 2013, De Doelen, Rotterdam
Workshop report
Hosts: Julia Noorgraaf, Alexandra Eveleigh, Angela Bartholomew, Pieter Woltjer
Title: Workshop crowdsourcing a crowdsourcing model for CH (MOCCA)
Introduction
The Modeling Crowdsourcing for Cultural Heritage (MOCCA) project, a joint research endeavor of the
Creative Industry Research Centre Amsterdam and the Centre for Digital Humanities of the University
of Amsterdam, aims to steer more effective crowdsourcing projects for galleries, libraries, archives,
and museums. By defining a set of conditions and requirements that help to determine to the relative
success of crowdsourcing projects, the MOCCA Project works to develop a nuanced tool that can be
used by cultural heritage organizations to better design their own tailor-made projects.
The Crowdsourcing a Crowdsourcing Model for Cultural Heritage Workshop will explain the necessity
of this research to the field, using the Amsterdam City Archives' current Red Een Portret (Save a
Portrait) project as a key case study. After preliminary results of the MOCCA project have been
introduced, participants will be divided into groups to test a version of the model in-progress against
their own plans for crowdsourcing projects. Each participant is requested to prepare by bringing a plan
for a crowdsourcing project from their own institution, either existing or hypothetical, paying special
attention to key attributes of the project such as the characteristics of the collection, the goals of the
project, and the skills or expertise volunteers will require to complete the task. The workshop will
enable participants to gain knowledge about the conditions necessary to design a successful project
while also helping to evaluate and improve the functionality of the tool.
Discussion
Julia Noorgraaf UVA Digital Lab introduction: projects commissioned in collaboration with heritage
institutions and private partners.
New fundemental research in the field of DH
Use of computinal tools in digital humanities

13. !"##$%!&'()%*&+%#+&,'-&.+/012%#.)3.+4)%5(+0342(%
647(%41'%803)(9%
647(%&*%:1-303.30&19%
803)(%&*%#+&,'-&.+/012%;+&<(/39%
=>&+3%?(-/+0@30&1%&*%#+&,'-&.+/012%;+&<(/39%
%
%
!"#"$!%&'%()&*+,"%
%
%
% %
-. 5&,%,&.)'%A&.%'(-/+0B(%3>(%-343.-%&*%A&.+%
/+&,'-&.+/012%@+&<(/3C-%'(D()&@7(13E%
%
% %
4F 8>(%@+&<(/3%0-%-30))%B(012%/&1/(0D('F%
BF 8>(+(%>4-%B((1%-&7(%@+&2+(--%74'(%
3&,4+'%+(4)0G012%3>(%@+&<(/3H%0F(F%@+()07014+A%
*02.+(-%IB.'2(34+AH%/&))(/30&1%-@(/0*0/-J%>4D(%
B((1%'(3(+701('F%
/F 8>(%@+&<(/3%0-%/.++(13)A%01%@+&/(--%&+%>4-%
+(/(13)A%/&1/).'('F%
%
!%
!%
%
%
%
!%
/0%10%123%&4536171506%(2783%
/0%10%123%9:;<3:36171506%(2783%
%
%
%
/0%10%123%+=7<>71506%(2783%

14. !"##$%!&'()%*&+%#+&,'-&.+/012%#.)3.+4)%5(+0342(%
!
7(1%8.1'49(134)%!0-/&1/(:30&1-%$;&.3%#+&,'-&.+/012%
!
!
!" !"#$%&'($)#(#*'+'&,-$.*$+,./01.2,+'(3$4,.5#+61$'1$6"#$'(16'626'.(7!%
!"#$%&#'"()*+,)&,-.#'/,/01,("#$%2,!"##$%&!!"#$#%&#'(#)*#$+,$!"#$!"#$%&'()*!"#$%&%!"'$!!"
!"#$%&!'$'&()$'!*($+,-.$'&($/"'(,!0'/-"$%/'&$!"#$%&''#%!(&)$*+!#,(+'!!"#"$%#&'(%&(')"#'&#
!"#$%&'(#)!$*+$*,%#&-!*.#!"#$%&!!"##$!"#$%!&'()'&$#!%&*%+$,#!!"#$#%&!&#'$(%$!$)*++!,*"!-(.#$
!"#$%&'!!!"#$%!&#$"'!!"#$%&'()")*!)"+,-%.-'/")*'!!"#$%&'()!!"#$!"%&'()*!"#!"#$%&'$&()*"+,&
!"#$%#&!"!"#$%&#'($)*+,&-+.*)%!"#$%&'()*#+,))((-!!!"#$%&"'($))*(!+)&'%,*#,'-).'
!"##$!%&"'()&')*+,()'"%)-"((&.#$)*&%/"0%)!!!"#"$%&'(&%$)*+,-'%&&'$./'0."&/'#/1/+%$"1#'
!"#$%&%'()*+,-.%/0*-''1/'%2/*'2*'31*4-'1,%-$)*-/+*1/3-/&%/0*'31*&2$$1&'%2/5%
%
!!"#$#%#$&!"'!"#$%&!!"#$#%&$#'!"#$%&'()!*('+,--.)/0')$'(1%!')/0'.)*(')"++'(%#2)!"#$%&'()$
!"#$%&!"#!$"%&#'('#)"*+"&,*-./*0,&'123"4!'/"'1#$,%&#'*1"5,*('.$/"!"#$%&$'($")$#*(+,#+,$#
!"##$!%&"'!!"#!$%&'()$*&!$+,$-#),$.&//0+(,$+1$#*1$&!",2$-,)0'-!!!"#$%&'()*+,-#$!"#
!"#$%&'#!(")&"*)$+',&"-$!!"!!"#$%%&##'$(")*+,&%-!!"##$%&'(&)#*(+,%"%(*-&!!"#$%"&!'()*+(%+
!"#$%&''$()*"&+$,"-$.-/#$012'$/".'$#"$!"#$%&'"(%
%
!" !"#$%&'(%()(%*&$'"*)+,$-+*'#+.$/0&01#$203(%-%20&('$0&,$-"#-4$!"#$!!"#$%&#"!!
!"#$%&#'()*+$*,$"*-$.&/"$0&("*1)(2$)+'()(&()*+'$01#$-)33)+4$(*$'"01#$-)("$501()/)50+('6$
!"#$"%&'()#*+%,-("%("&%*&.&*%-/%+01&2.#+#-'%)'3%("&%*&.&*%-/%2&.#&!%/-2%)$$02)$45%!"#$%&'(#)#

15. 6+&8(/39%
:&9%;<06%3&%=.(-30&1%>9?9% % %
!"# #41%37(%,&+<%@(%@+&<(1%013&%/&A6&1(13-%3743%/41%
@(%34/<)('%,037&.3%4%A48&+%/&AA03A(13%&*%30A(%
41'%(**&+3B%
% %
C(-9%%% !% D(3(+A01(%,7(37(+%(4/7%/&A6&1(13%
4''+(--(-%&1(%/&7(+(13%-.@E34-<%F-./7%
4-%(13(+012%37(%'43(%&*%4%'&/.A(13%&+%
37(%14A(%&*%4%6(+-&1%6&+3+4G('H9%
:&9%%
%
!% #&1-0'(+%+(I0-012%37(%34-<J%&+%
+('(-021012%03%01%-./7%4%,4G%3743%03%/41%
@(%@+&<(1%013&%/&A6&1(13-J%&+%013&%
-7&+3%34-<-9%$%6+&8(/3%3743%(I&)I(-%,037%
30A(%41'%6.+-.(-%&1(%2&4)%43%4%30A(%0-%
A&+(%)0<()G%3&%4))&,%370-9%
!"$ 5&,%,0))%37(-(%03(A-%@(%6+(-(13('%3&%37(%
64+30/06413B%
% %
49%$))%43%&1/(K%37(%,7&)(%/&))(/30&1%/41%@(%@+&,-('%
&1)01(9%
!% L7(%/+&,'%,0))%-()*E-()(/3J%6+&I0'012%
<1&,)('2(%4@&.3%37(%03(A-%-7(M7(%
+(/&210N(-%&+%74-%6+(I0&.-%<1&,)('2(%
4@&.39%
@9%O+&.6('%@G%/43(2&+GJ%37(%64+30/06413%/7&&-(-%
37(%/43(2&+G%&*%37(%03(A9%
!% L7(%/+&,'%,0))%-()*E-/+((1J%3&%4''+(--%
/43(2&+0(-%01%,70/7%-7(M7(%0-%*4A0)04+9%%
/9%$3%+41'&A9%L7(%03(A%466(4+-%+41'&A)G%3&%37(%
6+&8(/3%64+30/064139%
!% #+&,'%,0))%1&3%1(/(--4+0)G%@(%*4A0)04+%
,037%37(%03(AJ%37(+(*&+(%<1&,)('2(%
,0))%@(%)(--%-6(/04)0N('9%
;#$PP"QDR:O%
S(24+')(--%&*%37(%)(I()%&*%/74))(12(%&*%37(%34-<J%/&1-3+4013-%01%37(%
)(I()%&*%64+30/06430&1%6&--0@)(%01%37(%013(+*4/(%/41%(1/&.+42(%
% %

16. Using
the
MOCCA
Model:
OperaLon
War
Diary

17. Crowd
support
and
feedback
(1)

18. Crowd
support
and
feedback
(2)

20. Contact
us:
j.j.noordegraaf@uva.nl
bartholomew.angela@gmail.com
alexandra.eveleigh.09@ucl.ac.uk
hZp://cdh.uva.nl/projects-­‐2013-­‐2014/m.o.c.c.a.html