1.
NEDERLAND
Wikidata for GLAMs
WIKIMEDIA
NEDERLAND
Sebastiaan ter Burg & Maarten Dammers
With thanks to Gerardm & FakirNL

2.
NEDERLAND
Welcome GO TO
www.wikidata.org
LOG IN!

3.
NEDERLAND
Program
Time
10:30 Welcome
10:50 Introduction Wikidata
11:10 Tools
11:30 Break
11:45 Edit single properties
12:15 Lunch
12:45 Batch editing properties
14:00 Batch item creation
15:00 Break
15:15 Wikidata Queries
15:45 Wikidata Queries hands-on
16:30 Discussion
17:15 Drinks

4.
NEDERLAND
Objectives
Know what Wikidata is
Basic knowledge of how Wikidata works
Basic idea what volunteers are doing with Wikidata at the moment
Did manual edits
Know how Wikidata can benefit your organisation
Know how Wikidata can be used to crowdsource data
Know how Wikidata can bring open knowledge back to your organisation
Know the steps to undertake mass edits
Know the steps to undertake mass donations
Know where to look up statements
Made a list of differences in statements from your organisation
Have seen Wikidata Queries
Discussed the potential of Wikidata for your organisation/sector
Socialised

5.
NEDERLAND
Who’s who?

6.
NEDERLAND
Introduction Wikidata

7.
NEDERLAND
Wikidata is a free linked database that can be
read and edited by both humans and machines.

8.
NEDERLAND
Wikidata acts as central storage for the
structured data of its Wikimedia sister projects
including Wikipedia, Wikivoyage, Wikisource, and
others.

9.
NEDERLAND
Data in Wikidata is in the public domain

10.
NEDERLAND
You’ve been using it already
The BIG Interwiki problem

11.
NEDERLAND
https://nl.wikipedia.org/wiki/Lachen_(gedrag)

12.
NEDERLAND
https://nl.wikipedia.org/wiki/Lachen_(gedrag)

13.
NEDERLAND
Notability
Not everything is notable data

14.
NEDERLAND
Structure Wikidata

15.
NEDERLAND

16.
NEDERLAND

17.
NEDERLAND
Wikidata processes

18.
NEDERLAND Wikidata processes
Wikipedia Wikidata
Governance structure Mature Immature
Sources and references Mature Immature
Determination of appropriate content Community Growing
Quality control Mature Growing
Village pump (community debate) Mature Growing
Example of determination of notability: Constraint reports

19.
NEDERLAND
Properties
https://www.wikidata.org/wiki/Wikidata:List_of_properties/all

20.
NEDERLAND

21.
NEDERLAND
Properties: artwork

22.
NEDERLAND

23.
NEDERLAND
https://www.wikidata.org/wiki/Wikidata:List_of_properties/Works#Specialized_properties

24.
NEDERLAND
Proposing properties
The community determines the properties
Search, search, search
https://www.wikidata.org/wiki/Wikidata:Property_proposal

25.
NEDERLAND So what about
semantics? Taxonomy?
The community determines the properties
Solution: make a mapping
https://www.wikidata.org/wiki/Wikidata:Property_proposal

26.
NEDERLAND
Tools

27.
NEDERLAND
Reasonator
http://tools.wmflabs.org/reasonator/

28.
NEDERLAND

29.
NEDERLAND

30.
NEDERLAND

31.
NEDERLAND

32.
NEDERLAND
Reasonator gadget

33.
STEP 1
NEDERLAND
STEP 2
STEP 3

34.
NEDERLAND
Languages shown

35.
NEDERLAND
https://en.wikipedia.org/wiki/Wikipedia:Babel

36.
NEDERLAND
Autolist 2
http://tools.wmflabs.org/autolist/index.php

37.
NEDERLAND
WiDar

38.
NEDERLAND
Oauth Because of Oauth you can edit tools
with your own global account

39.
NEDERLAND
Pywikibot
Wikidata is being run by bots

40.
NEDERLAND
Toolscript
Run javascript from your browser
https://tools.wmflabs.org/toolscript/index.html

41.
NEDERLAND

42.
NEDERLAND

43.
NEDERLAND
Wikidata results
Find Wikidata on Wikipedia
(not installed in nl.wikipedia.org yet)
Let’s go to the Tamil Wikipedia….
and search for hagelslag.
https://ta.wikipedia.org/wiki/!l_அைமp'

44.
NEDERLAND

45.
NEDERLAND
http://www.histropedia.com

46.
NEDERLAND
Wikidata the game
http://tools.wmflabs.org/wikidata-game/

47.
NEDERLAND
http://tools.wmflabs.org/wikidata-game/

48.
NEDERLAND
BREAK

49.
NEDERLAND
Single edit

50.
NEDERLAND
Let’s edit
Pick a not so famous person/item/building/…
Look for inspiration at a very famous person/item/building/…

51.
NEDERLAND
Batch editing

52.
NEDERLAND
Why
Batch editing
Correcting / improving a property

53.
NEDERLAND
Why
Batch editing
Example:
AdLib > Europeana Data Model > GLAMwiki Toolset

54.
NEDERLAND
Why
Batch editing
Example:
AdLib > Europeana Data Model > GLAMwiki Toolset
Data lost Data lost

55.
NEDERLAND
Why
Batch editing
Batch creation
Example:
AdLib > Europeana Data Model > GLAMwiki Toolset
Data lost Data lost

56.
NEDERLAND
Human / Machine
Batch editing

57.
NEDERLAND
Human
Batch editing

58.
NEDERLAND
Human
Batch editing
Case: University alumni
http://ultimategerardm.blogspot.nl/2014/11/wikidata-wikipedia-categories.html

59.
NEDERLAND
https://tools.wmflabs.org/reasonator/?q=Q8884100

60.
NEDERLAND
Current language Wikipedias
en Category:University of Notre Dame
alumni
Big Wikipedias
es Categoría:Alumnado de la
Universidad de Notre Dame
fr Catégorie:Étudiant de l'université
Notre-Dame-du-Lac
pt Categoria:Ex-alunos da
Universidade de Notre Dame
Wikimedia Commons
commons Category:Alumni of the University
of Notre Dame
Other Wikipedias
gl Categoría:Alumnos da
Universidade de Notre Dame
ko 분류:노터데임 대학교 동문
la Categoria:Alumni Universitatis
Dominae Nostrae a Lacu
ro Categorie:Absolvenți ai University
of Notre Dame
sl Kategorija:Diplomiranci Univerze
Notre Dame
zh Category:聖⺟母⼤大學校友
people who studied at
the university of Notre Dame

61.
Wikidata knows about Wikipedia categories. NEDERLAND
Currently there are items for 2,406,128 categories.
Many of those items refer to categories in multiple Wikipedias. One random
example is item Q8884100, it refers to categories in 10 Wikipedias.
All of them categorize people who studied at the university of Notre Dame. Many
of them know about people only known in that Wikipedia. In addition to this there
may be articles that are not categorised or references to articles that are not in
one of the 10 categories known at this time.
http://ultimategerardm.blogspot.nl/2014/11/wikidata-wikipedia-categories.html

62.
NEDERLAND
When multiple categorised are "harvested" in Wikidata, Wikidata knows
about more items than any of the individual categories. This enables the
use of the data in new ways.
• suggest categories based on the presence of statements in the Wikidata
category
• suggest statement when an article is included in a category
• include red links in a category when a Wikipedia does not have articles.
http://ultimategerardm.blogspot.nl/2014/11/wikidata-wikipedia-categories.html

63.
Current language Wikipedias NEDERLAND
en Category:University of Notre Dame
alumni
Big Wikipedias
es Categoría:Alumnado de la
Universidad de Notre Dame
fr Catégorie:Étudiant de l'université
Notre-Dame-du-Lac
pt Categoria:Ex-alunos da
Universidade de Notre Dame
Wikimedia Commons
commons Category:Alumni of the University
of Notre Dame
Other Wikipedias
gl Categoría:Alumnos da
Universidade de Notre Dame
ko 분류:노터데임 대학교 동문
la Categoria:Alumni Universitatis
Dominae Nostrae a Lacu
ro Categorie:Absolvenți ai University
of Notre Dame
sl Kategorija:Diplomiranci Univerze
Notre Dame
zh Category:聖⺟母⼤大學校友

64.
Current language Wikipedias NEDERLAND
en Category:University of Notre Dame
alumni
Big Wikipedias
es Categoría:Alumnado de la
Universidad de Notre Dame
fr Catégorie:Étudiant de l'université
Notre-Dame-du-Lac
pt Categoria:Ex-alunos da
Universidade de Notre Dame
Wikimedia Commons
commons Category:Alumni of the University
of Notre Dame
Other Wikipedias
gl Categoría:Alumnos da
Universidade de Notre Dame
ko 분류:노터데임 대학교 동문
la Categoria:Alumni Universitatis
Dominae Nostrae a Lacu
ro Categorie:Absolvenți ai University
of Notre Dame
sl Kategorija:Diplomiranci Univerze
Notre Dame
zh Category:聖⺟母⼤大學校友

65.
NEDERLAND
ES + FR + PT + =
EN
Wikidata
Let’s compare categories
people who studied at
the university of Notre Dame

66.
NEDERLAND
There’s a difference between wiki's
ES + FR + PT + =
EN
Wikidata

67.
NEDERLAND
ES + FR + PT + =
EN
Person A
Person B
Person C
……
Person D
Person X
Person Z
……
Person A
Person F
Person K
…… Person D
Person X
…..
Wikidata
Missing articles can be red links

68.
NEDERLAND
What if a new article is added?
ES + FR + PT + =
EN
Person A
Person B
Person C
……
Person D
Person X
Person Z
……
Person A
Person F
Person K
…… Person D
Person X
…..
Wikidata
Person + Person +

69.
NEDERLAND
Well, suggest it to the wiki’s…
ES + FR + PT + =
EN
Person A
Person B
Person C
……
Person D
Person X
Person Z
……
Person A
Person F
Person K
…… Person D
Person X
…..
Wikidata
Person + Person + Person + Person + Person +

70.
NEDERLAND
Human
Batch editing
Case: merging

71.
STEP 1
NEDERLAND
STEP 2
STEP 3

72.
NEDERLAND

73.
NEDERLAND

74.
NEDERLAND
https://www.wikidata.org/wiki/User:Pasleim/projectmerge/enwiki-nlwiki

75.
NEDERLAND
https://www.wikidata.org/wiki/User:Ivan_A._Krestinin/To_merge/nlwiki

76.
NEDERLAND

77.
NEDERLAND
LUNCH

78.
NEDERLAND
Scenario
What kind of information would you probably batch edit?
What is available in your sources?
What are the properties on Wikidata?
What should the code look like?

79.
NEDERLAND
Item drafting
What kind of information would you probably batch edit?
What is available in your sources?
What are the properties on Wikidata?
What should the code look like?

80.
NEDERLAND
Machine
Batch editing

81.
NEDERLAND
Batch data import
Mass addition and integration of data into Wikidata

82.
NEDERLAND
Batch data import
Example projects

83.
NEDERLAND
By Sebastiaan ter Burg (Flickr: Domtoren in Utrecht) [CC-BY-SA-2.0 (http://creativecommons.org/licenses/by-sa/2.0)], via Wikimedia Commons

84.
NEDERLAND
Hans Bollongier (fl. 1623–1672) [Public domain], via Wikimedia Commons
Sum of all paintings
https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings

85.
NEDERLAND
By Rob Bogaerts / Anefo (Nationaal Archief)
[CC-BY-SA-3.0-nl (http://creativecommons.org/licenses/by-sa/3.0/nl/deed.en)], via Wikimedia Commons

86.
NEDERLAND
By Didier Descouens (Own work) [CC-BY-SA-4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

87.
NEDERLAND
Remember…
Data in Wikidata is in the public domain

88.
NEDERLAND
First:
What’s in the dataset?
What’s the quality?
What …
By Ministry of Information Photo Division Photographer [Public domain], via Wikimedia Commons

89.
NEDERLAND
How can an item be identified?

90.
NEDERLAND
How can an item be identified?
With unique
identifiers

91.
https://www.rijksmuseum.nl/en/collection/SK-A-5003
https://www.wikidata.org/wiki/Q3090610
NEDERLAND
Inventory numbers are usable
as identifiers

92.
NEDERLAND
Clean your data Before you import:
By Sherif9282 (Own work) [CC-BY-SA-3.0
(http://creativecommons.org/licenses/by-sa/3.0) or
GFDL (http://www.gnu.org/copyleft/fdl.html)], via Wikimedia Commons

93.
NEDERLAND
Start up your robot Demonstration
By Ian McKellar from San Francisco, CA, USA [CC-BY-SA-2.0 (http://creativecommons.org/licenses/by-sa/2.0)], via Wikimedia Commons

94.
NEDERLAND
19264 > Q1545193

95.
NEDERLAND
SK-A-5003 > Q3090610

96.
NEDERLAND
Bundesarchiv, Bild 183-49993-0006 /
CC-BY-SA [CC-BY-SA-3.0-de
(http://creativecommons.org/licenses/by-sa/3.0/de/deed.en)],
via Wikimedia Commons

97.
NEDERLAND
There is an array
Trust me…
[[eggs, bananas],catfood, toiletpaper] An array is like grocery list in your head…

98.
NEDERLAND
Example of what’s running
https://git.wikimedia.org/blob/labs%2Ftools%2Fmultichill.git/e6a873ea1d397e22965b2a69d08a2cd7b410d562/bot%2Fwikidata%2Frijksmuseum_import.py
https://git.wikimedia.org/tree/labs%2Ftools%2Fmultichill.git/HEAD/bot%2Fwikidata

99.
NEDERLAND
Empty items = no fun
Fill her up!
By Jocelyn Augustino (This image is from the FEMA Photo Library.) [Public domain], via Wikimedia Commons

100.
NEDERLAND
Start matching

101.
NEDERLAND
Batch creation:
1.Adding items is easy
2.Deleting or changing
items is difficult
Henri Brispot [Public domain], via Wikimedia Commons
First come
First served

102.
NEDERLAND
Setting up batches
1. Create a bot account
2. Discuss bot tasks
3. Get a bot flag
4. Run your bot
https://www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot

103.
NEDERLAND
BREAK

104.
NEDERLAND
Wikidata queries

105.
NEDERLAND
Tools for queries

106.
NEDERLAND
Discussion

107.
NEDERLAND
Uses:
Feedback loop
(List of differences)

108.
NEDERLAND
Small steps
Small errors, human edits,
drafting code

109.
NEDERLAND
DRINKS

110.
NEDERLAND
Wikidata for GLAMs
WIKIMEDIA
NEDERLAND
Sebastiaan ter Burg & Maarten Dammers
With thanks to Gerardm & FakirNL