20141114 wikidata glam_workshop2

NEDERLAND
Wikidata for GLAMs
WIKIMEDIA
NEDERLAND
Sebastiaan ter Burg & Maarten Dammers
With thanks to Gerardm & FakirNL

NEDERLAND
Welcome GO TO
www.wikidata.org
LOG IN!

NEDERLAND
Program
Time
10:30 Welcome
10:50 Introduction Wikidata
11:10 Tools
11:30 Break
11:45 Edit single properties
12:15 Lunch
12:45 Batch editing properties
14:00 Batch item creation
15:00 Break
15:15 Wikidata Queries
15:45 Wikidata Queries hands-on
16:30 Discussion
17:15 Drinks

NEDERLAND
Objectives
Know what Wikidata is
Basic knowledge of how Wikidata works
Basic idea what volunteers are doing with Wikidata at the moment
Did manual edits
Know how Wikidata can benefit your organisation
Know how Wikidata can be used to crowdsource data
Know how Wikidata can bring open knowledge back to your organisation
Know the steps to undertake mass edits
Know the steps to undertake mass donations
Know where to look up statements
Made a list of differences in statements from your organisation
Have seen Wikidata Queries
Discussed the potential of Wikidata for your organisation/sector
Socialised

NEDERLAND
Introduction Wikidata

NEDERLAND
Wikidata is a free linked database that can be
read and edited by both humans and machines.

NEDERLAND
Wikidata acts as central storage for the
structured data of its Wikimedia sister projects
including Wikipedia, Wikivoyage, Wikisource, and
others.

NEDERLAND
Data in Wikidata is in the public domain

NEDERLAND
You’ve been using it already
The BIG Interwiki problem

NEDERLAND
https://nl.wikipedia.org/wiki/Lachen_(gedrag)

NEDERLAND
Notability
Not everything is notable data

NEDERLAND Wikidata processes
Wikipedia Wikidata
Governance structure Mature Immature
Sources and references Mature Immature
Determination of appropriate content Community Growing
Quality control Mature Growing
Village pump (community debate) Mature Growing
Example of determination of notability: Constraint reports

NEDERLAND
Properties
https://www.wikidata.org/wiki/Wikidata:List_of_properties/all

NEDERLAND
Properties: artwork

NEDERLAND
https://www.wikidata.org/wiki/Wikidata:List_of_properties/Works#Specialized_properties

NEDERLAND
Proposing properties
The community determines the properties
Search, search, search
https://www.wikidata.org/wiki/Wikidata:Property_proposal

NEDERLAND So what about
semantics? Taxonomy?
The community determines the properties
Solution: make a mapping
https://www.wikidata.org/wiki/Wikidata:Property_proposal

NEDERLAND
Reasonator
http://tools.wmflabs.org/reasonator/

STEP 1
NEDERLAND
STEP 2
STEP 3

NEDERLAND
https://en.wikipedia.org/wiki/Wikipedia:Babel

NEDERLAND
Autolist 2
http://tools.wmflabs.org/autolist/index.php

NEDERLAND
Oauth Because of Oauth you can edit tools
with your own global account

NEDERLAND
Pywikibot
Wikidata is being run by bots

NEDERLAND
Toolscript
Run javascript from your browser
https://tools.wmflabs.org/toolscript/index.html

NEDERLAND
Wikidata results
Find Wikidata on Wikipedia
(not installed in nl.wikipedia.org yet)
Let’s go to the Tamil Wikipedia….
and search for hagelslag.
https://ta.wikipedia.org/wiki/!l_அைமp'

NEDERLAND
http://www.histropedia.com

NEDERLAND
Wikidata the game
http://tools.wmflabs.org/wikidata-game/

NEDERLAND
http://tools.wmflabs.org/wikidata-game/

NEDERLAND
Let’s edit
Pick a not so famous person/item/building/…
Look for inspiration at a very famous person/item/building/…

NEDERLAND
Why
Batch editing
Correcting / improving a property

NEDERLAND
Why
Batch editing
Example:
AdLib > Europeana Data Model > GLAMwiki Toolset

NEDERLAND
Why
Batch editing
Example:
Data lost Data lost

NEDERLAND
Why
Batch editing
Batch creation
Example:
Data lost Data lost

NEDERLAND
Human / Machine
Batch editing

NEDERLAND
Human
Batch editing

NEDERLAND
Human
Batch editing
Case: University alumni
http://ultimategerardm.blogspot.nl/2014/11/wikidata-wikipedia-categories.html

NEDERLAND
https://tools.wmflabs.org/reasonator/?q=Q8884100

NEDERLAND
Current language Wikipedias
en Category:University of Notre Dame
alumni
Big Wikipedias
es Categoría:Alumnado de la
Universidad de Notre Dame
fr Catégorie:Étudiant de l'université
Notre-Dame-du-Lac
pt Categoria:Ex-alunos da
Universidade de Notre Dame
Wikimedia Commons
commons Category:Alumni of the University
of Notre Dame
Other Wikipedias
gl Categoría:Alumnos da
ko 분류:노터데임 대학교 동문
la Categoria:Alumni Universitatis
Dominae Nostrae a Lacu
ro Categorie:Absolvenți ai University
of Notre Dame
sl Kategorija:Diplomiranci Univerze
Notre Dame
zh Category:聖⺟母⼤大學校友
people who studied at
the university of Notre Dame

Wikidata knows about Wikipedia categories. NEDERLAND
Currently there are items for 2,406,128 categories.
Many of those items refer to categories in multiple Wikipedias. One random
example is item Q8884100, it refers to categories in 10 Wikipedias.
All of them categorize people who studied at the university of Notre Dame. Many
of them know about people only known in that Wikipedia. In addition to this there
may be articles that are not categorised or references to articles that are not in
one of the 10 categories known at this time.

NEDERLAND
When multiple categorised are "harvested" in Wikidata, Wikidata knows
about more items than any of the individual categories. This enables the
use of the data in new ways.
• suggest categories based on the presence of statements in the Wikidata
category
• suggest statement when an article is included in a category
• include red links in a category when a Wikipedia does not have articles.

Current language Wikipedias NEDERLAND
en Category:University of Notre Dame
alumni
Big Wikipedias
es Categoría:Alumnado de la
Universidad de Notre Dame
fr Catégorie:Étudiant de l'université
Notre-Dame-du-Lac
pt Categoria:Ex-alunos da
Wikimedia Commons
commons Category:Alumni of the University
of Notre Dame
Other Wikipedias
gl Categoría:Alumnos da
ko 분류:노터데임 대학교 동문
la Categoria:Alumni Universitatis
Dominae Nostrae a Lacu
ro Categorie:Absolvenți ai University
of Notre Dame
sl Kategorija:Diplomiranci Univerze
Notre Dame
zh Category:聖⺟母⼤大學校友

NEDERLAND
ES + FR + PT + =
EN
Wikidata
Let’s compare categories
people who studied at
the university of Notre Dame

NEDERLAND
There’s a difference between wiki's
ES + FR + PT + =
EN
Wikidata

NEDERLAND
ES + FR + PT + =
EN
Person A
Person B
Person C
……
Person D
Person X
Person Z
……
Person A
Person F
Person K
…… Person D
Person X
…..
Wikidata
Missing articles can be red links

NEDERLAND
What if a new article is added?
ES + FR + PT + =
EN
Person A
Person B
Person C
……
Person D
Person X
Person Z
……
Person A
Person F
Person K
…… Person D
Person X
…..
Wikidata
Person + Person +

NEDERLAND
Well, suggest it to the wiki’s…
ES + FR + PT + =
EN
Person A
Person B
Person C
……
Person D
Person X
Person Z
……
Person A
Person F
Person K
…… Person D
Person X
…..
Wikidata
Person + Person + Person + Person + Person +

NEDERLAND
Human
Batch editing
Case: merging

NEDERLAND
https://www.wikidata.org/wiki/User:Pasleim/projectmerge/enwiki-nlwiki

NEDERLAND
https://www.wikidata.org/wiki/User:Ivan_A._Krestinin/To_merge/nlwiki

NEDERLAND
Scenario
What kind of information would you probably batch edit?
What is available in your sources?
What are the properties on Wikidata?
What should the code look like?

NEDERLAND
Item drafting
What kind of information would you probably batch edit?
What is available in your sources?
What are the properties on Wikidata?
What should the code look like?

NEDERLAND
Machine
Batch editing

NEDERLAND
Batch data import
Mass addition and integration of data into Wikidata

NEDERLAND
Batch data import
Example projects

NEDERLAND
By Sebastiaan ter Burg (Flickr: Domtoren in Utrecht) [CC-BY-SA-2.0 (http://creativecommons.org/licenses/by-sa/2.0)], via Wikimedia Commons

NEDERLAND
Hans Bollongier (fl. 1623–1672) [Public domain], via Wikimedia Commons
Sum of all paintings
https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings

NEDERLAND
By Rob Bogaerts / Anefo (Nationaal Archief)
[CC-BY-SA-3.0-nl (http://creativecommons.org/licenses/by-sa/3.0/nl/deed.en)], via Wikimedia Commons

NEDERLAND
By Didier Descouens (Own work) [CC-BY-SA-4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

NEDERLAND
Remember…
Data in Wikidata is in the public domain

NEDERLAND
First:
What’s in the dataset?
What’s the quality?
What …
By Ministry of Information Photo Division Photographer [Public domain], via Wikimedia Commons

NEDERLAND
How can an item be identified?

NEDERLAND
How can an item be identified?
With unique
identifiers

https://www.rijksmuseum.nl/en/collection/SK-A-5003
https://www.wikidata.org/wiki/Q3090610
NEDERLAND
Inventory numbers are usable
as identifiers

NEDERLAND
Clean your data Before you import:
By Sherif9282 (Own work) [CC-BY-SA-3.0
(http://creativecommons.org/licenses/by-sa/3.0) or
GFDL (http://www.gnu.org/copyleft/fdl.html)], via Wikimedia Commons

NEDERLAND
Start up your robot Demonstration
By Ian McKellar from San Francisco, CA, USA [CC-BY-SA-2.0 (http://creativecommons.org/licenses/by-sa/2.0)], via Wikimedia Commons

NEDERLAND
SK-A-5003 > Q3090610

NEDERLAND
Bundesarchiv, Bild 183-49993-0006 /
CC-BY-SA [CC-BY-SA-3.0-de
(http://creativecommons.org/licenses/by-sa/3.0/de/deed.en)],
via Wikimedia Commons

NEDERLAND
There is an array
Trust me…
[[eggs, bananas],catfood, toiletpaper] An array is like grocery list in your head…

NEDERLAND
Example of what’s running
https://git.wikimedia.org/blob/labs%2Ftools%2Fmultichill.git/e6a873ea1d397e22965b2a69d08a2cd7b410d562/bot%2Fwikidata%2Frijksmuseum_import.py
https://git.wikimedia.org/tree/labs%2Ftools%2Fmultichill.git/HEAD/bot%2Fwikidata

NEDERLAND
Empty items = no fun
Fill her up!
By Jocelyn Augustino (This image is from the FEMA Photo Library.) [Public domain], via Wikimedia Commons

NEDERLAND
Batch creation:
1.Adding items is easy
2.Deleting or changing
items is difficult
Henri Brispot [Public domain], via Wikimedia Commons
First come
First served

NEDERLAND
Setting up batches
1. Create a bot account
2. Discuss bot tasks
3. Get a bot flag
4. Run your bot
https://www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot

NEDERLAND
Uses:
Feedback loop
(List of differences)

NEDERLAND
Small steps
Small errors, human edits,
drafting code

20141114 wikidata glam_workshop2

Recommended

More Related Content

Similar to 20141114 wikidata glam_workshop2 (20)

More from Sebastiaan ter Burg (18)

Recently uploaded (20)

20141114 wikidata glam_workshop2