20141114 wikidata glam_workshop2
110
NEDERLAND Wikidata for GLAMs WIKIMEDIA NEDERLAND Sebastiaan ter Burg & Maarten Dammers With thanks to Gerardm & FakirNL
-
Upload
sebastiaan-ter-burg -
Category
Internet
-
view
786 -
download
0
description
Workshop Wikidata for Galleries, Libraries, Archives and Museums by Sebastiaan ter Burg and Maarten Dammers. In this workshop are - the basics of Wikidata and the relation to Wikipedia and other Wikimedia projects explained, - some exercises of single item edits given, - batch edits explained.
Transcript of 20141114 wikidata glam_workshop2
NEDERLAND
Wikidata for GLAMsWIKIMEDIA NEDERLAND
Sebastiaan ter Burg & Maarten DammersWith thanks to Gerardm & FakirNL
NEDERLAND
ProgramTime10:30 Welcome10:50 Introduction Wikidata11:10 Tools11:30 Break11:45 Edit single properties12:15 Lunch12:45 Batch editing properties14:00 Batch item creation15:00 Break15:15 Wikidata Queries15:45 Wikidata Queries hands-on16:30 Discussion17:15 Drinks
NEDERLAND
ObjectivesKnow what Wikidata isBasic knowledge of how Wikidata worksBasic idea what volunteers are doing with Wikidata at the momentDid manual editsKnow how Wikidata can benefit your organisationKnow how Wikidata can be used to crowdsource dataKnow how Wikidata can bring open knowledge back to your organisationKnow the steps to undertake mass editsKnow the steps to undertake mass donationsKnow where to look up statementsMade a list of differences in statements from your organisationHave seen Wikidata QueriesDiscussed the potential of Wikidata for your organisation/sectorSocialised
NEDERLAND
Who’s who?
NEDERLAND
Introduction Wikidata
NEDERLAND
Wikidata is a free linked database that can be read and edited by both humans and machines.
NEDERLAND
Wikidata acts as central storage for the structured data of its Wikimedia sister projects including Wikipedia, Wikivoyage, Wikisource, and others.
NEDERLAND
Data in Wikidata is in the public domain
NEDERLAND
You’ve been using it alreadyThe BIG Interwiki problem
NEDERLAND
https://nl.wikipedia.org/wiki/Lachen_(gedrag)
NEDERLAND
https://nl.wikipedia.org/wiki/Lachen_(gedrag)
NEDERLAND
NotabilityNot everything is notable data
NEDERLAND
Structure Wikidata
NEDERLAND
NEDERLAND
NEDERLAND
Wikidata processes
NEDERLANDWikidata processesWikipedia Wikidata
Governance structure Mature ImmatureSources and references Mature ImmatureDetermination of appropriate content Community GrowingQuality control Mature Growing Village pump (community debate) Mature Growing
Example of determination of notability: Constraint reports
NEDERLAND
https://www.wikidata.org/wiki/Wikidata:List_of_properties/all
Properties
NEDERLAND
NEDERLAND
Properties: artwork
NEDERLAND
NEDERLAND
https://www.wikidata.org/wiki/Wikidata:List_of_properties/Works#Specialized_properties
NEDERLAND
Proposing properties
https://www.wikidata.org/wiki/Wikidata:Property_proposal
The community determines the properties
Search, search, search
NEDERLAND
So what aboutsemantics? Taxonomy?
https://www.wikidata.org/wiki/Wikidata:Property_proposal
The community determines the properties
Solution: make a mapping
NEDERLAND
Tools
NEDERLAND
NEDERLAND
NEDERLAND
NEDERLAND
NEDERLAND
Reasonator gadget
NEDERLAND
STEP 1
STEP 2
STEP 3
NEDERLAND
Languages shown
NEDERLAND
https://en.wikipedia.org/wiki/Wikipedia:Babel
NEDERLAND
Autolist 2http://tools.wmflabs.org/autolist/index.php
NEDERLAND
WiDar
NEDERLAND
OauthBecause of Oauth you can edit tools
with your own global account
NEDERLAND
PywikibotWikidata is being run by bots
NEDERLAND
ToolscriptRun javascript from your browser
https://tools.wmflabs.org/toolscript/index.html
NEDERLAND
NEDERLAND
NEDERLAND
Wikidata resultsFind Wikidata on Wikipedia
(not installed in nl.wikipedia.org yet)
https://ta.wikipedia.org/wiki/!l_அைமp' Let’s go to the Tamil Wikipedia….
and search for hagelslag.
NEDERLAND
NEDERLAND
http://www.histropedia.com
NEDERLAND
Wikidata the game
http://tools.wmflabs.org/wikidata-game/
NEDERLAND
BREAK
NEDERLAND
Single edit
NEDERLAND
Let’s editPick a not so famous person/item/building/… Look for inspiration at a very famous person/item/building/…
NEDERLAND
Batch editing
NEDERLAND
Batch editingWhy
Correcting / improving a property
NEDERLAND
Batch editingWhy
Example: AdLib > Europeana Data Model > GLAMwiki Toolset
NEDERLAND
Batch editingWhy
Example: AdLib > Europeana Data Model > GLAMwiki Toolset
Data lost Data lost
NEDERLAND
Batch editingWhy
Example: AdLib > Europeana Data Model > GLAMwiki Toolset
Data lost Data lost
Batch creation
NEDERLAND
Batch editingHuman / Machine
NEDERLAND
Batch editingHuman
NEDERLAND
Batch editingHuman
Case: University alumni
http://ultimategerardm.blogspot.nl/2014/11/wikidata-wikipedia-categories.html
NEDERLAND
https://tools.wmflabs.org/reasonator/?q=Q8884100
NEDERLANDCurrent language Wikipedias
en Category:University of Notre Dame alumni
Big Wikipediases Categoría:Alumnado de la
Universidad de Notre Dame
fr Catégorie:Étudiant de l'université Notre-Dame-du-Lac
pt Categoria:Ex-alunos da Universidade de Notre Dame
Wikimedia Commonscommons Category:Alumni of the University
of Notre Dame
Other Wikipediasgl Categoría:Alumnos da
Universidade de Notre Dame
ko 분류:노터데임 대학교 동문
la Categoria:Alumni Universitatis Dominae Nostrae a Lacu
ro Categorie:Absolvenți ai University of Notre Dame
sl Kategorija:Diplomiranci Univerze Notre Dame
zh Category:聖⺟母⼤大學校友
people who studied at the university of Notre Dame
NEDERLANDWikidata knows about Wikipedia categories.
Currently there are items for 2,406,128 categories.
Many of those items refer to categories in multiple Wikipedias. One random example is item Q8884100, it refers to categories in 10 Wikipedias.
All of them categorize people who studied at the university of Notre Dame. Many of them know about people only known in that Wikipedia. In addition to this there may be articles that are not categorised or references to articles that are not in one of the 10 categories known at this time.
http://ultimategerardm.blogspot.nl/2014/11/wikidata-wikipedia-categories.html
NEDERLAND
When multiple categorised are "harvested" in Wikidata, Wikidata knows about more items than any of the individual categories. This enables the use of the data in new ways.
• suggest categories based on the presence of statements in the Wikidata category
• suggest statement when an article is included in a category
• include red links in a category when a Wikipedia does not have articles.
http://ultimategerardm.blogspot.nl/2014/11/wikidata-wikipedia-categories.html
NEDERLANDCurrent language Wikipediasen Category:University of Notre Dame
alumni
Big Wikipediases Categoría:Alumnado de la
Universidad de Notre Dame
fr Catégorie:Étudiant de l'université Notre-Dame-du-Lac
pt Categoria:Ex-alunos da Universidade de Notre Dame
Wikimedia Commonscommons Category:Alumni of the University
of Notre Dame
Other Wikipediasgl Categoría:Alumnos da
Universidade de Notre Dame
ko 분류:노터데임 대학교 동문
la Categoria:Alumni Universitatis Dominae Nostrae a Lacu
ro Categorie:Absolvenți ai University of Notre Dame
sl Kategorija:Diplomiranci Univerze Notre Dame
zh Category:聖⺟母⼤大學校友
NEDERLANDCurrent language Wikipediasen Category:University of Notre Dame
alumni
Big Wikipediases Categoría:Alumnado de la
Universidad de Notre Dame
fr Catégorie:Étudiant de l'université Notre-Dame-du-Lac
pt Categoria:Ex-alunos da Universidade de Notre Dame
Wikimedia Commonscommons Category:Alumni of the University
of Notre Dame
Other Wikipediasgl Categoría:Alumnos da
Universidade de Notre Dame
ko 분류:노터데임 대학교 동문
la Categoria:Alumni Universitatis Dominae Nostrae a Lacu
ro Categorie:Absolvenți ai University of Notre Dame
sl Kategorija:Diplomiranci Univerze Notre Dame
zh Category:聖⺟母⼤大學校友
NEDERLAND
EN
ES FR PT+ + + =Wikidata
Let’s compare categories
people who studied at
the university of Notre Dame
NEDERLAND
EN
ES FR PT+ + + =Wikidata
There’s a difference between wiki's
NEDERLAND
EN
ES FR PT+ + + =Person APerson BPerson C……
Person DPerson XPerson Z……
Person APerson FPerson K…… Person D
Person X…..
Wikidata
Missing articles can be red links
NEDERLAND
EN
ES FR PT+ + + =Person APerson BPerson C……
Person DPerson XPerson Z……
Person APerson FPerson K…… Person D
Person X…..
Wikidata
Person + Person +
What if a new article is added?
NEDERLAND
EN
ES FR PT+ + + =Person APerson BPerson C……
Person DPerson XPerson Z……
Person APerson FPerson K…… Person D
Person X…..
Wikidata
Person +Person + Person +Person + Person +
Well, suggest it to the wiki’s…
NEDERLAND
Batch editingHuman
Case: merging
NEDERLAND
STEP 1
STEP 2
STEP 3
NEDERLAND
NEDERLAND
NEDERLANDhttps://www.wikidata.org/wiki/User:Pasleim/projectmerge/enwiki-nlwiki
NEDERLAND
https://www.wikidata.org/wiki/User:Ivan_A._Krestinin/To_merge/nlwiki
NEDERLAND
NEDERLAND
LUNCH
NEDERLAND
ScenarioWhat kind of information would you probably batch edit?
What is available in your sources?What are the properties on Wikidata?
What should the code look like?
NEDERLAND
Item draftingWhat kind of information would you probably batch edit?
What is available in your sources?What are the properties on Wikidata?
What should the code look like?
NEDERLAND
Batch editingMachine
NEDERLAND
Batch data importMass addition and integration of data into Wikidata
NEDERLAND
Batch data importExample projects
NEDERLAND
By Sebastiaan ter Burg (Flickr: Domtoren in Utrecht) [CC-BY-SA-2.0 (http://creativecommons.org/licenses/by-sa/2.0)], via Wikimedia Commons
NEDERLAND
Hans Bollongier (fl. 1623–1672) [Public domain], via Wikimedia Commons
https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings
Sum of all paintings
NEDERLAND
By Rob Bogaerts / Anefo (Nationaal Archief) [CC-BY-SA-3.0-nl (http://creativecommons.org/licenses/by-sa/3.0/nl/deed.en)], via Wikimedia Commons
NEDERLAND
By Didier Descouens (Own work) [CC-BY-SA-4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons
NEDERLAND
Data in Wikidata is in the public domain
Remember…
NEDERLAND
By Ministry of Information Photo Division Photographer [Public domain], via Wikimedia Commons
First: What’s in the dataset? What’s the quality? What …
NEDERLAND
How can an item be identified?
NEDERLAND
With unique identifiers
How can an item be identified?
NEDERLAND
https://www.rijksmuseum.nl/en/collection/SK-A-5003
https://www.wikidata.org/wiki/Q3090610
Inventory numbers are usable as identifiers
NEDERLAND
Clean your dataBefore you import:
By Sherif9282 (Own work) [CC-BY-SA-3.0 (http://creativecommons.org/licenses/by-sa/3.0) or GFDL (http://www.gnu.org/copyleft/fdl.html)], via Wikimedia Commons
NEDERLAND
By Ian McKellar from San Francisco, CA, USA [CC-BY-SA-2.0 (http://creativecommons.org/licenses/by-sa/2.0)], via Wikimedia Commons
Start up your robotDemonstration
NEDERLAND
19264 > Q1545193
NEDERLAND
SK-A-5003 > Q3090610
NEDERLAND
Bundesarchiv, Bild 183-49993-0006 / CC-BY-SA [CC-BY-SA-3.0-de (http://creativecommons.org/licenses/by-sa/3.0/de/deed.en)], via Wikimedia Commons
NEDERLAND
There is an arrayTrust me…
[[eggs, bananas],catfood, toiletpaper]An array is like grocery list in your head…
NEDERLAND
https://git.wikimedia.org/blob/labs%2Ftools%2Fmultichill.git/e6a873ea1d397e22965b2a69d08a2cd7b410d562/bot%2Fwikidata%2Frijksmuseum_import.py https://git.wikimedia.org/tree/labs%2Ftools%2Fmultichill.git/HEAD/bot%2Fwikidata
Example of what’s running
NEDERLAND
By Jocelyn Augustino (This image is from the FEMA Photo Library.) [Public domain], via Wikimedia Commons
Empty items = no funFill her up!
NEDERLAND
Start matching
NEDERLAND
1.Adding items is easy2.Deleting or changing
items is difficult
Henri Brispot [Public domain], via Wikimedia Commons
First comeFirst served
Batch creation:
NEDERLAND
Setting up batches1. Create a bot account2. Discuss bot tasks3. Get a bot flag4. Run your bot
https://www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot
NEDERLAND
BREAK
NEDERLAND
Wikidata queries
NEDERLAND
Tools for queries
NEDERLAND
Discussion
NEDERLAND
Uses:Feedback loop(List of differences)
NEDERLAND
Small stepsSmall errors, human edits,
drafting code
NEDERLAND
DRINKS
NEDERLAND
Wikidata for GLAMsWIKIMEDIA NEDERLAND
Sebastiaan ter Burg & Maarten DammersWith thanks to Gerardm & FakirNL
