Linked Open Data for Libraries

University library

Linked Open Datafor librariesLukas Koster

Library Systems CoordinatorLibrary of the University of Amsterdamhttp://www.uba.uva.nl@lukask

NVB 2011, 17 november 2011

NVB 2011, 17 november 2011 2

University library

http://www.loc.gov/marc/transition/news/framework-103111.html

NVB 2011, 17 november 2011 3

University library

Agenda

Open data Linked data Linked Open Data and Libraries Options for libraries Recommendations

NVB 2011, 17 november 2011 4

University library

Open data: 5 stars (Tim Berners-Lee)

Data: no stars

Open Data: 1 star - Open Licence

Open Data: 2 stars - Reusable

Open Data: 3 stars - Open Format

Linked Open Data: 4 stars - URI's

Linked Open Data: 5 stars - Linked Data

NVB 2011, 17 november 2011 5

University library

Linked data: 4 rules (Tim Berners-Lee)

1. Use URIs as names for things 2. Use HTTP URIs so that people can look up those names. 3. When someone looks up a URI, provide useful information,

using the standards (RDF, SPARQL) 4. Include links to other URIs, so that they can discover more

things.

http://www.w3.org/DesignIssues/LinkedData.html

NVB 2011, 17 november 2011 6

University library

RDF

URI

Triple

Ontology

Vocabulary

NVB 2011, 17 november 2011 7

University library

URIs

Unique identifiers on the web

Instead of internal database primary keyhttp://viaf.org/viaf/102403515 (Dan Brown)

http://openlibrary.org/works/OL76837W (The Da Vinci Code)

NVB 2011, 17 november 2011 8

University library

Relational databases: primary keys

Books

Title

Author

Year

ID

Authors

Name

Year

ID

Primary key Primary key

Foreign key

Authors record

Dan Brown

1964

456ID

Name

Year

The Da Vinci Code

Books record

456

2003

1289

Title

ID

Author

Year

NVB 2011, 17 november 2011 9

University library

Relational databases and applications

Select title, year from booksSelect name, year from authors where books.author=authors.id

Title: The Da Vinci CodeAuthor: Dan Brown, 1964Year: 2003

Database

Application

User interface

Authors record

Dan Brown

1964

456ID

Name

Year

The Da Vinci Code

Books record

456

2003

1289

Title

ID

Author

Year

SQL

NVB 2011, 17 november 2011 10

University library

URIs

OpenLibrary

Title

Author

Year

URI

VIAF

Name

Year

URI

Primary key Primary key

Foreign key

Authors record

Dan Brown

1964

http://viaf.org/viaf/102403515 URI

Name

Year

The Da Vinci Code

Books record

http://viaf.org/viaf/102403515

2003

http://openlibrary.org/works/OL76837W

Title

URI

Author

Year

NVB 2011, 17 november 2011 11

University library

Linked data and applications

Select ?title ?year …Select ?name ?year WHERE …..

Title: The Da Vinci CodeAuthor: Dan Brown, 1964Year: 2003

Database

Application

User interface

SPARQL

Authors record

Dan Brown

1964

http://viaf.org/viaf/102403515 URI

Name

Year

The Da Vinci Code

Books record


2003


Title

URI

Author

Year

NVB 2011, 17 november 2011 12

University library

Triples •Subject - Predicate – Object

•Thing – Relation - Thing

written by

painted byis about

author ofpainter of

is subject of

uri

uri

uri

uri

uri

uri

NVB 2011, 17 november 2011 13

University library

Triples and URIs

URIs for: Subject Object Relation

uri

uri

uri



http://purl.org/dc/terms/creator

NVB 2011, 17 november 2011 14

University library

RDF – Resource Description Framework

Used for defining ontologies/vocabularies Data model (what can be described)

Classes (types), attributes, relations

Used for describing triples Data (what is described)

Objects, attribute values, relations

NVB 2011, 17 november 2011 15

University library

Description: http://bibliontology.com

Namespace: http://purl.org/ontology/bibo/

NVB 2011, 17 november 2011 16

University library

BIBO - Bibliographic Ontology

xml:base="http://purl.org/ontology/bibo/" xmlns:owl2xml="http://www.w3.org/2006/12/owl2-xml#" xmlns:terms="http://purl.org/dc/terms/" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" xmlns:status="&bibo;status/" xmlns:vann="http://purl.org/vocab/vann/" xmlns:schema="http://schemas.talis.com/2005/address/schema#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:prism="http://prismstandard.org/namespaces/1.2/basic/" xmlns:owl="http://www.w3.org/2002/07/owl#" xmlns:skos="http://www.w3.org/2004/02/skos/core#" xmlns:event="http://purl.org/NET/c4dm/event.owl#" xmlns:ns="http://www.w3.org/2003/06/sw-vocab-status/ns#" xmlns:degrees="&bibo;degrees/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/">

Ontologies used

Dublin Core - Metadata

FOAF - People

SKOS – Thesaurus, Subjects

NVB 2011, 17 november 2011 17

University library


 <owl:Class rdf:about="Book"> <rdfs:label xml:lang="en">Book</rdfs:label> <rdfs:subClassOf rdf:resource="Document"/> <rdfs:isDefinedBy rdf:datatype="&xsd;anyURI" >http://purl.org/ontology/bibo/</rdfs:isDefinedBy> <ns:term_status>stable</ns:term_status> <rdfs:comment xml:lang="en">A written or printed work of fiction or nonfiction, usually on

sheets of paper fastened or bound together within covers. </rdfs:comment> </owl:Class>

Class/Object type

NVB 2011, 17 november 2011 18

University library


<urn:isbn:0385504209> a bibo:Book ;dc:creator <http://viaf.org/viaf/102403515> ;dc:title “The Da Vinci Code"@en ;dc:date "2003“

Book example

NVB 2011, 17 november 2011 19

University library

OpenLibrary.org: RDFSubjects as string values

<dcterms:subject>Fiction</dcterms:subject> <dcterms:subject>Cryptographers</dcterms:subject> <dcterms:subject>Grail</dcterms:subject> <dcterms:subject>Secret societies</dcterms:subject> <dcterms:subject>Art museum curators</dcterms:subject> <dcterms:subject>Manuscripts</dcterms:subject> <dcterms:subject>Appreciation</dcterms:subject> <dcterms:subject>Crimes against</dcterms:subject> <dcterms:subject>Romans</dcterms:subject> <dcterms:subject>Aventures</dcterms:subject> <dcterms:subject>Suspense fiction</dcterms:subject> <dcterms:subject>Religious articles</dcterms:subject> <dcterms:subject>Occultisme</dcterms:subject> <dcterms:subject>Accessible book</dcterms:subject> <dcterms:subject>Protected DAISY</dcterms:subject>

NVB 2011, 17 november 2011 20

University library

Subjects as URIs

<dcterms:subject>

http://dbpedia.org/resource/The_Last_Supper_%28Leonardo_da_Vinci%29

</dcterms:subject>

<dcterms:subject>

http://id.loc.gov/authorities/names/n98088614

</dcterms:subject>

NVB 2011, 17 november 2011 21

University libraryDBPedia (WikiPedia)

NVB 2011, 17 november 2011 22

University libraryLoC

NVB 2011, 17 november 2011 23

University library

Two sides

PublishConsume

NVB 2011, 17 november 2011 24

University library

Summary: Linked Open Data

WWW

The web as global database/web of data

RDF as universal API

Applications using global data via RDF

NVB 2011, 17 november 2011 25

University library

Original objective of libraries

Gateways to information

Printed material

Physical objects

On location

Bibliotheken en leeszalen in beeld, 1990

NVB 2011, 17 november 2011 26

University library

Changing information world

WWW

http://www.flickr.com/photos/elenaromera/353826561/

http://www.flickr.com/photos/simona_/4068354970/

NVB 2011, 17 november 2011 27

University library

Changing role for libraries

Reference desk

Content curation

Information gateway

NVB 2011, 17 november 2011 28

University library

Linked data options for libraries

Consume

Traditional cataloguing

Enrichment of existing catalogue data

Create new information aggregates (new!) Publish (unique stuff)

Holdings/usage data

Special collections

NVB 2011, 17 november 2011 29

University library


Traditional cataloguing

NVB 2011, 17 november 2011 30

University library

Links as text strings

Links to internal records

NVB 2011, 17 november 2011 31

University library

RDA

Resource Description and Access

NVB 2011, 17 november 2011 32

University library

FRBR

Functional Requirements for Bibliographic Records

Defined in relation to tasks performed by users when searching and making use of national bibliographies and library catalogues

http://archive.ifla.org/VII/s13/frbr/frbr_current2.htm#2.2

NVB 2011, 17 november 2011 33

University library

FRBR User Tasks Find Identify Select Obtain Navigate

NVB 2011, 17 november 2011 34

University library

FRBR

Group 1: What? Work Expression Manifestation ItemGroup 2: By who? Person Corporate Body

FRAD Functional Requirements for Authority Data Group 3: About what? Concept Object Event Place

FRSAD Functional Requirements for Subject Authority Data

Title – Author - Subjecthttp://archive.ifla.org/VII/s13/frbr/frbr_current2.htm#2.2

NVB 2011, 17 november 2011 35

University library

http://www.loc.gov/cds/downloads/FRBR.PDF

© Library of Congress/Barbara Tillett

NVB 2011, 17 november 2011 36

University library

FRBR for books

Editions

Copies

Original

AdaptationTranslation

NVB 2011, 17 november 2011 37

University library

FRBR Group 1 Entities - WEMI

Manifestation

Item

Work

Expression

Catalogue

Missing links

NVB 2011, 17 november 2011 38

University library

Triples

written by

painted byis about

author ofpainter of

is subject of

uri

uri

uri

uri

uri

uri

NVB 2011, 17 november 2011 39

University library

LOD, FRBR and cataloguingwritten by

painted by

author of

painter of

is subject of

http://permalink.opc.uva.nl/item/001665446

is about

Manifestation

Item

Work

Expression


Dan Brown


The Da Vinci Code


Leonardo da Vinci

http://id.loc.gov/authorities/names/n98088614

The Last Supper

Dutch translationDe Da Vinci Code

HoldingOBA

http://www.worldcat.org/libraries/57394

http://<expression-uri>

http://<manifestation-uri>

Library

NVB 2011, 17 november 2011 40

University library

URI http://openlibrary.org/works/OL76837W

Original Title The Da Vinci Code 245 $a

Author http://viaf.org/viaf/102403515 100 $a

Subject http://en.wikipedia.org/wiki/The_Last_Supper_(Leonardo_da_Vinci)

650 $a

Work

URI http://<expression-uri>

Work http://openlibrary.org/works/OL76837W

Language dut (or: URI to language code) 546 $a

Title De Da Vinci Code 245 $a

Expression

URI http://<manifestation-uri>

Expression http://<expression-uri>

Publisher http://isbndb.com/d/publisher/anchor_books.html 260 $b

Date 2006 260 $c

Manifestation

NVB 2011, 17 november 2011 41

University library

URI http://openlibrary.org/works/OL76837WWork

URI http://<expression-uri>

Work http://openlibrary.org/works/OL76837W

Expression

URI http://<manifestation-uri>

Expression http://<expression-uri>Manifestation

URI http://<holding-uri>

Library http://www.worldcat.org/libraries/57394

Manifestation http://<manifestation-uri>

Holding

URI http://<item-uri>

Holding http://<holding-uri>

Availability

Item(s)

Global shared bibliographic data

Local holdings data

WWW

NVB 2011, 17 november 2011 42

University library

PublishersManifestation

Item

Work

Expression

FRBR Group 1 FRBR Group 2FRAD

FRBR Group 3FRSAD

Holding

Libraries

NVB 2011, 17 november 2011 43

University library

Problems - challenges

Existing circumstances not suited for moving to Linked Cataloguing - RDA/FRBR/LOD:

Database - Bibliographic formats (MARC) Applications - Local library systems

NVB 2011, 17 november 2011 44

University library

Linked Cataloguing - What’s needed Global Shared Bibliographic Metadata Store(s) Global Shared Authority Files Open Cataloguing systems Supporting for linking with URIs

NVB 2011, 17 november 2011 45

University library


Enrichment of existing data

NVB 2011, 17 november 2011 46

University library

FRBR

Links

NVB 2011, 17 november 2011 47

University library http://search.obvsg.at/OBV

FRBR

NVB 2011, 17 november 2011 48

University library http://search.obvsg.at/OBV

Text about authorEmbedded from DBPedia(Wikipedia Linked Data engine)Uses German National Library Author ID’s

NVB 2011, 17 november 2011 49

University library

Enrichment - Discovery front ends

Examples use Discovery front ends Extra layer on top of processed catalogue metadata Metadata are FRBRised, based on string matching Linked data embedded using scripts/programming,

manipulating HTML front end

NVB 2011, 17 november 2011 50

University library

Example: Pilot project

Linking library catalogue data to theatre performance data

Dutch Digital Cultural Heritage Foundation DEN as instigator

http://den.nl/

Library of the University of Amsterdam Theatre Institute of The Netherlands

http://tin.nl/http://www.uba.uva.nl/

NVB 2011, 17 november 2011 51

University library

Library catalogue results

No FRBR here (yet)

NVB 2011, 17 november 2011 52

University library

Library catalogue results

NVB 2011, 17 november 2011 53

University library

TIN theatre production database

NVB 2011, 17 november 2011 54

University library

TIN theatre production database

NVB 2011, 17 november 2011 55

University library

What we made

NVB 2011, 17 november 2011 56

University library

How we did it - URIs

<base-url>/person/Beckett, Samuel

<base-url>/title/Beckett, Samuel/Waiting for Godot

JavaScript/JQuery

HTML

NVB 2011, 17 november 2011 57

University library

How we did it – JavaScript/JQuery<base-url>/person/Beckett, Samuel

<base-url>/title/Beckett, Samuel/Waiting for Godot

<base-url>/production/Beckett, Samuel/Waiting for Godot/1988-11-22/6750

NVB 2011, 17 november 2011 58

University library

Problems/challenges No common identifiers

Aleph key ≠ key No internal links to common entity

No central “Work” String matching

Author: ‘Samuel Beckett’- ‘Beckett, Samuel’

Title: ‘Waiting for Godot’ –’En attendant Godot’ Copyright

Photos, videos, audio, artwork

NVB 2011, 17 november 2011 59

University library

Identifiers/URIs/String matching

/title/Beckett, Samuel/Waiting for Godot

/title/Beckett, Samuel/Waiting for Godot : a tragicomedy in two acts

/title/Beckett, Samuel/En attendant Godot : pièce en deux actes

/title/Beckett, Samuel/Wachten op Godot

/title/Beckett, Samuel/Waiting for Godot

/title/Beckett, Samuel/Waiting For Godot

/title/Beckett, Samuel/Wachten op Godot

/title/Beckett, Samuel/Wachtend op Godot

/title/Beckett, Samuel/Wachten op Godot (De favorieten)

/title/Beckett, Samuel/Wachten op Godot (eerste bedrijf)

/title/Beckett, Samuel/En attendant Godot

/title/Beckett, Samuel/Warten auf Godot

NVB 2011, 17 november 2011 60

University library

Ideally….

FRBR

NVB 2011, 17 november 2011 61

University library

Current situation

Implicit relations

NVB 2011, 17 november 2011 62

University library

Enrichment - What’s needed New search type: linked data search Mechanisms for consuming external linked data

sources Options to identify trustworthy LOD sources Automatic retrieval and processing of RDF

vocabularies

NVB 2011, 17 november 2011 63

University library


Create new information aggregates

NVB 2011, 17 november 2011 64

University library

The girl

The war

The house

The diary

The book

The movie

The playAbout

Library catalogue

FRBR

Subject: Anne Frank

NVB 2011, 17 november 2011 65

University library

New aggregations

http://www.annefrank.org/en/Subsites/Timeline/#

NVB 2011, 17 november 2011 66

University library

LOCAH – Linking LivesLinked Open Copac Archives Hub

http://blogs.ukoln.ac.uk/locah/

http://data.archiveshub.ac.uk/

Publish linked dataArchives+libraries

Using Linked Data to create biographical resources

http://archiveshub.ac.uk/linkinglives

NVB 2011, 17 november 2011 67

University library

New Aggregates - What’s needed Content curation Cooperation

Technology Expertise New systems

NVB 2011, 17 november 2011 68

University library


Publishing

NVB 2011, 17 november 2011 69

University library

Publishing linked data

RDF: Ontology

Ontologies (re)used (namespaces)

Object types, attributes, relations Triples

On the fly

Triple store

NVB 2011, 17 november 2011 70

University library

Publishing library data as linked data

Bibliographic information:

FRBR Work/Expression/Manifestation

FRAD Authors/Creators

FRSAD SubjectsIdeally only once, no redundancy

Publishers

LoC New Bibliographic Framework

Not unique

NVB 2011, 17 november 2011 71

University library


Holdings information:

Holdings per library

FRBR Items Usage data

Unique

Approved

NVB 2011, 17 november 2011 72

University library


Special collections

=

Cultural heritage

Archives

Museums

Unique

Approved

NVB 2011, 17 november 2011 73

University library

Publishing - What’s needed System development skills/staff Linked Data features added to existing library

systems

New generic linked data information systems, tools,

online services

NVB 2011, 17 november 2011 74

University library

Recommendations

Cooperate! Libraries, Archives, Museums Consortia

Ask library systems vendors to adapt (next gen) systems: FRBR/RDA/Linking architecture/infrastructure LOD/RDF/URI Publishing options LOD/RDF/URI Consuming options

NVB 2011, 17 november 2011 75

University library

Existing library system vendors

adding publishing options

authority files - VIAF

working with user grouphttp://igelu.org/special-interests/lod

NVB 2011, 17 november 2011 76

University library

Linked Open Data: Systems and tools

Develop your own systems/open source Use existing commercial systems Consortia infrastructures National platforms Use free tools

NVB 2011, 17 november 2011 77

University library

http://kasabi.com/

NVB 2011, 17 november 2011 78

University library

http://dydra.com/

NVB 2011, 17 november 2011 79

University library

http://revyu.com/

NVB 2011, 17 november 2011 80

University library

http://virtuoso.openlinksw.com/

NVB 2011, 17 november 2011 81

University library

http://metadataregistry.org/

NVB 2011, 17 november 2011 82

University library

http://thedatahub.org/

NVB 2011, 17 november 2011 83

University library

Library Linked Data documentation

W3C Library Linked Data Incubator Group, Report:

http://www.w3.org/2005/Incubator/lld/XGR-lld-20111025/

IGeLU 2011 session Linked Data and Ex Libris products, Summary slides:

http://igelu.org/wp-content/uploads/2011/09/Linked-data-and-Ex-Libris-products-Summary.pdf

Tutorial publishing linked open data by DEN: http://www.den.nl/pagina/334/den-lab/

Linked Open Data for Libraries

Education

Transcript of Linked Open Data for Libraries