A Logical Modelfor Digital Archives

Rathachai Chawuthairathachai.chawuthai@live.com

Information ManagementCSIM / AIT

Draft document 0.1

2

Agenda

• Introduction• Digital Preservation• Underlying Community

Knowledge• Logical Model• Prototype• Related works

3

Introduction

4

• Our valued digital information in the present may not be accessible or rendered originally in next 100 years.– Technological Obsolescence– Deterioration of digital storage media

• A reader in next 100 years may not understand our today digital information as same as author’s purpose.– Author and reader do not have same context knowledge– Changing of contextual knowledge over the time

• It could have the common knowledge somewhere that every local knowledge refer to.

Motivation

Yuan Li (2011), Flouris (2007)

5

User are to be able to access and understand

digital information in the future

SDA 2011 at Berlin

6

• To develop a theory for digital archive• To design an information model representing

contextual knowledge• To explore knowledge by linking archives

across communities ???????• To develop a prototype system in order to

test the theory

Objectives

7

• Do a theory by extending the existing theory of Flouris “Steps towards a theory of information preservation” (Underlying Community Knowledge)

• Design “Context Model” of“Underlying Common Community Knowledge”– Use linked metadata to model contextual knowledge– Refer to OAIS information model– Integrate with PREMIS metadata

• Build an archival system– Refer to OAIS guideline– Integrated with Fedora-Commons as a back-end service

Scopes

8

Digital Preservation

9

Example in 22nd Century

What is ? Error: DVDunreadable

Error: No program can open file format .doc

!7rò??àÕ ??ߟ²ÂÚÕ??ߟ²ÂÚ

ðŽɳ!Z?g! Õr/ÕŸ/?rò?

File is read protectedPlease key password

10

• Digital preservation is an active management of digital information to endure its accessibility over the time.

• Digital preservation types– Bit Preservation

Ability to produce a particular sequence of bits from storage media at any time.

– Data PreservationAbility to rendered the produced bit stream and produce a meaningful output from it at any time.

– Information PreservationAbility to understand the rendered digital object at any time

Overview

Flouris (2007)

11

• Preservation policy– To use well-known file format,

such as, .pdf, .xml, .tiff, .jpg, .avi, and etc• Preservation strategies

– Secure storage system, Software migration, Emulation, Media refreshment, and Disaster planning.

• Content policy– Track user activities, such as, ingest, migration, and etc.– Peer review be for deposit into repository

• Right and agreement– Because some preservation activities need to duplicate and modify

digital content, it needs to record right and agreement to digital object.

Recommendation

Yuan Li (2011)

12

OAIS

OCLC.org

ContentInformation

PDIPreservationDescriptionInformation

Archive Packaging Information

DescriptiveInformation

about Package 1

Package 1

Information Model

13

OAIS

OCLC.org

DIP

AIP

SIP

Producer

Administrator

Ingest

Store

Query

Access

Disseminate Consumer

Workflow

Manage

14

• Provenance– Describe history of creation, ownership, access, and change

• Authenticity– Ensure trustworthiness (Does digital resource render originally?)

• Preservation activities– Record process supporting preservation, such as migration

• Technical environment– Provide name and version of hardware, platform, OS, and software that is

required to render digital resources• Rights management

– Inform concern of intellectual property rights and agreement that need to be observed when execute preservation process.E.g. does a creator allow to copy his/her work or not?

Preservation Metadata

OCLC.org, usenix.org

Basic features

15

PREMIS

PREMIS from LOC.gov

• Information providing to support preservation management– Technical information (Characteristics)

• E.g. creator, created date-time, file format, software/hardware environment, …

– Information about action of a digital object• E.g. ingest, migrate, verify, …

– Inhibitors• Password, encryption, … in order to access digital objects

– Digital Provenance• Record change of object format e.g. .DOC .PDF• Contain application, version, environment, … in order to render digital objects

– Significant Properties (If important)• Object’s characteristics e.g. font, formatting, color, …., etc• Look and feel

– Rights• E.g. Rights and agreement metadata associated with preservation

Overview

16

PREMIS

PREMIS from LOC.gov

Entities

17

Challenge

Flouris (2007)

ConceptualLevel

PhysicalLevel

• Data Preservation• Bit Preservation

•Information Preservation

18

Underlying Community Knowledge

19

• DC is a group of people who– Have common knowledge (concept)– Have common background– Have common contextual knowledge– Have same language

• Knowledge of DC called Underlying Community Knowledge (UCK)

Designated Community (DC)

Flouris (2007)

20

• UCK looks like: knowledge, background, context, commonsense, semantic, and etc. that are understandable by all people in DC

• It means that People in the same DC know the same UCK and understand every Concept inside UCK

Underlying Community Knowledge (UCK)

Flouris (2007)

21

Problem

Flouris (2007)

ConsumerProducer

First name = “Rathachai”Family name = “Chawuthai”

UCK 1 UCK 2

Name : “Rathachai Chawuthai”Write Read

First name = “Chawuthai”Family name = “Rathachai”

22

Approach

Flouris (2007)

ConsumerProducer

First name = “Rathachai”Family name = “Chawuthai”

UCK 1 UCK 2

Name : “Rathachai Chawuthai”Write

Delta

Read

First name = “Rathachai”Family name = “Chawuthai”

23

• Some Preliminary Ideas Towards a theory of digital preservation– Giorgos Flouris

Reference

TBD

24

Challenge

Name =

First name+

Last name

Name =

Family name+

First name

?

?

UCK

AUCK

B

25

Logical Model

26

• A model must:– Represent contextual knowledge – Be a reference for all underlying community knowledge as

a common knowledge– Identify associations and differentiates between common

knowledge and community knowledge– Identify associations and differentiates between

community knowledge– Capture change or evaluation of common knowledge itself– Be able to link concepts among designated community

based on common contextual knowledge

Goal

27

• Underlying Common Community Knowledge– A common contextual knowledge for all

underlying community knowledge

UCCK

28

UCCK

C R

HC

IC IR

AO

• C a set of concepts• R a set of Relations• HC a set of hierarchy of Classes• HR a set of hierarchy of Relations• IC a set of instances of C• IR a set of instances of R• A0 a set of Axiom (Inference relations of logic)

HR

Yildiz (2006)

29

UCCK

C R

HC

IC IR

AOHR

UCCKDer

ive DeriveUCK1 UCK2

30

UCCK

UCK1 UCK2

31

UCCK

UCK1 UCK2

UCCK

32

UCCK

UCK1 UCK2

UCCK

33

UCCK

Past Future

34

The Event Ontology

Raimodn (2007)

http://motools.sourceforge.net/event/event.html TBD

35

Prototype

36

As an Consumers

Archival Information

System

Consumers

AnotherArchival

Information System

AnotherArchival

Information System

Link Link

• Browse digital objects• Search relevance digital

objects across repositories• Link to other related

digital objects under contextual knowledge across systems

• Customize own designated community

37

As an Archivist

Archival Information

System

Archivist

• Ingest digital objects• Define links to other

objects• Add metadata according to

digital object’s type• Add underlying

community knowledge• Add contextual knowledge

38

As an Administrator

Archival Information

System

Administrator

• Define metadata for each type of digital object

• Define underlying common community knowledge

• Define underlying community knowledge

• Define designated communities

39

• Be able to manage variety types of digital objects• Be able to link digital object to other ones

semantically• Be able to provide context knowledge by linking

digital objects for each designated community• Be able to manage variety types of metadata• Be able to do semantic search• Be able to store knowledge as ontology

Requirements

40

• Repository system• Features

– Collect digital objects and their relations

– Collect metadata– Collect ontology– Support versioning

• Only one repository system that – Support Semantic Search– Provide Web Services

• Work as back-end services

Fedora-Commons

Duraspace.org

41

• Popular CMS• Features– Rich user management– Rich content management– Flexible for customized modules

• Only one CMS that – supports SPARQL endpoint

• Work as front-end service to end-user

Drupal

Drupal.org

42

• A Drupal’s module• Features

– Provide administration panel– Provide fast-search to Fedora database– Support many formats of metadata– Support many types of digital objects

• Only one Drupal’s module that: – Integrate with Fedora-Commons– Works with GSearch service (Semantic

Search of Fedora-Commons)• Work as front-end administration

services

Islandora

Islandora.ca

43

System architectures

ConsumersAdministrator Archivist

Islandora Other content modules

Drupal

AdministrationServices

Fedora Core Service GSearchGeneric Search SOLR

Database

44

• To find Architecture, like, Hitest’s diagram

Reference

TBD

45

Related works

46

• Cultural, Artistic and Scientific knowledge for Preservation, Access and Retrieval – Is an Integrated Project co-financed by the European Union within the

Sixth Framework Programme– Add context knowledge to digital object following its characteristics and

representations• Similarity

– Integrate context knowledge of digital objects and estimate gap of designated communities’ knowledge with semantic technology

• Advantage of my project– Explore knowledge by linking archive across designated communities

referring to underlying common community knowledge– Emphasize changing common community knowledge over the time

CASPAR

Casparpreserves.eu

47

• Sustaining Heritage Access through Multivalent Archiving– Is an Integrated Project co-financed by the European Union within the

Seventh Framework Programme– Represent context as relations between digital objects– Integrate context information by processes, such as, ingested, accessed, and

reused with ontological representation• Similarity

– Represent context information by linking digital objects and other things semantically based on document processes

• Advantage of my project– Explore knowledge by linking to other digital objects and other things

semantically referring to underlying common community knowledge capturing knowledge from real-world concept (rather than document processes)

SHAMAN

Reference

48

?

49

References

• CASPAR: Cultural, artistic and scientific knowledge for preservation, access an retrieval. eu funded project (fp6-2005-ist-033572). http://www.casparpreserves.eu

• http://public.ccsds.org/publications/archive/650x0b1.PDF • http://www.loc.gov/standards/premis/ • http://www.drupal.org• http://www.duraspace.org/• http://islandora.ca