AGRES An International e. Journal (2019) Vol ... - Ark Group
E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview...
Transcript of E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview...
![Page 1: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/1.jpg)
Orchestrating Business Processes
E-ARK Overview
Introduction to the digital archiving components of the E-ARK project.
István Alföldi Poliphon, Hungary Hungarian National Archives [email protected]
![Page 2: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/2.jpg)
Orchestrating Business Processes
2
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Format Specifications and Tools
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
QGIS
E-ARK Web Search
Lily – Ingest
AIP2DIP Converter
IP Viewer
CMIS Portal Viewer
EAD Metadata
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
RODA-In
ESSArch Tools For Producer
SIP Creator SIP2AIP Converter
Universal Archival Modul
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK Web
E-ARK SFSB
E-ARK SIP
E-ARK DIP
E-ARK AIP
![Page 3: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/3.jpg)
Orchestrating Business Processes
3
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Viewers
E-ARK Format Specifications and Tools
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
QGIS
E-ARK Web Search
Lily – Ingest
EAD Metadata
RODA-In
ESSArch Tools For Producer
SIP Creator SIP2AIP Converter
Universal Archival Modul
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK Web
E-ARK SFSB
E-ARK SIP
E-ARK AIP
AIP2DIP Converter
IP Viewer
CMIS Portal Viewer
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
E-ARK DIP
![Page 4: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/4.jpg)
Orchestrating Business Processes
4
e-Document Archive
P
r
o
d
u
c
e
r
C
o
n
s
u
m
e
r
Reference Model of an Open Archival Information System (OAIS)
OAIS
Submission Information
Package
Archival Information
Package
Dissemination Information
Package
![Page 5: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/5.jpg)
Orchestrating Business Processes
5
Data Management
Ingest
Preservation Planning
Access
Administration
Archival Storage
P
r
o
d
u
c
e
r
C
o
n
s
u
m
e
r
queries
result sets
orders
Reference Model of an Open Archival Information System (OAIS)
OAIS
SIP DIP
Pre-Ingest e-Document
Archive AIP
Descriptive Metadata
![Page 6: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/6.jpg)
Orchestrating Business Processes
6
Data Management
Ingest
Preservation Planning
Access
Administration
Archival Storage
P
r
o
d
u
c
e
r
C
o
n
s
u
m
e
r
queries
result sets
orders
Reference Model of an Open Archival Information System (OAIS)
OAIS
SIP DIP
Pre-Ingest e-Document
Archive AIP
Descriptive Metadata
Links Reference Model for an Open Archival Information System (OAIS)
![Page 7: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/7.jpg)
Orchestrating Business Processes
7
SIP DIP
AIP
E-ARK Common Specification for Information Packages
![Page 8: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/8.jpg)
Orchestrating Business Processes
8 E-ARK Information Packages
E-ARK SIP
E-ARK DIP
E-ARK AIP
Links DILCIS Board Common Specification for Information Packages Submission Information Package Archival Information Package Dissemination Information Package
![Page 9: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/9.jpg)
Orchestrating Business Processes
9
Data Management
Ingest
Preservation Planning
Access
Administration
Archival Storage
P
r
o
d
u
c
e
r
C
o
n
s
u
m
e
r
queries
result sets
orders
E-ARK Processes
OAIS
SIP DIP
Pre-Ingest e-Document
Archive AIP
Descriptive Metadata
![Page 10: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/10.jpg)
Orchestrating Business Processes
10
Ingest Access Pre-Ingest
Ingest Access Pre-Ingest
E-ARK Processes
![Page 11: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/11.jpg)
Orchestrating Business Processes
11
Pre-Ingest Ingest Access
E-ARK Processes
![Page 12: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/12.jpg)
Orchestrating Business Processes
12
Pre-Ingest Ingest Access
E-ARK Processes
![Page 13: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/13.jpg)
Orchestrating Business Processes
13
PRODUCERARCHIVE
Extract and Ingest ERMS
records based on MoReq2010
Extract and Ingest Relational
DB based on SIARD
Extract and Ingest files from
simple file-system
Extrac and Ingestt files from simple
file-system - GML
Data Management
Archival Storage
Preservastion
Archival Repository
CONSUMER
Data
OLAP
FILES
DB
GML
Access databases via
SOLR (not SQL)
Access databases via
DBVTK (SQL)
Access single ERMS records
Access data with OLAP
via Oracle
Access geodata via QGIS
ERMS
DB
ERMS
FILES
GML
E-ARK Use cases
Ingest Access
C
o
n
s
u
m
e
r
SIP DIP
Pre-Ingest AIP
P
r
o
d
u
c
e
r
![Page 14: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/14.jpg)
Orchestrating Business Processes
14 E-ARK Format Specifications and Tools
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
GML
E-ARK SIP
E-ARK AIP
Pre-Ingest Ingest Archival Storage Access
E-ARK DIP
![Page 15: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/15.jpg)
Orchestrating Business Processes
15
Pre-Ingest Ingest Archival Storage Access
E-ARK Content Type specifications
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
E-ARK DIP
Links SIARD 2.1 (Software Independent Archival of Relational Databases) specification E-ARK ERMS (SMURF and SFSB) Content Type specification
![Page 16: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/16.jpg)
Orchestrating Business Processes
16
Pre-Ingest Ingest Archival Storage Access
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
E-ARK Content Type specifications
E-ARK DIP
![Page 17: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/17.jpg)
Orchestrating Business Processes
17
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
E-ARK DIP
![Page 18: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/18.jpg)
Orchestrating Business Processes
18
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
QGIS
EAD Metadata
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
E-ARK DIP
![Page 19: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/19.jpg)
Orchestrating Business Processes
19
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
EAD Metadata
RODA-In
ESSArch Tools For Producer
Universal Archival Modul
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK AIP
SIP Creator
E-ARK SIP
E-ARK DIP
![Page 20: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/20.jpg)
Orchestrating Business Processes
20
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
E-ARK Web Search
Lily – Ingest
AIP2DIP Converter
EAD Metadata
SIP2AIP Converter
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK SFSB
E-ARK AIP
E-ARK SIP
E-ARK DIP
![Page 21: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/21.jpg)
Orchestrating Business Processes
21
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
IP Viewer
CMIS Portal Viewer
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
E-ARK DIP
![Page 22: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/22.jpg)
Orchestrating Business Processes
22
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
QGIS
E-ARK Web Search
Lily – Ingest
EAD Metadata
RODA-In
ESSArch Tools For Producer
SIP Creator SIP2AIP Converter
Universal Archival Modul
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK Web
(Reference Implementation)
E-ARK SFSB
E-ARK SIP
E-ARK AIP
AIP2DIP Converter
IP Viewer
CMIS Portal Viewer
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
E-ARK DIP
![Page 23: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/23.jpg)
Orchestrating Business Processes
23
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Format Specifications and Tools
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
QGIS
E-ARK Web Search
Lily – Ingest
AIP2DIP Converter
IP Viewer
CMIS Portal Viewer
EAD Metadata
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
RODA-In
ESSArch Tools For Producer
SIP Creator SIP2AIP Converter
Universal Archival Modul
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK Web
E-ARK SFSB
E-ARK SIP
E-ARK DIP
E-ARK AIP
![Page 24: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/24.jpg)
Orchestrating Business Processes
24 E-ARK General Model
Links E-ARK General Model 3.0
With lots of links inside!
![Page 25: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/25.jpg)
Orchestrating Business Processes
25 E-ARK General Model – Pilot Scenarios and Documentation
Links Detailed Pilot Definition Pilot documentation Volume 1. Pilot documentation Volume 2.
![Page 26: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/26.jpg)
Orchestrating Business Processes
26 Getting started with E-ARK tools
1. Select your use cases
2. Select the E-ARK information package and content type specifications Read the documentation
3. Select the tools Read the documentation
4. Look for an E-ARK pilot scenario similar to yours in the General Model Read the documentation
6. Experiment with the tools Run a pilot
5. Get more information from eArchiving Training, Service Desk support
![Page 27: E-ARK - General Model 2.2 v2earchiving.cordoba.es/.../07_Istvan_Alfoldi_E-ARK.pdf · E-ARK Overview Introduction to the digital archiving components of the E-ARK project. István](https://reader033.fdocuments.net/reader033/viewer/2022042601/5f9d8793bbcd4b31a57133c5/html5/thumbnails/27.jpg)
Orchestrating Business Processes
? István Alföldi Poliphon, Hungary [email protected]
Questions & Answers