PANGAEA - Providing access to geoscientific data using Apache Lucene Java
GEO/EGIDA 2011 Bonn PANGAEA® & the ICSU World Data System (WDS) - towards a global system of data...
16
GEO/EGIDA 2011 Bonn www.pangaea.de PANGAEA® & the ICSU World Data System (WDS) - towards a global system of data publishers and data libraries. Michael Diepenbroek MARUM, University Bremen
-
Upload
ashlyn-booth -
Category
Documents
-
view
220 -
download
2
description
GEO/EGIDA 2011 Bonn Nuclear Radiation Tokyo, Japan WDC Co-ordination Offices Washington DC, USA Beijing, China Meteorology Asheville NC, USA Beijing, China Obninsk, Russia Oceaography Obninsk, Russia Silver Spring MD, USA Tianjin, China Paleoclimatology Boulder CO, USA Marine Geology and Geophysics Boulder CO, USA Moscow, Russia Remotely Sensed Land Data Sioux Falls SD, USA Renewable Resources and Environment Beijing, China Recent Crustal Movements Ondrejov, Czech Republic Airglow Mitaka,Japan Astronomy Beijing, China Atmospheric Trace Gases Oak Ridge TN, USA Aurora Tokyo, Japan Cosmic Rays Toyokawa, Japan Geology Beijing, China Human Interactions in the Environment Palisades NY, USA Ionosphere Tokyo, Japan Earth Tides Brussels, Belgium Geomagnetism Copenhagen, Denmark Edinburgh, UK Kyoto, Japan Colaba, India Glaciology Boulder CO, USA Cambridge, UK Lanzhou, China Marine Environmental Sciences Germany, (2001) Rotation of the Earth Obninsk, Russia Washington DC, USA Satellite Information Greenbelt MD, USA Rockets and Satellites Obninsk, Russia Seismology Denver CO, USA Beijing, China Solar Radio Emission Nagano, Japan Space Science Beijing, China Space Science Satellites Kanagawa, Japan Solar Activity Meudon, France Soils Wageningen, The Netherlands Sunspot Index Brussels, Belgium Solar Terrestrial Physics Boulder CO, USA Didcot Oxon, UK Moscow, Russia Haymarket, Australia Solid Earth Geophysics Beijing, China Boulder CO, USA Moscow, Russia ICSU World Data Centers (WDC) Geophysical Year 1957
Transcript of GEO/EGIDA 2011 Bonn PANGAEA® & the ICSU World Data System (WDS) - towards a global system of data...
GEO/EGIDA 2011 Bonn www.pangaea.de
PANGAEA® & the ICSU World Data System (WDS)
- towards a global system of data publishers and data
libraries.
Michael DiepenbroekMARUM, University Bremen
www.pangaea.de GEO/EGIDA 2011 Bonn
GEOSS Global Earth Observation System of Systems
!?
information
knowledge
orientative knowledge
www.pangaea.de GEO/EGIDA 2011 Bonn
•Nuclear RadiationTokyo, Japan
WDC Co-ordination OfficesWashington DC, USABeijing, China
•MeteorologyAsheville NC, USABeijing, ChinaObninsk, Russia
•OceaographyObninsk, RussiaSilver Spring MD, USATianjin, China
•PaleoclimatologyBoulder CO, USA
•Marine Geology and GeophysicsBoulder CO, USAMoscow, Russia
•Remotely Sensed Land DataSioux Falls SD, USA
•Renewable Resources and EnvironmentBeijing, China
•Recent Crustal MovementsOndrejov, Czech Republic
•AirglowMitaka,Japan
•AstronomyBeijing, China
•Atmospheric Trace GasesOak Ridge TN, USA
•AuroraTokyo, Japan
•Cosmic RaysToyokawa, Japan
•GeologyBeijing, China
•Human Interactions in the EnvironmentPalisades NY, USA
•IonosphereTokyo, Japan
•Earth TidesBrussels, Belgium
•GeomagnetismCopenhagen, DenmarkEdinburgh, UKKyoto, JapanColaba, India
•GlaciologyBoulder CO, USACambridge, UKLanzhou, China
•Marine Environmental SciencesGermany, (2001)
•Rotation of the EarthObninsk, RussiaWashington DC, USA•Satellite InformationGreenbelt MD, USA
•Rockets and SatellitesObninsk, Russia
•SeismologyDenver CO, USABeijing, China
•Solar Radio EmissionNagano, Japan
•Space ScienceBeijing, China•Space Science SatellitesKanagawa, Japan
•Solar ActivityMeudon, France
•SoilsWageningen, The Netherlands
•Sunspot IndexBrussels, Belgium
•Solar Terrestrial PhysicsBoulder CO, USADidcot Oxon, UKMoscow, RussiaHaymarket, Australia•Solid Earth GeophysicsBeijing, ChinaBoulder CO, USAMoscow, Russia
ICSU World Data Centers (WDC)Geophysical Year 1957
www.pangaea.de GEO/EGIDA 2011 Bonn
ICSU WDS - Roles & relations in a federated system
Publishers commercial, open access
(e.g. ESSD journal),crossreferencing
Data Collection & Processing FacilitiesQA/QC, data products, also
data rescue
Data Archiving & Publication Facilities
certified repositories
Related Networks & Programs
GEOSS, GMES, WMO-IS, IOC etc
Metadata & Data Services
web portals, catalogues
Visualisation & Analysis
compute systems, virtual labs, GIS systems
Research Institutionsuniversities,
research institutes
Research Projects / Programsnational, EU, international
Libraries DOI registry
interdiscipl. catalogues
Research Facilitiessattelites, vessels,
observatories, alert systems etc.
Education & Outreach
Scientific Communities & Other Stakeholders
www.pangaea.de GEO/EGIDA 2011 Bonn
PANGAEA® Data Publisher for Earth & Environmental Science
- activities & services
• Project data management• Long term data archive (data library)• Data publication• Data infrastructures
www.pangaea.de GEO/EGIDA 2011 Bonn
PANGAEA® - project data management
More than 140 European to international projects since 1995(www.pangaea.de/projects)
CARBOOCEAN CARBOCHANGE EPOCA CORALFISH EUR-OCEANS HERMES / HERMIONE HYPOX IODP SPICOSA JGOFS international TARA OCEANS ESONET / EMSO (ESFRI) SIOS Statoil CO2 Base…
www.pangaea.de GEO/EGIDA 2011 Bonn
PANGAEA® - long term archive
• Open access & non restricted data Creative Commons licenses (mostly CC-BY)
• Data accepted from individual scientists, institutes, science & industry projects
• Long term funding for basic operation hardware, software, system management & organisation
• Long term preservation of data Technical: security, migration of media, Usability: preserving the integrity & semantics of data sets
www.pangaea.de GEO/EGIDA 2011 Bonn
PANGAEA® - contents
IRD(grav/10 cm 3)
Sand(%)
CaCO3(%)
TOC(%)
Radio(%/ sand)
Smect(%/clay)
IRD(grav/10 cm 3)
Sand(%)
CaCO3(%)
TOC(%)
Radio(%/sand)
Smect(%/clay)
IRD(gr av/10 cm 3)
Sand(%)
CaCO3(%)
TOC(%)
Radio(%/sand)
Smect(%/clay)
IRD(grav/10 cm 3)
Sand(%)
CaCO3(%)
TOC(%)
Radio(%/ sand)
Smect(%/clay)
IRD(gr av/10 cm 3)
Sand(%)
CaCO3(%)
TOC(%)
Radio(%/ sand)
Smect(%/ clay)
PS1389-3 PS1390-3 PS1431-1 PS1640-1 PS1648-1
Age (kyr) max. : 233.55 kyr PS1389-3ff
0.0
100.0
200.0
0 20 0 100 0 15 0 0.5 0 50 0 100 0 20 0 100 0 15 0 0. 5 0 50 0 100 0 20 0 100 0 15 0 0. 5 0 50 0 100 0 20 0 100 0 15 0 0.5 0 50 0 100 0 20 0 100 0 15 0 0. 5 0 50 0 100
54° 0' 54° 0'
54°30' 54°30'
55° 0' 55° 0'
55°30' 55°30'
11°
11°
12°
12°
13°
13°
14°
14°
15°
15°
World vector shore lineGrain size class KOLP AGrain size class KOEHN2Grain size class KOEHNGeochemistryGrain size class KOLP BGrain size class KOLP DIN20 m
Scale: 1:2695194 at Latitude 0°
Source: Baltic Sea Research Institute, Warnemünde.
• Profiles -> doi:10.1594/pangaea.103958• Time series -> doi:10.1594/pangaea.323487• Sea bed photos -> doi:10.1594/PANGAEA.319877• Distributes samples -> doi:10.1594/pangaea.51749• Complex data -> doi:10.1594/PANGAEA.108079• Air photos -> doi:10.1594/PANGAEA.323540• Audio record -> doi:10.1594/PANGAEA.339110
www.pangaea.de GEO/EGIDA 2011 Bonn
unclassified
Atmosphere
Corals
Ice
Sediment
Water
Total number of data sets ~ 500,000 Data items ~ 5.5 billions
Long term archive – contents (9/2010)
www.pangaea.de GEO/EGIDA 2011 Bonn
Conform to global standards (GSDI) ISO19xxx, OGC, W3C, OAI
Portals CARBOOCEAN (4) EUR-OCEANS (16) IODP - SEDIS (4) World Data Center portal (15) ESONET/EMSO
Broker function GBIF, OBIS
Sensor webs ESONET/EMSO, Statoil
Data warehouse
Data infrastructures
www.pangaea.de GEO/EGIDA 2011 Bonn
PANGAEA® – standard interfaces for metadata
Dublin Core
STD-DOI
ISO19115
data management & longterm archiving
RDB
catalogues
PANGAEA
XSLT
Index
protocols
marshaller
WS(SOAP/WSDL)
Frontends / portals
Elsevier,AGU et al
Geoserver(OGC)
OGCcatalogue
service
OAI-PMH
WS(SOAP/WSDL) ISO690
GeoPortal.Bund®
TIB Library
DOI registration
catalogues
DOI registry
DIF DublinCoreharvester
OCLC
harvester
Thomson Reuters
EUR-OCEANS
CARBOOCEAN
IODP
Darwin Core
DIGIR Darwin Core
ISO19115
DIF
OBIS
GBIF
harvester
harvester
D-GRID
gml, kml
WDS
PANGAEAweb frontend
www.pangaea.de GEO/EGIDA 2011 Bonn
PANGAEA®– Dissemination of Data & Metadata
www.pangaea.de GEO/EGIDA 2011 Bonn
PANGAEA® - data publication
• following the OECD principles and guidelines for access to research data (2007)
• peer-reviewed citable data sets referenced by persistent identifiers (DOI)DOI registry -> crossref for scientific data• Collaborations with publishers (Elsevier, Springer, AGU, Thompson Reuters
etc.)with data journalscrossreferencing supplementary data with traditional publications
www.pangaea.de GEO/EGIDA 2011 Bonn
Publishing data - asynchron
technical reviewpeer review(incl. data)
submit data sets
archive data sets
publish data sets
submit article
publish article
prepare article &related data sets
data curator reviewers
author,data originator
editor
JOURNAL .DATA ARCHIVE .
no
no
accepted?
accepted?
www.pangaea.de GEO/EGIDA 2011 Bonn
Publishing workflow - synchronized
technical review
peer review(incl. data)
submit data sets
archive data sets
send DOI
publish data sets
submit article
publish article
prepare article &related data sets
JOURNAL .
data curator
reviewers
author,data originator
editor
DATA ARCHIVE .
noyes
accepted?
yes
no
accepted?
