GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances...

16
GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1 Jahnke / Menger [German Federal Environmental Agency]
  • date post

    18-Dec-2015
  • Category

    Documents

  • view

    234
  • download

    0

Transcript of GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances...

Page 1: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

GSBL – Concept +

SoftwareSuiteThe Joint Data Pool and

Information System for Chemical Substances

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger [German Federal Environmental Agency]

Page 2: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Key Aspectsof the GSBL Concept

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 2Jahnke / Menger [German Federal Environmental Agency]

Page 3: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

GSBL-Public DataAvailable for search & retrieval

GSA DataAvailable for search & retrieval

...

Data Flow Data Gathering

collect new data

Mapping Data change

physical + technical data model to GSBL

Normalise DataStandardisation of units, appearance, ...

Registrate Dataidentify + compare with chemicals

in the data base

ThesaurusCreate relations between records

(chemicals, legislation,…)Update Data

‚write‘ data in the data base Check Data proof data quality

Export DataFull content or partial content

Maintain Datacorrect identities of chemicals

External PartnerSSF format

Central Data Base of Chemicals

External Data of different Format

Import

[software modules]

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 3Jahnke / Menger [German Federal Environmental Agency]

GSBL DataAvailable for search & retrieval

Access Data search&retrieval

Page 4: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Definition of Substancein the GSBL

• basic for the GSBL data registration rules• agreed upon and fixed• ID properties/fields are still flexible (due to future amendments)

[1] Pure Substance

[2] composed Substance / Preparation

Real SubstanceReal Substance

[3] Class of -Chemical group

-Legislation-Usage-…

Substance ClassSubstance Class

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 4Jahnke / Menger [German Federal Environmental Agency]

Page 5: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

ID-Data for Registration

Technical Data Model

• each substance have to be assigned to one of the 3 types• ID-data are the identifier in the GSBL (GSBL-RegNo.)

• some ID-data are mandatory (flexible!)

• registration of chemical structure is possible!

[Pure Substance]

[Composed Substance / Preparation]

[Class]

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 5Jahnke / Menger [German Federal Environmental Agency]

chemical structure (if available),

name (multiple),

name (m), [producer], components (m), physical condition

name (m), type of class (chemical, legislation, …)

Page 6: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Business Logicfor Registration of Data

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 6Jahnke / Menger [German Federal Environmental Agency]

REGISTRATION:

• rule-based software

• rules defining possible

• independent of technical data model

• replicable + repeatable registration process

Data

Dat

a S

tru

ctu

re T

able

DataDelivery

FormatReader

MappingXRef

RulesCheck

Normalise

Register

Update

Page 7: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Register DataBusiness Logic for Registration of Data

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 7Jahnke / Menger [German Federal Environmental Agency]

• load SSF import file• check correct SSF-format

Data

Dat

a S

tru

ctu

re T

able

DataDelivery

FormatReader

MappingXRef

RulesCheck

Normalise

Register

Update• map external data model to ‘GSBL-data model’

• using script procedures (SPL) to map fields automatically

• extendable pool of general SPL procedures (data model independent)

• implemented rules to check registration criteria (typ3 have to fullfill …)

• define rules to improve data quality!

• alternating mandatory fields (e.g. for Eco-toxicological data or flash point)

• harmonise the format to compare possible redundant or false entries

• using standards (text, units, …) for harmonisation

• merge redundant information in the imported file

• check against already registered substances

• create loader-file (format for ORCALE tables; refer to data structure tables,…)

• write (create, delete, merge) data in the GSBL-data base

• create index

Page 8: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Technical Data Modelof the GSBL

Substance190.000

Properties450

Fields30.000

Sources100

Standards(Text, Units,..)

LiteratureCitations

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 8Jahnke / Menger [German Federal Environmental Agency]

Structure8.000

Page 9: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Technical + Physical Flexibilityof the Software

control set maintained in [EXCEL]

configuration for software modules [ASCII]

GUI: tree [HTML, JavaScript]

Web

Data Pool

ORACLE

FULGOR

DataGathering

Import

Export

Check

Thesaurus

Search&

Retrieval

DataMaintenance Ranking

SoftwreManagement

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 9Jahnke / Menger [German Federal Environmental Agency]

Page 10: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Software Modulescentral control unit

Web

Data Pool

ORACLE

FULGOR

DataGathering

Import

Export

Check

Thesaurus

Search&

Retrieval

DataMaintenance Ranking

SoftwreManagement

[data flow]

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 10Jahnke / Menger [German Federal Environmental Agency]

Page 11: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Standardised Interface Data Exchange Format

data exchange format:• standardised• used in all data transfers

• internal (modules)• external (data provider)

• platform independent (ASCII)• usable for different data

models• readable by men and machine

[GENERAL]DATE=...

DBDIR=...

FORMAT=...

....

[SUBSTANCE]

@.

@;property@:field=content@:field=|standard text

...

[CITATION]

@.

@;property@:field=content@:field=|standard text

...

[…] segment@. record@; property @: field

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 11Jahnke / Menger [German Federal Environmental Agency]

Page 12: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

FULGOR

• retrieval data base• created from the ‘original’ ORACLE GSBL (2x/a)• index based flat ‘DB’• decentral, distributable on CD • needs no DBMS, no additional license fee

Performance2 physical data structures and formats

ORCALE• production data base • standard relational DBMS with available tools• build, run and maintain the central GSBL• fast, flexible import / export of data• …

Web

Data Pool

ORACLE

FULGOR

DataGathering

Import

Export

Check

Thesaurus

Search&

Retrieval

DataMaintenance Ranking

SoftwreManagement

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 12Jahnke / Menger [German Federal Environmental Agency]

Page 13: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

User ViewsData Ranking + GUI Konfiguration

Web

Export

Search&

RetrievalGSBL

GSA

PUBLIC

Web

Search&

Retrieval

Web

Search&

Retrieval

Ranking

GSBLORACLE

MasterConfig

MasterConfig

MasterConfig

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 13Jahnke / Menger [German Federal Environmental Agency]

Page 14: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Search & Retrieval Application Architecture

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 14Jahnke / Menger [German Federal Environmental Agency]

SERVER 2

WebBrowser

SERVER

WebClient GSBL

Webserver (IIS,Apache)

GEINinterface

Firewall

Port 5555

INTERNET

TCP/IP Port 5555 Windows-Sockets

GSBLsubstances

access SERVER

retrieval SERVERPort 5555

comServer

CLIENT

retrievalCLIENT

configTool

SERVER 1

Xfirestructures

XfireSERVER

[DEMO...]

Page 15: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Conclusion Benefits

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 15Jahnke / Menger [German Federal Environmental Agency]

Page 16: GSBL – Concept + SoftwareSuite The Joint Data Pool and Information System for Chemical Substances EnviroInfo2003 - Cottbus / 24.-26.09.03 / 1Jahnke / Menger.

Thank You ...

Visit our website and try the GSBL Search & Retrieval Software!

http://www.gsbl.de

{petra.jahnke | matthias.menger}@uba.de

...for Your Interest!

EnviroInfo2003 - Cottbus / 24.-26.09.03 / 16Jahnke / Menger [German Federal Environmental Agency]