The Web, Text, Data, and XML

SDC-0055-057-JE-8013

December 3, 1998

SDC-0055-057-JE-8013

Bruce Bargmeyer

EPA/OIRM/EIM Division

Tel: (202) 260-5306

[email protected]

WWW URL: http://sdct-sunsrv1.ncsl.nist.gov/~bargmeye

index.html

SDC-0055-057-JE-8013

Topics

Terminology and the EDR

Thesaurus

Data Elements

Ontology

Sources

Sharing Environmental Information

XML

SDC-0055-057-JE-8013

• System managers• System developers• Subject area specialists• Program managers• Scientists• NGOs• Public• Legislative bodies• Statistician/analysts• Regulation writers• ……..

Users:

SDC-0055-057-JE-8013

• Produce State of the Environment report•Design/build computer systems•Writing legislation and regulations•Track/monitor status of environment•Statistical analyses•Problem solving•Environmental planning

Activities:

SDC-0055-057-JE-8013

Users

Accessing text and data

EEA

DOE

DoD

EPAenvironagricultureclimatehuman healthindustrytourismsoilwaterair

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

environagricultureclimatehuman healthindustrytourismsoilwaterair

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text

ambienteagriculturatiemposalud hunanoindustriaturismotierraaguaaero

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

data


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

Others . . .

ambienteagriculturatiemposalud hunoindustriaturismotierraaguaaero

123345445670248591308

123345445670248591308

3268082513485038

3268082513485038270800002178

text data

SDC-0055-057-JE-8013

EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text dataenvironagricultureclimatehuman healthindustrytourismsoilwaterair

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text datasambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


Others . . .

ambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero

123345445670248591308

123345445670248591308

3268082513485038

3268082513485038270800002178

text data


SDC-0055-057-JE-8013

Search Engine Queries

SearchEngine

EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


Others . . .


123345445670248591308

123345445670248591308

3268082513485038

3268082513485038270800002178

text data


SDC-0055-057-JE-8013

SearchEngine

Search engines do not find traditional

data.

EEA

DoD

EPA

text

textenvironagricultureclimatehuman healthindustrytourismsoilwaterair

textambienteagriculturatiemposalud humanoindustriaturismotierraaguaaero


Others . . .


text

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

datas

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

data


DOE

Challenges

SDC-0055-057-JE-8013

Challenges

SearchEngine

Search engines are not used well for

multilingual information.






EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text datas

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

Others . . .

text data

text

SDC-0055-057-JE-8013

Challenges

SearchEngine

Hard to use retrieved data in PC

software.


EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text datas

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

Others . . .

data




text


SDC-0055-057-JE-8013

Challenges

??

SearchEngine

Users lack information on data

quality and meaning.


EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text datas

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

Others . . .

data




text


??

SDC-0055-057-JE-8013

Challenges

SearchEngine

Data exchange between systems is

difficult.





EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text datas

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

Others . . .

text data

text


SDC-0055-057-JE-8013

Search engines do not find traditional data Search engines and DBMSs not used well

for multilingual information Users lack information on data quality and

meaning Hard to use retrieved data in PC software Data exchange between systems is difficult Not tailored for environmental information

Challenges

SDC-0055-057-JE-8013

Steps Forward

SearchEngine

Metadata Registry Terminology Thesaurus Themes GEMET

Catalog of Data Sources (CDS)Environmental Data Registry (EDR)

EEA

DOE

DoD

EPA

text




Others . . .


text

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

datas

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

data


SDC-0055-057-JE-8013

Increased Understanding


SearchEngine

StructuredMetadata


EEA

DOE

DoD

EPA

text




Others . . .


text

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

123345445670248591308

123345445670248591308

3268082513485038270800002178

data

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

datas

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

data

data


SDC-0055-057-JE-8013

Facilitates Data Access

Middleware

StructuredMetadata



EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


Others . . .


123345445670248591308

123345445670248591308

3268082513485038

3268082513485038270800002178

text data


SDC-0055-057-JE-8013

Enhanced Data System Exchange

Middleware

EnhancedData

Exchange


DataStandards


EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


Others . . .


123345445670248591308

123345445670248591308

3268082513485038

3268082513485038270800002178

text data


EDIXML-EDIXML-DataWeb Forms

SDC-0055-057-JE-8013

Queries Through Middleware

Ontology GEMET

StructuredMetadata


IntelligentSystems

MiddleWare

InfoSleuth

Metadata Registry Terminology Thesaurus Themes

DataStandards

EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


Others . . .


123345445670248591308

123345445670248591308

3268082513485038

3268082513485038270800002178

text data


SDC-0055-057-JE-8013

Queries Using Resource Agents

Resource Agents (RAs)

StructuredMetadata


IntelligentSystems

MiddleWare

InfoSleuth

Metadata Registry Terminology Thesaurus Themes

DataStandards

EEA

DOE

DoD

EPA 123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178

text data

123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


123345445670248591308

123345445670248591308

3268082513485038270800002178

3268082513485038270800002178


RA

RA

RA

RA


Ontology GEMET

SDC-0055-057-JE-8013

Example of data changes world-wide.

Change

ISO

ANSIIndustry

EPA

Country

Country changesCZ Czechoslovakia*

CZ Czech Republic**LO Slovakia**

* FIPS PUB 10-3** FIPS PUB 10-4

SDC-0055-057-JE-8013


Change

ISO

ANSIIndustry

EPA

Biological terms

New speciesNew classification

Scientific NameVernacular Name

Taxonomic Serial Number

SDC-0055-057-JE-8013


Change

ISO

ANSIIndustry

EPA

Chemicals

New chemicalSystematic Name

SynonymCAS Number

SDC-0055-057-JE-8013

As data changes world-wide, metadatachanges can be recorded and effectively

communicated between metadata registries.

Change

ISO

ISO/IEC 11179Metadata Registry

Standard

DefenseData Dictionary

Sources

Catalog ofData Sources

HealthCare

FinanceAdministration

IntelligentTransportation

System

EnvironmentalData

RegistryANSI

IndustryEPAS

tan

dar

d D

ata

SDC-0055-057-JE-8013

Terminology

fish

= fish

SDC-0055-057-JE-8013

Concept

Sign Object

Elements of Terminology

troutSalmo truttabrown trouttruite

any of several game fishes of the genus Salmo, related to the salmon...

SDC-0055-057-JE-8013

Terminology

Terms ContextConcept

troutSalmo truttatruite

common namescientific nameFrench name

any of several game fishes of the genus Salmo, related to the salmon...

UIN=6349

SDC-0055-057-JE-8013

Search Example:Fish TroutTrout

Documents Data1 2 3 4 5 6 7 8

SearchEngine


Brown troutSalmo truttatruite


UIN=6349Thesaurus

Salmo truttaBrown Trout

trout

fish

SDC-0055-057-JE-8013

DataElements

Name: trout species

Definition: The names of species of trout.

Values: brook trout -- Salvelinus fontinalisbrown trout -- Salmo truttacutthroat trout-- Oncorhynchus clarkii ...

Systems:STORETEnvirofacts . . .

DataElements

DBMSQuery

Web-enabled FormsEDI Messages

DataInterchange

Federal RegisterRegulationsReports

DocumentsPublishing




UIN=6349

SDC-0055-057-JE-8013

EPA

EEA

DOE

DoD




UIN=6349

LocalMapping

CentralMapping

Query AgentBrokerMediatorResource Agent

IntelligentInformation

Services (IIS):Ontology

Example:

fish trout brown trout

SDC-0055-057-JE-8013

General EuropeanMultilingual

EnvironmentalThesaurus(GEMET)

Facilitated Sessions:Government

FederalState/Local

Private EnterpriseAcademia

Thesauri DataElements

Data Sources




UIN=6349

SDC-0055-057-JE-8013

OntologyOntologyThesaurusThesaurus

Deployment Technologies

DataDataElementsElements

SearchEngine

DBMS/EDI/ Documents

IIS

a category of vertebrate, cold-blooded craniate animals with permanent gills...

SDC-0055-057-JE-8013

As data changes world-wide, metadatachanges can be recorded and effectively

communicated between metadata registries.


Standard


Sources


HealthCare



System

Sta

nd

ard

Da

taEDR

Change

ANSIIndustry

EPA

ISO

SDC-0055-057-JE-8013

What is XML?

Extensible Markup Language (XML) Simplified SGML

(Standard Generalized Markup Language, ISO 1986)

Next generation HTML Semantic structure of document or data Extensible, industry-specific tag sets Display determined by style sheets

(CSS, XSL)

(Source: John McCarthy, Frank Olken, and Roy Tennant, April 1998)

SDC-0055-057-JE-8013

XML Example

Markup

Character Data

<?xml version =“1.0”?>

<book>

<author>

<name>Richard Light</name>

<email>[email protected]</email>

</author>

<title>PresentingXML</title>

</book>


SDC-0055-057-JE-8013

XML Goals & Philosophy

Overcomes shortcomings of HTML Allows processing of Web documents by

sophisticated document processing software Overcomes shortcomings of SGML

Allows media-independent electronic publishing

Interoperates with HTML and SGML Provides vendor-neutral data exchange


SDC-0055-057-JE-8013

Increasing industry interest and acceptance

Parsers in multiple computer languages JAVA, C++, Perl, Python, etc.

Additional industry-specific tag sets Full Web browser support Growing set of authoring/processing tools

Where is XML Going?


SDC-0055-057-JE-8013

OntologyOntologyThesaurusThesaurus

Role of XML

DataDataElementsElements

SearchEngine

DBMS / EDI / Documents

IIS

XMLXML XMLXML

XMLXML

XMLXML

SDC-0055-057-JE-8013

As data changes world-wide, metadatachanges can be effectively

communicated using XML between metadata registries.


Standard


Sources


HealthCare



System

Change

ISO

ANSIIndustry

EPASta

nd

ard

Da

taEDR

XML

XML

XML

XML

XML

SDC-0055-057-JE-8013

Progress

• Memorandum of Agreement - EPA, EEA, DOD, DOE

• Joint Action Document

• Tasks, Deliverables and Milestones for InfoSleuth Project– Phase One demonstration successful

• GEMET Agreement

SDC-0055-057-JE-8013

Cooperative Efforts

• Joint Articles with the EEA

• Common environmental terminology– GEMET

• Structured descriptions of data and text– EDR & CDS

• Terminology collaboration with selected states

SDC-0055-057-JE-8013

Cooperative Efforts

• Technology Demonstrations– GEMET for cataloging and searching

• Search engine for text and data

– EDR and CDS development and integration• Global Information Locator Service

– MCC InfoSleuth• EPA, DOD, DOE, EEA

• EPA and states

SDC-0055-057-JE-8013

Next Steps

• Collaborate on terminology– Thesaurus, topic trees, ontology

• Collaborate on metadata

- Well-formed data elements

• Collaborate on data/text description– Connect EDR to CDS through Global Information

Locator Service

• Collaborate on metadata registries (e.g., EDR)

SDC-0055-057-JE-8013

The Web, Text, Data, and XML

Documents

Transcript of The Web, Text, Data, and XML