UNCLASSIFIED

UNCLASSIFIED

DoD Enterprise DoD Enterprise Ontology SupportOntology Support

Dr Glenda HayesDr Glenda Hayesghayes@mitre.org

MITRE/DISA PEO-GES

25 Nov 2008

Presentation to Presentation to

ASQ Software ASQ Software

SIG/SSQ/IEEE Computer SIG/SSQ/IEEE Computer

SocietySociety

UNCLASSIFIED 22

Agenda

• Net-Centricity – DoD Net-Centric Data Strategy– Metadata’s Role

• Types of Metadata– Structural and Semantic Metadata– Discovery Metadata

• Need for Controlled Vocabularies– DoD Discovery Metadata Spec (DDMS)– Ontology Spectrum

• DoD Metadata Registry and Clearinghouse (DoD MDR)

UNCLASSIFIED 33Recipe for Agility

Net-Centric Tenets

DoDDoDNetNet--CentricCentric

Data StrategyData Strategy

InformationInformationAssuranceAssuranceStrategyStrategy

Global ConnectivityGlobal Connectivity(Transformational(TransformationalCommunications)Communications)

Core EnterpriseCore EnterpriseServicesServices(NCES)(NCES)

UNCLASSIFIED 44

DoD Net-Centric Data Strategy

4

TrustedTrusted

InteroperableInteroperable

ResponsiveResponsive

AccessibleAccessible

UnderstandableUnderstandable

VisibleVisibleIs an information resource discoverable by most users?

Is it available on the network, and are tools readily available to use it?

Can it be intelligibly used? Are the semantics well documented?

Can it be combined or compared with other information? Can it be mediated?

Are the source, security level and access controls of the data available to users?

Is the data what users need? Are robust user feedback mechanisms in place to improve it?

The DoD Net-Centric Data Strategy, issued by the DoD CIO May 9,

2003, is the plan to make the Department’s information resources:

CC/S/As must institutionalize processes to accomplish these goals

UNCLASSIFIED 5

Metadata’s Role

• Discover the existence of data (e.g., html, doc, ppt, jpeg, mpeg, data store, etc)

• Discover a web service – To create, read, update, or delete data from a data store– To transact business (order products or services to be

rendered)

• Inform the machine of apps to process data (mime)

• Protect the data from improper access (national security & privacy)

• Inform the consumer of the data’s reliability

• Inform the consumer, application, and developer of the data’s organization & interpretation; the (web) service’s operations, i/o structures, and endpoints

• Inform the consumer, application, and developer of data transforms and metadata mappings

• And more…

Visible

Accessible

Understandable

Moreinfo

UNCLASSIFIED 66

Differentiating Types of Metadata

• Structural & Semantic Metadata– “Rules governing a chunk” - Name, description,

data constraints, and relationships of tags used

in information resources to delimit one chunk of

data from another chunk

– Artifacts where structural metadata is described:

XML schemas, RDBMS structures, taxonomies

– Register in DoD Metadata Registry, use

submission pkg

• Resource Metadata– “Advertisement” - Terms to aid in the recall and

retrieval of artifacts

– Artifacts that we collect resource metadata on:

PPT, DOC, GIF, JPG, MPG, RDBMS

– Register in “Data Catalog”, use DoD Discovery

Metadata Specification (DDMS)

UNCLASSIFIED 7DDMS: Leverages Industry Standards

7

DoD Discovery Metadata Specification (DDMS)

DDMS Attributes

Security

Title

Identifier

Creator

Publisher

Contributor

Date

Rights

Language

Type

Source

Subject

Geospatial

Coverage

Temporal Coverage

Virtual Coverage

Description

Format

Configuration managed by DoD Metadata WG

http://metadata.dod.mil/mdr/irs/DDMS

DDMS endorsed by Executive Order 13388

“Further Strengthening The Sharing Of Terrorism

Information To Protect Americans”

Data Catalog

(historical)

****

*

* mandatory

OGC: GML

W3C: Date & Time

W3C: OWL

IC: ISM

W3C: Date & Time

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

UNCLASSIFIED 888

* mandatory

DDMS endorsed by

Executive Order 13388

“Further

Strengthening The

Sharing Of Terrorism

Information To

Protect Americans”

DoD Discovery Metadata Specification (DDMS)

Configuration managed by DoD Metadata WG

Data Catalog

(historical)

Utility Beyond “Make Data Visible”

DDMS is enabler to multiple Data Strategy Goals

DDMS Attributes

Security

Title

Identifier

Creator

Publisher

Contributor

Date

Rights

Language

Type

Source

Subject

Geospatial

Coverage

Temporal Coverage

Virtual Coverage

Description

Format

****

*

OGC: GML

W3C: Date & Time

W3C: OWL

IC: ISM

W3C: Date & Time

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

ISO: Dublin Core

Make Data

Accessible

(practically)

Make Data

Accessible

(practically)

Make Data

Accessible

(responsibly)

Make Data

Understandable

Make Data

Understandable

Enable Data to

be Trusted

Enable Data to

be Trusted

UNCLASSIFIED 9

Scope & Scale comparable to DoD

UNCLASSIFIED 101010

MDR Support for Taxonomies

PoliticalOrganization

TerroristOrganization

ForeignTerroristOrganization

AlQaida

MyCOItaxonomy

DoD Coretaxonomy

<ddms>:<Subject>…/MyCOI.owl#AlQaida</Subject>

</ddms>

Organization

UrCOItaxonomy

TerroristGroup

Producer

View

Group

al-Qaeda

equals

equals

Consumer

View

UNCLASSIFIED 1111

DoD Core Taxonomy v0.75c

UNCLASSIFIED 1212

UCore v2.0 Default Taxonomy

UNCLASSIFIED 1313

FEA-BRM as OWL-encoded Taxonomy

UNCLASSIFIED 14

Taxonomies for Discovery

UNCLASSIFIED 15

Example DDMS metacard

References to controlled vocabularies

Moreinfo

Copyright 2007, The MITRE Corporation, Leo Obrst 16weak semanticsweak semantics

strong semanticsstrong semantics

Is Disjoint Subclass of with transitivity property

Modal Logic

Logical Theory

ThesaurusHas Narrower Meaning Than

TaxonomyIs Sub-Classification of

Conceptual ModelIs Subclass of

DB Schemas, XML Schema

UML

First Order Logic

RelationalModel, XML

ER

Extended ER

Description LogicDAML+OIL, OWL

RDF/SXTM

Syntactic Interoperability

Structural Interoperability

Semantic Interoperability

Ontology Spectrum: One View

UNCLASSIFIED 1717

DoD Metadata Registry (MDR)https://metadata.dod.mil

• Purpose– Provide an on-line repository which enables developers to reuse, understand, integrate with,

and share existing data assets (metadata)• Targeting web services, databases, and vocabularies

– Mandated for the publishing of semantic and structural metadata • DOD Directive 8320.2

– Provides a portal for developer access and web services for machine-to-machine access

• Key Facts– Over 8,000 users and 180,000 assets registered

– Over 900 Programs of Record supported

– Serving the DoD, DHS, IC, NASA and NATO

– Hosted on NIPR, SIPR, and JWICS (in progress)

– User driven via DoD Metadata Working Group and Feedback links

– Implements the ebXML standard for Metadata Registries (in DISR)

– User Name/Password or Single Sign-On through DKO

– Governance structure provided by Joint Enterprise Services ERB

• Primary Benefits– Enables reuse and governance of data assets

– Foundation for other services; e.g. mediation

– Allows the COI data assets to exist after the COI disbands

• Primary Audience – DoD Capability Developers, COIs

UNCLASSIFIED 1818

DoD MDR v7.0

Public areasPublic areas

UNCLASSIFIED 191919

MDR Support for Mediation

tacrep-2-kml.xsl(stylesheet)

tacrep.xsd(schema)

MDR OrganizesComponents for Mediation

HasXSLT

notional

Leverage Registered Components & Associations

tacrep.xml ebXML RegistryQuery service

tacrep.kml

schemaLocation=“.../tacrep.xsd”

UNCLASSIFIED 20

• Distributed Configuration Management

• 7 “Super” Namespaces

20

MDR Governance Namespaces

UNCLASSIFIED 2121

MDR Users

• Developers – Re-use and subscribe to registered data components, and/or

register new ones they have created

• Community of Interest (COI) Metadata Governors– Configuration Manage (CM) registered component (e.g.,

posting new metadata versions, version change notification etc.)

• Acquisition Policy Makers – Use Metadata Registry metrics for acquisition oversight (e.g.,

reflecting program participation, specific data component re-use etc.)

• Applications– Interface with registered components via Metadata Registry

Web Service (ebXML) to exploit reference tables, transformations, and XML schemas at Run Time

UNCLASSIFIED 2222

MDR Size and Scope

• Instances on 2 security enclaves– Unclassified and Secret

• Users – 10,360

• Information Resources – Submission Package – 1,294

– Schemas (e.g., DTD, XSD, etc) – 5,036

– Translations (i.e., XSL, XSLT) – 181

– Services (i.e., WSDL) – 567

– XML samples – 251

– Taxonomies (i.e., OWL) – 178

– Reference Data Sets – 5,709

– Amplifying Documents (e.g., DOC, ER1, etc) – 5,334

• 900 Programs of Record, 700 Organizations

Unclassified MDR Inventory

as of 24 Nov 2008

UNCLASSIFIED 2323

DoD MDR History

2000 2008

COE XML Registry

DoD XML Registration

MemoDoD Metadata Registry MDR on

SIPR

2002 20062004

v2.1 v3.1 v4.1 v7.0

MDR Implements ebXML RIM

& RS

v5.0v1.0

v6.1

Moreinfo

UNCLASSIFIED 2424

Net-Centric Publisher

XSDWSDLDDMSServiceEndpoint

Simplifies Metadata Publishing

UNCLASSIFIED 2525

Framework for Registry Interoperability

Inter-Registry Object References

Federated Queries

Centralized Authorityw/Local Caching

Object Relocation

Architecture Products

Enterprise SearchAggregator

Service

DDMS-basedQuery Service

Unclassified(U) MDR

Secret(U) MDR

MDR UDDI

Top Secret(U) MDR USTRANSCOMUSMTF

���� ����

����fully

automatedpush

OnlinePackage

Registration

����

MDR

More attention needed

(S)

(TS) (S)

MDR

Adapted from OASIS Cooperating Registries

UNCLASSIFIED 2626

www.disa.mil

UNCLASSIFIED

UNCLASSIFIED

UNCLASSIFIED 27

Additional questions, please use the

Comments and Feedback link at http://metadata.dod.mil27

PEO – GES Data Services Office

• Mission– Provide tools, techniques, and performance standards to enable

the DoD Data Strategy– Support DISA DoD Data Strategy compliance effort

• Products & Services– Chair DoD Metadata Working Group– Provide NCES Metadata Services support– Oversee operation of the DoD Metadata Registry– Develop and promote Data Strategy Enablers for Communities of

Interest (COIs)– Provide Data Strategy input to NCES Acquisition Milestone

Documents– Support NCES Product Branch, Testing & Evaluation,

Operations, Sustainment, and NetOps activities– Support DISA CIO in extending the Enterprise Information

Environment (EIE) technical procedures and standards for DISA internal systems

UNCLASSIFIED 28

Advanced Search

28

UNCLASSIFIED 29

Search Results

29

ratings

Add

to

Briefcase

UNCLASSIFIED 30

Information Resource Details

30

User-defined

URLs

UNCLASSIFIED 3131

Navigate through Relationships

UNCLASSIFIED 3232

Practical Utility for Taxonomies

• Applicable for – Content

– Services

– Structural Metadata

• Aid precision search via DoD Discovery Metadata Specification (DDMS)

Event

Physical Area Geographical Area

Territorial Subdivision Physical Community Country

Geopolitical Organization

Location Guidance

DoD Core Taxonomy

FIPS.xsdCountry.sql ISO.xsd

<ddms>

:

<Subject>…/DoDCore#Terrorist_Event</Subject></ddms>

UNCLASSIFIED 3333

Federated Search Use Case

FSFS EC

NCES Fed Search

Aggregator

Capabilities:

Enterprise Services –DECC Columbus

Interfaces:

EC

FS

Enterprise Catalog

Federated SearchExternal Applications, Services, and Data

Sources

Users

NCES Enterprise

Catalog

NCES Service Discovery

NCES Enterprise Services

Management

User Logs into DOL

Portal, DKO, or COI

Application

User Authorized by NCES Security

ServicesUser Submits Search Query

Query is federated and

results returned.

Aggregated results

returned

Results viewed by

user

Fed Search Aggregator

discovers data sources from

Service Discovery

NCES Security Service

FS FS

FS

Community of Interest

FS FS

FS FS

Program of Record

COI, POR, C/S/A Data Sources populated from applications, databases, web content, etc.

For immediate discoverability users may

post metadata to the Enterprise Catalog

Enterprise Web Content is crawled and

indexed

DS

DS DS

DS

DS DS

DS

DS(Web Enabled)

DS(Web Enabled)

Data SourceDS

DECC Columbus & San Antonio

Federated Search enables information sharing within and between PORs and COIs

UNCLASSIFIED 3434

Releasability Rules

NotionalExample

Attribute-Based Access Control

Security Clearance: SCitizenship: USRank: MajorAOR: AF

classification="TS" ownerProducer="USA GBR" SCIcontrols="SI TK" FGIsourceProtected="ISR" disseminationControls="OC REL PR" releasableTo="USA AUS CAN GBR" declassDate="2002-08-01" derivedFrom="Source Document"

UNCLASSIFIED 3535

Str

uctu

ral &

Sem

antic

Resourc

e

Topic

al A

ssert

ions

Visible ��

Accessible ��

Understandable �� �

Trusted �� �

Interoperable ��

Responsive �� �

Metadata Supports NCDS Goals

Title: ~~~~~~~~~~

Description: ~~~~ ~~~ ~~~

Author: ~~~ ~~ ~~~~~~

Subject: ~~~ ~~~ ~~~~

InformationResource

ResourceMetadata

Structural & SemanticMetadata

book

index card

template, dictionary, thesaurus

Analogy

=

=

=

UNCLASSIFIED 3636

Useful Links

• DoD CIO Data Strategy Homepage– http://www.defenselink.mil/cio-nii/

• DoD Metadata Registry– http://metadata.dod.mil

• DoD Discovery Metadata Specification– http://metadata.dod.mil/mdr/irs/DDMS

• NCES Techguide– http://metadata.dod.mil/mdr/ns/ces/techguide/

• NCES Developer Community – https://www.us.army.mil/suite/page/384284

• COI Toolkit– https://www.us.army.mil/suite/page/479547

• Intellipedia– https://www.intelink.gov/wiki