Collaborative Metadata Management

Binzmühlestrasse 14, CH-8050 Züriche-mail: jossen@ifi.unizh.ch, http://www.ifi.unizh.chTel.: +41-44-635 6753, Fax: +41-44-635 6809

Department of InformaticsUniversity of Zurich

Database TechnologyResearch Group

Claudio Jossen

Agenda� Motivation

� Metadata Management

� Metadata Management System (MDMS)

2

� Metadata Workflow

� Collaborative Metadata Management

� Conclusion

Motivation

• Joint work with the largest Swiss Health Insurance Company: Helsana

• Ca. 2 Million Customers

• New Data Warehouse

• Introducing SOA / SCA

• Well-established Processmanagement

• Problem: No central and standardized Metadata Interface (API / GUI)

3

Agenda� Motivation

� Metadata Management

� Metadata Management System (MDMS)

4

� Metadata Workflow

� Collaborative Metadata Management

� Conclusion

Kinds of Metadata

5

Metadata Management I

6

Metadata Management II

7

Source: : Meta Data Repository Redux, Part 1 & 2, DM Direct April 2004, www.dmreview.com

Agenda� Motivation

� Metadata Management

� Metadata Management System (MDMS)

8

� Metadata Workflow

� Collaborative Metadata Management

� Conclusion

Metadata-Dimensions

Model

Subject Area

Entity

ata

Hie

rarc

hy

Dimension 3: Abstraction

Sources

Data Warehouse Reporting

Enterprise Information Model

Model

Subject Area

Entity

9

Attribute

Model

Subject Area

Entity

Attribute

Model

Subject Area

Entity

Attribute

Model

Subject Area

Entity

Attribute

Dimension 2: Data Flow

Dim

en

sio

n 1

: D

a

Model

Subject Area

Entity

Attribute

Metamodel – Data schema

<rdf:Description rdf:about=http://www.helsana.ch/mdm/models/BDWH><rdf:li><rdf:Description rdf:about=http://www.helsana.ch/mdm/entities/adr><rdf:li><rdf:Description rdf:about=http://www.helsana.ch/mdm/attributes/adr/sprache_c><mdmErwin:ParentAttribute rdf:resource=http://www.helsana.ch/mdm/attributes/adr_typ/sprache_c/><mdmERwin:Code rdf:resource=http://www.helsana.ch/mdm/code_templates/bdwh/sprache_c/>

</rdf:Description></rdf:li>

10

</rdf:li>…</rdf:Description></rdf:li>…</rdf:Description>

Metamodel - ETL

<rdf:Description rdf:about=http://www.helsana.ch/mdm/transformations/SourceDB1001><mdmETL:Type>S</mdmETL:Type><mdmETL:Step rdf:resource=http://www.helsana.ch/mdm/steps/SourceDB1001_1>…</rdf:Description><rdf:Description rdf:about=http://www.helsana.ch/mdm/steps/SourceDB1001_1><mdmETL:Source rdf:resource=http://www.helsana.ch/mdm/attributes/T_D H_RECH/sender_ean/><mdmETL:Source rdf:resource=http://www.helsana.ch/mdm/attributes/T_DH_RECHPOS/ean_responsible/><mdmETL:Target rdf:resource=http://www.helsana.ch/mdm/attributes/ean/ean/></rdf:Description>

11

</rdf:Description>

L: LookupC: CaseB: CalculationS: StandardG: Generated

Metamodel – Information model

<rdf:Description rdf:about=http://www.helsana.ch/mdm/entities/InfoModel/Adresse><mdmInfo:Definition>Die Adresse eines Partners…</mdmInfo:Definition><rdfs:SubClassOf rdf:resource= http://www.helsana.ch/mdm/entities/InfoModel/Partner>

</rdf:Description><rdf:Description rdf:about=http://www.helsana.ch/mdm/entities/adr>

<rdfs:type rdf:resource= http://www.helsana.ch/mdm/entities/InfoModel/Adresse>

12

<rdfs:type rdf:resource= http://www.helsana.ch/mdm/entities/InfoModel/Adresse></rdf:Description>

Metamodel - OverviewHttp://www.helsana.ch/mdm/models/

Http://www.helsana.ch/mdm/entities/

mdmERwin:File_Name

mdmERwin:File_Name

mdmERwin:Model_Mart_Path

Http://www.helsana.ch/mdm/attributes/

mdmERwin:Entity

mdmERwin:Definition

mdmERwin:Note

Http://www.helsana.ch/mdm/domains/Http://www.helsana.ch/mdm/subject_areas/

mdmERwin:Note_2

mdmERwin:Note_3

mdmERwin:Subject_Area

mdmERwin:Definition

mdmERwin:Referenced_Entities

mdmERwin:UDP

mdmERwin:Logical Only

mdmERwin:Domain

mdmERwin:Domain_Name

mdmERwin:Type

mdmERwin:Datatype

mdmERwin:Logical_Datatype

13

Http://www.helsana.ch/mdm/key_groups/

Http://www.helsana.ch/mdm/udp_definition_groups/

mdmERwin:Logical_Only

mdmERwin:Physical_Name

mdmERwin:Comment

mdmERwin:Database

mdmERwin:Physical_Only

mdmERwin:Index_Generate

mdmERwin:UDP_Row_Count

mdmERwin:Type

mdmERwin:View_With_Check

mdmERwin:View_Where

mdmERwin:View_Group_By

mdmERwin:View_Having

mdmERwin:View_Order_By

mdmERwin:View_SQL

mdmERwin:Attribute

mdmERwin:Domain

mdmERwin:Logical_Only

mdmERwin:Definition

mdmERwin:Note

mdmERwin:UDP

mdmERwin:Physical_Name

mdmERwin:Datatype

mdmERwin:Not_Null

mdmERwin:Physical_Only

mdmERwin:Comment

mdmErwin:Physical_Order

mdmErwin:Parent_Attribute

mdmERwin:Physical_Name

mdmERwin:Key_Group_Type

mdmERwin:Index_Generate

mdmERwin:Index

mdmERwin:Key_Group_Member_Column

mdmERwin:UDP_Definition

mdmERwin:Type

mdmERwin:Definition

mdmERwin:UDP_List

Http://www.helsana.ch/mdm/code_templates/

mdmERwin:Database

mdmERwin:Query

mdmERwin:Template

mdmErwin:Code

Http://www.helsana.ch/mdm/code_mappings/

mdmERwin:Source

mdmERwin:Target

Architecture of the MDMS

MDMS User

Web Service ContainerRelational Database Java Web Container

SOAP HTTPSeRQL / SPARQL

14

Data Modelling ApplicationLocal Model Manager

XMI files

SOAP

Demo MDMS

15

Agenda� Motivation

� Metadata Management

� Metadata Management System (MDMS)

�

16

� Metadata Workflow

� Collaborative Metadata Management

� Conclusion

Metadata Workflow

17

(Meta-) Model-Operators I

µµµµ

18

(Meta-) Model-Operators II

στστστστ

19

(Meta-) Model-Operators III

• µµµµ: Transforms a simple RDF-Graph into a

versioned and authoring related RDF-Graph

• σσσσ: select - match - operator, returns an

integrated RDF-Graph out of two input RDF-integrated RDF-Graph out of two input RDF-Graphs, where one of them has to begenerated from the other by µ.

• ττττ: Reduces a versioned (temporal) RDF-

Graph to a simple RDF-Graph

20

Agenda� Motivation

� Metadata Management

� Metadata Management System (MDMS)

�

21

� Metadata Workflow

� Collaborative Metadata Management

� Conclusion

Collaborative Approaches

• Social Sciences:

� Communities of Practice (CoP)

• Computer Science:

� Web 2.0: Social Software

22

� Web 2.0: Social Software

� Semantic Web: Semantic Social Software

Communities of Practice (CoP)

• intra-/inter-organizational community

• synchronous / ansynchronous

• distributed

• domain-based

• no timetable

23

• no timetable

• self-organizing

(Semantic) Social Software

• Forum -> thread-based

• Blog -> documentation

• Wiki -> versioned authoring

• Portal -> information/application integration

24

integration

• And the winner is …

(Semantic) Wiki

25

Agenda� Motivation

� Metadata Management

� Metadata Management System (MDMS)

�

26

� Metadata Workflow

� Collaborative Metadata Management

� Conclusion

Conclusion

• The MDMS is now a stable and productive application with a growing number of users

• Implementation of the metadata authoring part still needs to be done

27

• In theory the wiki-approach fits the business requirements -> let’s see what the users will do with it…

Further Research

• Integration of Service-Metadata:RDF(S) und SOA (SAWSDL)

• Connection and Visualization of Business Processes (BPEL)

28

Processes (BPEL)

• Upgrade to a full Knowledge Management Portal (IT, Processes, Organization)

Questions? Comments?

Wer sonst hatWer sonst hat

sovielesoviele

Metadaten?Metadaten?

29

Metadaten?Metadaten?