Post on 25-Jan-2015
description
Metadata and Metadata and IT service managementIT service management
Charlie BetzCharlie BetzAccentureAccenture
04/10/23 2Metadata & IT Service Management
What we will coverWhat we will cover
A brief history & analysis of this A brief history & analysis of this word “metadata”word “metadata”
Comparison and contrast of Comparison and contrast of metadata repository, CMDB, and metadata repository, CMDB, and other sources of structured IT other sources of structured IT information. information.
CMDB data architectureCMDB data architecture Technical and organizational issues Technical and organizational issues Integrated, ERP-like solutions for ITIntegrated, ERP-like solutions for IT
04/10/23 3Metadata & IT Service Management
What is “metadata”?What is “metadata”?
A view from the data analysis A view from the data analysis community:community:
““Metadata describes critical elements Metadata describes critical elements of data scattered across the of data scattered across the organization.”organization.” (Jahn) (Jahn)
04/10/23 4Metadata & IT Service Management
The data dictionaryThe data dictionaryLogical Name
Physical Name
Definition
Entity Customer CUST An identified consumer or purchaser of enterprise services.
Logical Name
Physical Name
Definition Datatype
Attributes First Name FNAME A first or given name char(32)Last Name LNAME A last or surname char(32)Address 1 ADDR_1 The first part of a mailing
address.char(64)
Address 2 ADDR_2 The second part of a mailing address.
char(64)
City CITY The city pertaining to the mailing address.
char(64)
State STATE A recognized metropolitan char(2)Zip ZIP A US ZIP code. char(5)
04/10/23 5Metadata & IT Service Management
The data dictionary in The data dictionary in contextcontextLogical
NamePhysical Name
Definition
Entity Customer CUST An identified consumer or purchaser of enterprise services.
Logical Name
Physical Name
Definition Datatype
Attributes First Name FNAME A first or given name char(32)Last Name LNAME A last or surname char(32)Address 1 ADDR_1 The first part of a mailing
address.char(64)
Address 2 ADDR_2 The second part of a mailing address.
char(64)
City CITY The city pertaining to the mailing address.
char(64)
State STATE A recognized metropolitan char(2)Zip ZIP A US ZIP code. char(5)
What databases is this data structure in?
What servers are they on?
What programs depend on this data?
What data feeds contain this data structure?
Over what middleware are they flowing, and where are they going?
04/10/23 6Metadata & IT Service Management
Scope, scope, Scope, scope, scopescope
All of the following are metadata according All of the following are metadata according to current metadata expertsto current metadata experts
Software portfolio (application inventory)Software portfolio (application inventory) IT assets (hardware inventory)IT assets (hardware inventory) File, database, object, class, and File, database, object, class, and
component definitionscomponent definitions Business process documentationBusiness process documentation Organizational structure as it relates to IS Organizational structure as it relates to IS
system control (e.g., data stewardship, system control (e.g., data stewardship, business process ownership)business process ownership)
Data transformationsData transformations Batch job operationsBatch job operations Data quality statisticsData quality statistics Software configuration managementSoftware configuration management
04/10/23 7Metadata & IT Service Management
Configuration management Configuration management according to ITILaccording to ITIL
The Configuration Management system The Configuration Management system identifies relationships between an item that is to identifies relationships between an item that is to
be changed and any other components of the be changed and any other components of the infrastructure, infrastructure,
thus allowing the owners of these components to thus allowing the owners of these components to be involved in the impact assessment process. be involved in the impact assessment process.
Whenever a Change is made to the Whenever a Change is made to the infrastructure, infrastructure, associated Configuration Management records associated Configuration Management records
should be updated in the CMDB. should be updated in the CMDB. Where possible, this is best accomplished by use Where possible, this is best accomplished by use
of integrated tools that update records of integrated tools that update records automatically as Changes are made.automatically as Changes are made.
04/10/23 8Metadata & IT Service Management
Scope of CMDBScope of CMDB
From ITIL Service Support From ITIL Service Support volume:volume:
Infrastructure servers Infrastructure servers Mainframes Mainframes Customer and supplier Customer and supplier
databases [why stop databases [why stop there?]there?]
Operational Operational environments and environments and applications supporting applications supporting regulated business regulated business systems systems
Mission-critical services Mission-critical services
Desktop builds and Desktop builds and software licencessoftware licences
Networks. Networks. Items that could affect Items that could affect
regulatory compliance regulatory compliance for the organisation for the organisation
EDI and database EDI and database feeds, e.g. payroll feeds feeds, e.g. payroll feeds
External interfaces to External interfaces to trading partners, trading partners, suppliers, Customers suppliers, Customers and business partners and business partners
Interfaces to branches Interfaces to branches with Customer systemswith Customer systems
04/10/23 9Metadata & IT Service Management
Other possible CMDB Other possible CMDB data sources data sources
From ITIL Service Support volume:From ITIL Service Support volume:
Requirements analysis and Requirements analysis and design tools, systems design tools, systems architecture and CASE toolsarchitecture and CASE tools
Database management Database management audit toolsaudit tools
Document-management Document-management systemssystems
Distribution and installation Distribution and installation toolstools
Comparison tools Comparison tools Build and release tools Build and release tools Installation and de-Installation and de-
installation toolsinstallation tools
Compression toolsCompression tools Listing and Listing and
configuration configuration baseline toolsbaseline tools
Audit tools (also Audit tools (also called 'discovery' or called 'discovery' or 'inventory' tools)'inventory' tools)
Detection and Detection and recovery tools recovery tools
Reporting toolsReporting tools
04/10/23 10Metadata & IT Service Management
From the ITIL data From the ITIL data management volume management volume
(back-catalog)(back-catalog) “A corporate
repository is a store house for all the data definitions of the complete corporate data model for access by all its authorized users…. UNIX, DEC VAX, PC and other environments use the concept of a Configuration Management Database …”
Metadata repository vs. Metadata repository vs. CMDBCMDB
MDR
CMDBOperations
Development
Management frameworksNon-database discovery tools
CASE toolsSource code
scanners
SCM tools
DBMS scanning
Maintenance processes
Development processes
Config, change, incident, problem, release, etc.
This is the BIG difference!Unstable state. There is strong pressure to converge!
04/10/23 12Metadata & IT Service Management
Configuration management Configuration management that’s not about metadatathat’s not about metadata
Desktops have rarely if ever been of Desktops have rarely if ever been of interest to metadata administratorsinterest to metadata administrators
Metadata is typically not integrated Metadata is typically not integrated with management frameworkswith management frameworks Perhaps this should change!Perhaps this should change!
Metadata has been historically Metadata has been historically weak in processweak in process Assumes that someone else has been Assumes that someone else has been
keeping it up to datekeeping it up to date
04/10/23 13Metadata & IT Service Management
Can my metadata Can my metadata repository repository
also be a CMDB?also be a CMDB? Possibly, but…Possibly, but…
Most ITIL suites integrate at least Most ITIL suites integrate at least change, config, and incident. change, config, and incident.
More convenient, but also greater More convenient, but also greater vendor lock-in.vendor lock-in.
Stand-alone CMDBs can existStand-alone CMDBs can exist One can decouple the CI inventory from One can decouple the CI inventory from
process applications through unique IDs process applications through unique IDs (e.g. URLs/URIs)(e.g. URLs/URIs)
Your repository starts to turn into an Your repository starts to turn into an OLTP tool; be readyOLTP tool; be ready
04/10/23 14Metadata & IT Service Management
Repository as CMDB - 2Repository as CMDB - 2
Simple data
Complex dataAre you ready for
complex data?
04/10/23 15Metadata & IT Service Management
Challenges of complex Challenges of complex datadata
Deep inheritance Deep inheritance from highly abstract from highly abstract supertypessupertypes
Recursion (trees and Recursion (trees and networks)networks)
Many many-manysMany many-manys All of the above All of the above
result in result in object/relational object/relational mapping layers in mapping layers in advanced repository advanced repository productsproducts
Industry standards…Industry standards…
04/10/23 16Metadata & IT Service Management
The CMDB requirementsThe CMDB requirements ““Configuration structures should describe the relationship and position of Configuration structures should describe the relationship and position of
CIs in each structure… CIs should be selected by applying a CIs in each structure… CIs should be selected by applying a decomposition process to the top-level item using guidance criteria for the decomposition process to the top-level item using guidance criteria for the selection of CIs. A CI can exist as part of any number of different CIs or CI selection of CIs. A CI can exist as part of any number of different CIs or CI sets at the same time… The CI level chosen depends on the business and sets at the same time… The CI level chosen depends on the business and service requirements. service requirements.
““Although a 'child' CI should be 'owned' by one 'parent' CI, it can be 'used Although a 'child' CI should be 'owned' by one 'parent' CI, it can be 'used by' any number of other CIs… by' any number of other CIs…
““Components should be classified into CI types…Typical CI types are: Components should be classified into CI types…Typical CI types are: software products, business systems, system software.…software products, business systems, system software.…
The relationships between CIs should be stored so as to provide The relationships between CIs should be stored so as to provide dependency information. For example, … a CI is a part of another CI[,] … dependency information. For example, … a CI is a part of another CI[,] … a CI is connected to another CI [,] … a CI uses another CI…”a CI is connected to another CI [,] … a CI uses another CI…”
04/10/23 17Metadata & IT Service Management
Configuration item Configuration item definitiondefinition
Per ITIL: The CM team is to "set up CI Per ITIL: The CM team is to "set up CI types, attributes, types of relationships, types, attributes, types of relationships, high-level CIs."high-level CIs."
Defining types and valid dependencies Defining types and valid dependencies is metamodelingis metamodeling
Difficult, abstract task for CMDB admins Difficult, abstract task for CMDB admins Risks re-inventing metamodel wheel Risks re-inventing metamodel wheel
when standards existwhen standards exist
04/10/23 18Metadata & IT Service Management
Naïve CMDB metamodelNaïve CMDB metamodel Far too close to the data modeler’s inside jokeFar too close to the data modeler’s inside joke Doesn’t scale! SQL databases can’t optimize…Doesn’t scale! SQL databases can’t optimize… Seek out your company’s data architecture group!Seek out your company’s data architecture group!
(You’ll probably need the most senior person to (You’ll probably need the most senior person to assist in assessing/setting up your CMDB.)assist in assessing/setting up your CMDB.)
Thing
04/10/23 19Metadata & IT Service Management
Problems of unconstrainedProblems of unconstrained any to any any to any
Columns can contain databases, Columns can contain databases, tables can contain servers, and so on.tables can contain servers, and so on.
Logical consequence: “black belt” Logical consequence: “black belt” team emergesteam emerges
Can’t outsource data entryCan’t outsource data entry HP just introduced HP just introduced
constraint architectureconstraint architecture Need standards!Need standards!
04/10/23 20Metadata & IT Service Management
Challenge your vendors!Challenge your vendors!
If I define an service CI, and a server If I define an service CI, and a server CI, can I prevent my CMDB admins CI, can I prevent my CMDB admins from putting the service from putting the service inside inside the the server?server?
If I define a hard drive CI, and an If I define a hard drive CI, and an application CI, can I prevent my CMDB application CI, can I prevent my CMDB admins from making the application admins from making the application directly dependentdirectly dependent on the hard drive? on the hard drive?
The technical data management term The technical data management term is “constraints.” Does your tool support is “constraints.” Does your tool support them?them?
04/10/23 21Metadata & IT Service Management
Trying to make sense of Trying to make sense of the enterprise IT worldthe enterprise IT world
IT Governance IT Governance Portfolio ManagementPortfolio Management
Project Portfolio ManagementProject Portfolio Management Application Portfolio Application Portfolio
ManagementManagement IT Portfolio ManagementIT Portfolio Management
IT Service Management IT Service Management ChangeChange IncidentIncident ConfigConfig AssetAsset ReleaseRelease CapacityCapacity ContinuityContinuity … … moremore
StandardsStandards ITIL, COBIT, CMM, TOGAF, ITIL, COBIT, CMM, TOGAF,
IEEE/ISO/ANSI, …IEEE/ISO/ANSI, …
Business Service Business Service ManagementManagement
Enterprise Architecture Enterprise Architecture Configuration Configuration
Management Management Application/Technology Application/Technology
Relationship MappingRelationship Mapping Application Application
Profiling/Reverse Profiling/Reverse EngineeringEngineering
IT DiscoveryIT Discovery Data & Metadata Data & Metadata
ManagementManagement
04/10/23 22Metadata & IT Service Management
The IT value chainThe IT value chainDefine/Analyze
Design/Build
Deploy/Run
Measure/Optimize
04/10/23 23Metadata & IT Service Management
Simplified convergenceSimplified convergence
ERPfor IT
Pla
n
04/10/23 24Metadata & IT Service Management
ERPfor IT
The IT tools vendor The IT tools vendor cyclonecyclone Most are silos
Tremendous data redundancy
Limited interoperability and/or standards
Great risk of lock-in!
Pla
n
04/10/23 25Metadata & IT Service Management
Plan
The internal IT tools messThe internal IT tools mess
ERPfor IT
CMDB
Metadatarepository
CASE tools(Modeling, SCM)
EnterpriseArchitecture
Project/programportfolio
Projectmanagement
Applicationportfolio
Operationsframework &
metrics
ETL
Elementmanagement
04/10/23 26Metadata & IT Service Management
The tools mess 2The tools mess 2
Most shops do not build these Most shops do not build these interfaces, resulting in disparate interfaces, resulting in disparate internal IT data and IT service internal IT data and IT service inefficiencyinefficiency
They are VERY TOUGH tools-level They are VERY TOUGH tools-level programmingprogramming
WE NEED STANDARDS!WE NEED STANDARDS!
CMDB
Metadatarepository
CASE tools(Modeling, SCM)
EnterpriseArchitecture
Project/programportfolio
Projectmanagement
Applicationportfolio
Operationsframework &
metrics
ETL
Elementmanagement
04/10/23 27Metadata & IT Service Management
The standards The standards convergenceconvergence
04/10/23 28Metadata & IT Service Management
ConclusionsConclusions
Look for opportunities for data re-use in Look for opportunities for data re-use in ITIT
Don’t underestimate the difficulty of Don’t underestimate the difficulty of defining the CI metamodeldefining the CI metamodel
Or building interfaces between internal Or building interfaces between internal IT toolsIT tools
Challenge your vendors for Challenge your vendors for understandable, standard data models understandable, standard data models more detailed than “any to any.”more detailed than “any to any.”
Start paying attention to the standards Start paying attention to the standards warswars
04/10/23 29Metadata & IT Service Management
ResourcesResources www.erp4it.comwww.erp4it.com Charlie’s weblog Charlie’s weblog www.itil.co.ukwww.itil.co.uk official ITIL website official ITIL website http://www.ogc.gov.uk/index.asp?id=1000364http://www.ogc.gov.uk/index.asp?id=1000364 ITIL ITIL
publicationspublications www.itsmf.comwww.itsmf.com ITSMF international ITSMF international http://en.itsmportal.net/http://en.itsmportal.net/ ITSM portal ITSM portal http://www.itilpeople.comhttp://www.itilpeople.com independent ITIL portal independent ITIL portal http://www.tso.co.uk/itil/http://www.tso.co.uk/itil/ Back catalog, including data Back catalog, including data
management volumemanagement volume www.dmtf.orgwww.dmtf.org Distributed Management Task Force, Distributed Management Task Force,
standards organization focusing on detailed standards organization focusing on detailed metamodels for operational IT metamodels for operational IT
www.dcml.orgwww.dcml.org Data Center Markup Language, Data Center Markup Language, essentially a new DMTF competitoressentially a new DMTF competitor
www.omg.orgwww.omg.org Standard metamodels from a Standard metamodels from a development perspectivedevelopment perspective