Post on 29-Jan-2018
Enterprise data architecture of complex
distributed applications & services
Davinder
Kohli
Data Metamorphosis
Process
Requirements
Architecture/Desig
nBusi
nessData App Tech
Implementation
Business/Data Transfer
Objects
Deploy/Test
Data
Provisioning
Test
Scenarios
Use Cases
Data – lifeblood of an
organization
Data is an asset
Data has economic value
Data must be shared and easily accessible
Data must have common terminology & definitions
Data needs to be secured
SOA Ecosystem - Use
Case
UI
Confused? Where do I start?
Http
Session
Service A Service B Service C
Service
C1Service
C2Service
C3
Service
A1Service
A2Service
A3
Service
B1Service
B2Service
B3
Service A31
Service A32
Service A33
Service B31
Service B32
Service B33
Service C31
Service C32
Service C33
Service A2, A33, B1, B32, C1, C31
Data Flow/Mapping - facet of Data Architecture
Why? Identify sources of data
Define data interrelationship
Flow of information through the app’s ecosystem
Public/non-public information
Data provisioning for testing
What? UI - data rendering, form submissions
Complex Services – requests, responses
Unnecessary data – movement, duplications
Absence of Data Flow/Mapping Implementation
Longer implementation cycle
Too much information to figure out Redundant data objects Too much data movement
Testing Confusion during data provisioning Lack of coordinated datasets Longer testing cycle
Quality More unit tests More lines of code
Performance degradation
Challenges in data mapping Getting buy-in from stakeholders
Lack of data dictionary
Silo’d resources – technology, people, process (release cycle)
Evolving interfaces – WSDL, DB Schema
Long term maintenance
Approach/Solution Approach
Top down – Business cases
Bottom up – Existing interfaces, WSDLs
Resource alignment – people, artifacts
Artifacts
Data Mapping/Flow Sheet
Analysis of data flow/mapping
Reduce data movement
Identify redundancy of data sources
Gaps in mapping
SOT
How to build data mapping?
Sample
UI
IxD CCLUse
Cases
Data
Mapping
WSDLsWSDLs
WSDLs
Bottom Up
Top Down
CSD
Demo
Wanna checkout
my data
flow/mapping?
Artifact Creation Approach
Data Model Beans
WSDL(s)
Data Mapping
File
UIWSDL(s)WSDL(s)
Data Mapper
Utility
(Apache
POI,JAXB)
Data Model Beans
WSDL to
Java
Manual
Creation
Java AdaptersXSLT Transformers
Mapping done
manually by
developer
Manual CreationManual Creation
Questions?