The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric...

48
The Real-Time Middleware Company SM The Data-Centric Future The Data-Centric Future

Transcript of The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric...

Page 1: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

The Real-Time Middleware CompanySM

The Data-Centric FutureThe Data-Centric Future

Page 2: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources
Page 3: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

The Data-Centric Future

Page 4: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

“The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it.”

-- Mark Weiser, 1991 Scientific American article on Pervasive Computing

“The shift today is from thinking about servers and objects and code to thinking only about information flow. The network can bring everything you need to know, now.”

-- RTI 2006, The Real-Time Middleware Company

Pervasive Technology

Page 5: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Pervasive Data Space

Pervasive Data

� Today’s newly-connected distributed systems are just the beginning

� Pervasive data will drive the vast distributed applications of the future

DBMS

DBMSDBMS

Internet WebService

EmbeddedNode

DBMS

EnterpriseServer

Internet EmbeddedSystem

EmbeddedNode

EmbeddedSystem

Enterprise

Page 6: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

What is DDS?

� DDS = Data-Distribution Service for Real-Time Systems� Data-centric publish-subscribe communications

– Just declare your intent to publish or receive data– No or minimal configuration

� Real-time performance– No need to specially request every piece of data– Direct peer-to-peer transport (no servers!)– Event-driven transfer

� Flexible & powerful QoS control

DDS

Alarm AlarmData Data

Publisher Subscriber Subscriber

Applications justsend or receive data with a standard API.

Page 7: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Messaging Technologies

Non-real-time Soft real-time Hard real-time Extreme real-time

Java/RMIJava/JMS

CORBA

MPI

Java RTSJ (soft RT) RTSJ (hard RT)

Web Services

Mes

sag

ing

T

ech

no

log

ies

and

Sta

nd

ard

sM

essa

gin

g

Te

chn

olo

gie

s an

d S

tan

dar

ds

Data Distribution Service / DDS

RT CORBA

Adapted from NSWC-DD OA Documentation

Page 8: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Data-Centric Programming

� Data-Centric Perspective– Focus on how the data is moving and transforming in your system– Sources and sinks– Static vs dynamic– Filtering: who needs what data when?– Storage and retrieval – Size and complexity– Physical system and transport limitations

� Tenets of Data-Centric Programming– Expose the data– Hide the code– Separate data and code

� Data-handling and data-processing– Code generated from Interfaces– Loosely coupled

Page 9: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Object Oriented vs. Data Centric

Loosely CoupledTightly coupled

Changes:Change declarative data file

Changes: Read & change code

Strict separation of parser, validator, transformer, and logic

Combined processing, no restrictions

Messages are primaryData model or schema

API / object model

Must agree on data mapping, mapping system

Mobile code

Separate data & codeIntermix data & code

Hide the codeExpose methods – code

Expose the dataHide the data (encapsulation)

Data CentricObject Oriented

Page 10: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

A Great Time for DDS!

� The infrastructure evolution cycle is churning…– New -> Emerging -> Standard -> Commodity– Middleware is emerging as OS declines

� …DDS is maturing…– OMG focus– Wire spec– Tools– Enterprise integration– Multiple products fielded– Deployed applications!

� …and adoption is on the rise– Navy– DISR– FCS/SoSCOE– Many significant applications

Page 11: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Who is RTI?

� DDS market leaders� Experts in real-time distributed information management� Founded out of the Stanford Aerospace Robotics Lab� Active in standards, including OMG, NCOIC, Eclipse, Open Group� Sustained growth, strong financials� Committed to customer success: 98% customer satisfaction

Page 12: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Mission

To be the Recognized Leader of Software and Solutions for Real-Time

Communications Middleware

Page 13: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

RTI Experience & Maturity

� ~400 different publish-subscribe applications– 75 DDS API applications

� 20+ major Navy programs

– Thousands of deployments

� 350+ graduates of RTI’sDDS QuickStart

� 65 OS+CPU+Compilercombinations supported as standard product

� Nightly automated build & performance measurement, stress testing

Page 14: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

A Tour of Some RTI Applications…

Telecom/Datacomm

Robotics and Automation

Aerospaceand Defense

Transportation

Page 15: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

� Ship-Wide Area Network (SWAN)– Shipboard control– Machinery control– Damage control– Integrated condition assessment– Steering control– Advanced Degaussing (Magnetic signature)– Mission control systems– Navigation systems– Communication systems– Support systems for “visitors”

LPD-17

Page 16: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

HiPer-D TEST BEDNSWC DAHLGREN DIVISION

Main Display Area with 2 Operator Positions Equipment for Multiple Ship Representations

Software Development Stations

SPY Control Position

TBM Signal Processing Sun Tactical Compute Pool

Page 17: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Navy Open Architecture Ship Self Defense System (SSDS)

� Project to employ standards throughout ship systems (frameworks, OS, etc.)

� Goal: Reduce total cost of ownership, ease system upgrades, reduce interoperability issues

� RTI Services provided advanced integration, support & consulting

� First deployment at sea now

Page 18: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

� Distributed combat and control system for U.S. Navy ship

� Concerned with extensibility of system, compatibility between vendors, easy upgrades

� OMG DDS is the specified standards-based middleware in US Navy Open Architecture

� RTI Data Distribution Service selected on performance, extensions and advanced services

Littoral Combat System (LCS)

Page 19: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

� Next-generation of the U.S. Navy Aegis Weapon System

� Challenge to share time-critical data across highly distributed system including radar, weapons, displays and controls

� Need to maximize future scalability and flexibility

� RTI provides real-time communication infrastructure. Standards-based & extensible for future system enhancements

Lockheed Martin US Navy Aegis Open Architecture Weapon System

Page 20: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

DD(X) U.S. Navy Destroyer Program

�Zumwalt is the lead ship in a class of next-generation, multi-mission surface combatants

�RTI powers the Total Ship Computing Environment Infrastructure (TSCEI), the backbone of the network computing system and basis for all DDG 1000 application software programs

� “The selection of RTI came through a process which uses formal evaluation criteria and a source selection board to ensure that the Navy gets the best value. This is an emerging product market and it was determined that the offering from RTI, a small privately held company, provides the best value to the Navy.”

-- Raytheon DDG 1000 System Software Development Director Bob Martin

Page 21: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Highway Traffic Monitoring in Tokyo

Transportation

�The City of Tokyo provides real-time information to commuters and officials about traffic problems

�Hundreds of traffic monitors and information kiosks along the highway

�Challenge to deliver information to variety of server & client platforms, via links varying in bandwidth & location

�RTI enables reliable delivery of information over heterogeneous systems and with minimal bandwidth

Page 22: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Train Communications

� US railways embarked on an effort to standardize communications – 10,000 trains, 100,000 communications stations

� Required combined wireless, wired, real-time and enterprise elements

� RTI Data Distribution Service chosen because of its high performance and scalability

� RTI Services helped develop proposal, educated on the DDS standard and created performance tests

Page 23: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

U.S. Army Munitions Transfers

� The US Army built a “smart”robotic crane to automate manpower-intensive munitions transfer process

� Challenge to coordinate multifaceted system requiring high level of precision

� RTI offered the performance and reliability required for complex system

� RTI Services integrated hardware and software systems from many vendors

Page 24: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

� Autonomous vehicle in the 2005 DARPA Grand Challenge race

� Unique characteristic of FireFox: adaptive vision system – vehicle “learns” through example

� Complex network of control and vision systems, sensors, processors, operating systems

� RTI integrates all kinds of data sources, shares data with minimal latency

DARPA Flying Fox Autonomous Vehicle Systems

Page 25: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Ship-to-Ship Cargo Transfer

� ONR asked RTI to develop the software for a ship-to-ship cargo transfer system for rough sea conditions

� RTI Consulting Services developed turn-key control software for the robotic crane, and successfully demonstrated it at sea

Page 26: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

U.S. Army and University of Iowa Driving Simulator

� The National Advanced Driving Simulator provides state-of-the-art real-time driving simulation

� High number of systems – visual, motion, controls, etc. -exchanging and processing data in real-time

� Real-time performance was critical: other middleware such as CORBA and DCOM were simply not fast enough

Page 27: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Flight Simulator Takes Off with RTI

For communications between full flight simulator subsystems, CAE, one of the world's leading providers of simulation and training, used RTI over high-bandwidth IEEE-1394 on its Sim XXI product line.

"In the past we probably would have developed an expensive, proprietary system for data communications. By using RTI, we were able to deliver a proven, reliable and cost effective solution to our customers.“

--Peter Jarvis, Chief Designer, CAE Civil Simulation & Training Division

Page 28: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Force Technologies Ship Simulations

� FORCE trains ship captains by using accurate simulations of actual locales worldwide

� Performance - many components need to come together and share data in real-time

� Scalability - Want to integrate systems more rapidly

� RTI delivered on the performance and scalability requirements. RTI Services also helped design the application

Page 29: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

� Modern factories require the exchange of up-to-the-minute data on manufacturing processes, even with resource-constrained devices

� RTI met the challenge to incorporate devices with limited memory or processing power

� RTI Engineering Services with Schneider created a compact real-time publish-subscribe service – it resides & executes in under 100 kb!

Industrial Automation

Schneider Line of Programmable Logic Controls

Page 30: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Harmonic Digital TV Video-on-Demand

� Harmonic builds transmission equipment to enable video-on-demand worldwide

� Challenge delivering data over WAN to and from disparate hardware

� RTI offers richer feature set than other solutions. Also enables scalability and future extensibility of the system

� Standard commercial off-the-shelf solution key to meeting tight schedule, lowering costs –chose RTI as leader of COTS publish--subscribe solutions

Communications

Page 31: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

AWACS Radar System Upgrade

� Airborne control system for surveillance, command & control and battle management

� Upgrading system to be open, supportable, less expensive to maintain and extend

� RTI is standards-based, open and extensible, reducing integration risk

� RTI is a proven COTS solution, reducing total cost of ownership over in-house development

Page 32: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

DDS B-1B Tactical Systems Upgrade

DDS is being used to seamlessly integrate legacy flight control systems with a new open architecture tactical communication and control system.

� Adding new command & control and communications capabilities that need to work with legacy control system

� B1B needs an architecture that is open & modular for future extensions and upgrades

� RTI is open and scalable, reducing integration risk, standards-based ensuring supportability

Page 33: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

So, Why DDS?

� Why do all these customers buy publish-subscribe middleware?

–System Integration–Flexibility–Performance –Standards compliance

Page 34: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Why Distribution Middleware?

8.0 Training

5.0 Communications

2.0 Sensors

3.0 Fusion

4.0 BMC2

7.0 Visualization

6.0 Sensor Control

1.0 Common Services

� Grouping the modules into functional clusters does nothing to change that reality and ease software integration

UNCLASSIFIED

� Hawkeye has functionally oriented software modules

� Each module talks to many other modules

RIP TRK MSIWAC TDA

ESM SAFERDR IFF

SEN DSCL4 L16L11

HMI ACIS

DIA NAV IPCCMCPMUX

FIL TDM

� Adding new functionality cascades integration re-work across many other modules

CEC

8.0 Training

5.0 Communications

2.0 Sensors

3.0 Fusion

4.0 BMC2

7.0 Visualization

6.0 Sensor Control

1.0 Common Services

RIP TRKCEC MSIWAC RAIDERTDA

DWC

CHAT

ESM SAFERDR IFF

SEN DSCD

istributed D

ata Framew

orkIPv6L4 L16L11

HMI ACIS T4O

DIA NAV IPCCMCPMUX

FIL TDM aADNS TIS

1.0 Common Services

� Changing the communication between the modules can ease integration, when the new ‘Publish Subscribe’ approach is used – each module publishes its output w/o regard to who is receiving it, in contrast to the point-to-point approach of traditional inter-process communication

It’s about an architecture that can assimilate evolving functionality, rather than remaining set in time

Page 35: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Flexibility

� Per-data-stream Quality of Service– 22 QoS parameters– Determinism vs. reliability, bandwidth, filters, deadlines,

ordering, etc.– Handles a huge range of demanding delivery requirements– Integrates systems with very different needs

� Fault tolerant (esp. over unreliable media)– Natural fail-over to alternate publishers– Notification on QoS contract violation

PublisherNode

I havedata every

.005 sec.

SubscriberNode

I needdata every

.001 sec.

SubscriberNode

I needdata every

.01 sec.

Page 36: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Industry-Leading Performance

Throughput Latency

RTI

RTI

JMS

JMS

-

100

200

300

400

500

600

700

800

900

16 32 64 128 256 512 1,024 2,048

Message size (bytes)

Meg

abits

pe

r sec

ond

Benchmark performed over Gigabit Ethernet between 2.0 GHz Opteron PCs running Linux. RTI can saturate the network with packet sizes greater than 2,048 bytes.

0

50

100

150

200

250

300

350

400

16 32 64 128 256 512 1,024 2,048

Message size (bytes)

Min

imum

late

ncy

(mic

rose

cond

s)

Page 37: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Standards

� Standards invite competition

� Competition builds excellence

� Excellence creates markets & pushes technology into new markets

� We welcome competition!– Together we will realize

DDS’s potential

Page 38: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

DDS Is Building an Ecosystem

� Life needs an ecosystem to thrive

� Technology needs an ecosystem to thrive

� What’s in an ecosystem?– Many products

– Services and support– Tool chains

– Platform support

– Integration with enterprise technologies

– Best-of-class 3rd party technologies

Page 39: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

RTI’s Ecosystem

� Best-of-class technologies– *Object Computing Inc. (OCI): ACE-TAO CORBA– *Oracle: In memory and enterprise databases– *Sherrill Lubinski (SL): Dashboard and GUI

building– SparxSystems: UML and MDA tools– Themis: Application Management Tools– Dot21: Track Analysis and Visualization Tools– Motorola: Hardware integration– Arrow: Enclosures, packaged product– Wind River, LynuxWorks, Green Hills: RTOS

� The ecosystem can deliver whatever you may need

*RTI resells these technologies

Page 40: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

RTI Data Distribution Service 4.1

� Fourth-generation maturity– Based on experience with ~400 different designs since 1996– Proven in real-world, mission- and life-critical applications

� Market-leading adoption– #1 in embedded middleware market share*

(encompassing all middleware types)– >70% worldwide share of DDS market**

� Industry-leading technology– Consistently highest-performance middleware– Advanced buffering architecture– Standards compliant– Pluggable transport design– Wide and deep platform support (over 60 platforms)– Zero-configuration deployment– Strict reliability mode– Large-data-type support

*Embedded Market Forecasters, June 2006; **VDC Analyst Report, Nov 2006Skip

Page 41: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

CORBA Integration and Support

� RTI supports CORBA and DDS applications with a common IDL file and language mapping

� RTI is now distributing and supporting CORBA– ACE TAO

– Partnership with OCI

IDL File

RTI IDL Compiler

TAO IDL Compiler

DDS Support Code

CORBA Types

CORBA Stubs & Skeletons

Page 42: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

RTI Real-Time Connect

(In-Memory)Database

Table.PassengersFlt Name Addrs----------------------C129 A. Johnson …C054 J. Smith ….……

Table.TracksFlt Lat. Long.----------------------C129 34.5 102.3C054 27.7 46.8……

RTI Real-Time Connect

Embeddedapplication

Embeddedapplication

Embeddedapplication

Real-Time Enterprise

Real-timemessages

Enterprise

infrastructure

Database changes

Page 43: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Enterprise Integration

DDSApplication

DDSApplication

DDSApplication

RelationalDatabase

RelationalDatabase

Relational Database

Web Server

SQL Application

JMS Application

RTC DatabaseIntegration

SOA services

WSDL, XMLBP

EL

Ser

vice

Orc

hest

ratio

n

SQL Application

Real-Time Enterprise

SOA architectureStandard APIsStandard ComponentsStandard Interfaces

Standard Networks and Transport Interfaces

Page 44: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Pervasive Data Space

DBMS

DBMSDBMS

EnterpriseApp Embedded

App

Fast StorageApp

EmbeddedApp

InternetApp

Standards-Based Pervasive-Data Space

� A first step towards the pervasive data “e2E” vision– All data is accessible to all applications with standard APIs– The system can provide any information, past or present, to any

location at any time. – Data models map transparently– No need for application-level bridging

Web SQL

DDSSQL

DDS

Page 45: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

To Learn More About DDS…

� OMG DDS Portal live!– www.omg.org

� RTI Webinars– DDS Introduction– Data-centric design– Enterprise integration

� QuickStart training– DDS basics– Hands-on RTI product

training– Tools use– Over 350 graduates!

Page 46: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

RTI Shapes Demo

� Goals– Teach DDS concepts in a

“fun” way– Explain PS concepts,

QoS, multiple connections, ease of configuration

� Download includes– Demo application– Guide with background

material and illustrative examples

� Where– www.rti.com– Live now!

Page 47: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

The Data-Centric Future

Code/architecture-centric � Where are clients & servers?� What objects & methods?� How do I access info?� How synchronized?

Data-centric� What information?� How fast/reliable/flexible?� When is it available?� How is it stored?

� Pervasive data will change the future� DDS is key to this data-centric future

– High performance

– Fine delivery control– Enterprise integration

� The real change is a profound thought shift:

� We’ve only just begun– Huge problems remain: integrating many technologies,

scalability, impedance matching, technology adoption

Page 48: The Data-Centric Future - Data Distribution Services · Data-Centric Programming Data-Centric Perspective – Focus on how the data is moving and transforming in your system – Sources

Be amazed

You can be overwhelmed by the challengeor amazed by the opportunity…