Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan
-
Upload
pivotalopensourcehub -
Category
Data & Analytics
-
view
2.056 -
download
2
Transcript of Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan
![Page 1: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/1.jpg)
Pivoting Spring XD to Spring Cloud Data Flow
Sabby Anandan | Product Manager | @sabbyanandan
![Page 2: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/2.jpg)
business premise
microservices
what it means for data
tools / frameworks
what we learned
how it all comes together
![Page 3: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/3.jpg)
Sense of Urgency
business results
business strategy
![Page 4: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/4.jpg)
Sense of UrgencyOR
Need for Momentum?
![Page 5: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/5.jpg)
business strategy
business results
![Page 6: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/6.jpg)
business strategy
business results
Continuous Delivery
![Page 7: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/7.jpg)
Continuous Delivery
![Page 8: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/8.jpg)
Deliver Continuously1 2
![Page 9: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/9.jpg)
frequent roll out updates, even multiple times a day
gives you more ways to maintain availabilityreduce risks
allows you to make sound technology choices
gives your team more velocity
![Page 10: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/10.jpg)
microservices architecture
business strategy
business results
devops culture
continuous delivery
Casey West Principal Technologist, Cloud Foundry
![Page 11: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/11.jpg)
“how do we get there?”
![Page 12: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/12.jpg)
Continuously Delivered Microservices
![Page 13: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/13.jpg)
Microservicesarchitecture composed of loosely coupled
elements that have bounded contexts
Adrian Cockcroft Battery Ventures
previously: Cloud Architect at Netflix
![Page 14: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/14.jpg)
“what tools can I use?”
![Page 15: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/15.jpg)
Spring
![Page 16: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/16.jpg)
Spring BootAutoConfigure
StartersCLI
Actuator
Dev-Tools
Health Checks
Security
Logging
![Page 17: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/17.jpg)
BUILDING ADAPTIVE APPLICATIONS IS HARD
built on Cloud Foundry
code will be open sourced.
Demo: Spring Boot
![Page 18: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/18.jpg)
Emerging Challenges• separate deployable units (registry, discovery,
versioning) • reliable operationalization (fault tolerance) • too many moving parts (coordination, routing,
load balancing)
![Page 19: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/19.jpg)
Spring
![Page 20: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/20.jpg)
Spring Cloud
![Page 21: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/21.jpg)
Spring Cloud
Hystrix Eureka Ribbon
Zuul Feign
Service Discovery Config Server Control Bus
Zookeeper Distributed TracingConfig Server
![Page 22: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/22.jpg)
Spring Cloud@EnableConfigServer
@EnableEurekaServer
@EnableDiscoveryClient@EnableCircuitBreaker
@EnableHystrix
@EnableAtlas
@EnableTurbine
@EnableZuulProxy
![Page 23: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/23.jpg)
OK, I get it....what’s specical about
microservices?
![Page 24: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/24.jpg)
Microservicesa single application as a suite of small services,
each running in its own process and communicating with lightweight mechanisms, often
an HTTP resource API
James Lewis and Martin Fowler ThoughtWorks
![Page 25: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/25.jpg)
Microservicesa single application as a suite of small services,
each running in its own process and communicating with lightweight
mechanisms, often an an HTTP resource API
![Page 26: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/26.jpg)
OK, I get it....what if I have a lot
of data?
![Page 27: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/27.jpg)
every software company cares about data
![Page 28: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/28.jpg)
Data-driven Microservicescomposition of small standalone executable applications communicating over messaging
middleware
Mark Fisher and Mark Pollack Spring/Pivotal
![Page 29: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/29.jpg)
Data-driven Microservicescomposition of small standalone executable
applications communicating over messaging middleware
operates by consuming from and producing to message queues and data stores
![Page 30: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/30.jpg)
“i need real-time insights from data”
![Page 31: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/31.jpg)
Spring
![Page 32: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/32.jpg)
Developer ToolkitsSpring Integration
enables lightweight messaging within Spring-
based applications and supports integration with
external systems Spring Cloud Stream enables you to create powerful distributed streaming data applications with a minimal amount of coding
![Page 33: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/33.jpg)
Spring Cloud Stream
@EnableBinding(Source.class)
@EnableRXJavaProcessor
@EnableBinding(Sink.class)
@EnableBinding(Processor.class)
![Page 34: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/34.jpg)
http | transform | log
![Page 35: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/35.jpg)
| = ?
http | transform | log
![Page 36: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/36.jpg)
| = Binder
![Page 37: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/37.jpg)
Binders
![Page 38: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/38.jpg)
BUILDING ADAPTIVE APPLICATIONS IS HARD
built on Cloud Foundry
code will be open sourced.
Demo: Spring Cloud Stream
![Page 39: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/39.jpg)
@EnableBinding(Source.class)
Discover OutputChannel
Discover Binder
Discover Type
Converter
Bind Producer
Auto Configure
$ java -jar http-source.jar
![Page 40: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/40.jpg)
$ java -jar transform-processor.jar
@EnableBinding(Processor.class)
Discover Input and Output Channels
Discover Binder
Discover Type
Converter
Bind Producer and
ConsumerAuto
Configure
![Page 41: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/41.jpg)
@EnableBinding(Sink.class)
Discover Input
Channel
Discover Binder
Discover Type
Converter
Bind Consumer
Auto Configure
$ java -jar log-sink.jar
![Page 42: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/42.jpg)
“i have large volumes of asynchronous data
systems”
![Page 43: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/43.jpg)
Spring
![Page 44: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/44.jpg)
Reactive Streams@EnableRXJavaProcessor
![Page 45: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/45.jpg)
10 11 12 13 14 15 16 17 18 19.. ..
10 11 12 13 14 15 16 17 18 19.. ..
i0
i112
17
![Page 46: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/46.jpg)
“i need offline data analysis”
![Page 47: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/47.jpg)
Spring
![Page 48: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/48.jpg)
Batch-processing MicroservicesSpring Batch
enables the development of robust batch applications
vital for the daily operations of enterprise systems
Spring Cloud Task enables you to develop and run short-lived executable data applications locally or in the cloud
![Page 49: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/49.jpg)
@EnableTaskDiscover
DataSourceBind
DataSourceAuto
Configure
$ java -jar timestamp-task.jar
![Page 50: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/50.jpg)
BUILDING ADAPTIVE APPLICATIONS IS HARD
built on Cloud Foundry
code will be open sourced.
Recap
![Page 51: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/51.jpg)
I need real-time insights from data
I need offline data analysis
Spring Cloud Stream
Spring Cloud Task
Stream
Batch
![Page 52: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/52.jpg)
Stream Batch
Data Architecture
![Page 53: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/53.jpg)
Spring
![Page 54: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/54.jpg)
Spring XD
![Page 55: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/55.jpg)
Kodiak: Turnkey Data Integration Platform Sep 2012
Apr 2013
Aug 2013
Jan 2014
Apr 2014
Nov 2014
Dec 2014
Jan 2015
Feb 2015
Batch Jobs (Gaps: Oozie; Flume; Sqoop)
PMML (closed-loop-analytics; IoT), YARN
Kafka and Sqoop Support
Spring XD on CloudFoundry (beta)
Spring XD Launch
Builds on Spring Boot
Spark and Python Support
Spark Streaming, RxJava, Reactor Support
Apr 2015 BDS [HAWQ, GPDB, GemFire, PHD 3.0/HDP]
Flo UI, HDP/Ambari, Lattice Integration Jun 2015
Nov 2015 Flo Composed Jobs/Workflows, Perf. Improvements
![Page 56: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/56.jpg)
Kodiak: Turnkey Data Integration Platform Sep 2012
Apr 2013
Aug 2013
Jan 2014
Apr 2014
Nov 2014
Dec 2014
Jan 2015
Feb 2015
Batch Jobs (Gaps: Oozie; Flume; Sqoop)
PMML (closed-loop-analytics; IoT), YARN
Kafka and Sqoop Support
Spring XD on CloudFoundry (beta)
Spring XD Launch
Builds on Spring Boot
Spark and Python Support
Spark Streaming, RxJava, Reactor Support
Apr 2015 BDS [HAWQ, GPDB, GemFire, PHD 3.0/HDP]
Flo UI, HDP/Ambari, Lattice Integration Jun 2015
Nov 2015 Flo Composed Jobs/Workflows, Perf. Improvements
![Page 57: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/57.jpg)
Not Quiet There• couldn’t scale without undeploying
running stream or batch pipelines • couldn’t do rolling upgrades • couldn’t do continuous deployments
![Page 58: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/58.jpg)
longer running services
short lived processes
Data Microservices Architecture
Stream Batch
![Page 59: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/59.jpg)
Spring XD
![Page 60: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/60.jpg)
Spring Cloud Data Flow
![Page 61: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/61.jpg)
Spring Cloud Data Flow isa cloud native programming and operating model
for composable data microservices on a structured platform
![Page 62: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/62.jpg)
Spring Cloud Data Flow isa cloud native programming and operating model for composable data microservices on a
structured platform
![Page 63: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/63.jpg)
Spring Cloud Data Flow isa cloud native programming and operating model for composable data microservices on a
structured platform@EnableBinding(Source)class Greeter { @InboundChannelAdapter(Source.OUTPUT) String greet() { "hello world" }}
canary deployments
continuous delivery
monitoring
@EnableBinding(Source.class)
@EnableBinding(Processor.class)
@EnableBinding(Sink.class)
![Page 64: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/64.jpg)
Spring Cloud Data Flow isa cloud native programming and operating model for composable data microservices on a
structured platform
http
transform
log
job foo < bar || baz & jaz > bye
Streams
Jobsfoo
bar jaz
baz
bye
![Page 65: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/65.jpg)
Spring Cloud Data Flow isa cloud native programming and operating model for composable data microservices on a
structured platformPrivate and Public PaaS
Polyglot
Multiple Platforms
Service Marketplace
Direct Access to Containers
Metrics, Logging, Monitoring
Dynamic Scaling and Resource Allocation
Integrated Security and Auditing
![Page 66: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/66.jpg)
Spring Cloud Data Flow isa cloud native programming and operating model for composable data microservices on a
structured platformPrivate and Public PaaS
Polyglot
Multiple Platforms
Service Marketplace
Direct Access to Containers
Metrics, Logging, Monitoring
Dynamic Scaling and Resource Allocation
Integrated Security and Auditing
![Page 67: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/67.jpg)
Spring Cloud Data Flow isa cloud native programming and operating model
for composable data microservices on a structured platform
……
Polyglot
Multiple Platforms
……
Direct Access to Containers
Metrics, Logging, Monitoring
Dynamic Scaling and Resource Allocation
Integrated Security and Auditing
YARN
![Page 68: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/68.jpg)
XD Modules
XD Admin
XD Containers
Zoo
Keep
erZo
o Ke
eperAdmin / Flo UI
Shell
CURL
Database
![Page 69: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/69.jpg)
AdminAdmin / Flo UI
Shell
CURL ??X
YARN
Stream/Task Boot Apps
![Page 70: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/70.jpg)
Orchestrate Composable Data Microservices
HOST
Cloud Foundry YARN Local
Spring Cloud Data Flow
µPCF
Spring Cloud Stream/Task AppsSpring Cloud Stream Binders [Rabbit, Kafka, Redis]
![Page 71: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/71.jpg)
BUILDING ADAPTIVE APPLICATIONS IS HARD
built on Cloud Foundry
code will be open sourced.
Demo: Spring Cloud Data Flow
![Page 72: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/72.jpg)
cf push• here is my source code • run it on the cloud for me • i do not care how
![Page 73: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/73.jpg)
yarn push• here is my source code • run it on the hadoop for me • i do not care how
![Page 74: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/74.jpg)
“simple things should be simple, complex things should be possible”
- alan kay
![Page 75: Pivoting Spring XD to Spring Cloud Data Flow with Sabby Anandan](https://reader030.fdocuments.net/reader030/viewer/2022020314/58f9a949760da3da068b6d15/html5/thumbnails/75.jpg)
ResourcesSpring Cloud Data Flow: http://cloud.spring.io/spring-cloud-dataflow/ Spring Cloud Data Flow Samples: https://github.com/spring-cloud/spring-cloud-dataflow-samples
Spring Cloud Stream: http://cloud.spring.io/spring-cloud-stream/ Spring Cloud Task: http://cloud.spring.io/spring-cloud-task/