Presentation on Cloud Mashups
-
Upload
michael-heydt -
Category
Software
-
view
79 -
download
0
Transcript of Presentation on Cloud Mashups
![Page 1: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/1.jpg)
![Page 2: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/2.jpg)
Cloud Mashups
Michael Heydt – Senior Technology Manager, SCS [email protected], [email protected], @mikeheydt
Building cloud-cloud and cloud-premises mashups
Defining a new application paradigm
Via lessons learned with cloud systems
![Page 3: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/3.jpg)
AgendaHistory
Future
Idea
Demo
How-To
Closing
![Page 4: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/4.jpg)
HISTORY
Mashups up to now
![Page 5: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/5.jpg)
Legacy Mashups
ConsumerPlatformEnterprise
![Page 6: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/6.jpg)
Consumer Mashups
Mashup software is public via a web site,All services are “external”, Likely not to use custom services,And consumed through service portal or Iframe / portlets
Yahoo Pipes
![Page 7: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/7.jpg)
Platform Mashups
Provide a single provider face to multiple cloud services
Facebook + EC2 storage / Salesforce
![Page 8: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/8.jpg)
Enterprise Mashups
Mashing of services within an enterprise,Likely with some web data and custom services,A single identity system,Exposure of data through corporate portals
JackBe Presto
![Page 9: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/9.jpg)
Guess What?
These are so 2009They are not “cloud mashups”, and…
I’m not talking about any of these!
![Page 10: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/10.jpg)
FUTURE
C2C and C2P Mashups,A Brave New World
![Page 11: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/11.jpg)
New Architectures
Cloud-2-CloudCloud-2-Premises
Mash across cloud providers and your private systemsEnabled with new technologies
![Page 12: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/12.jpg)
A New Paradigm
Quickly building applications byIntegrating services from multiple cloudsAnd data from on-premises systemsInto a new serviceHosted in the cloud and Used in your applicationAnd scalable beyond anything before
Requires new skills and technologiesThis is what I’ll be talking about!
![Page 13: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/13.jpg)
ETROCLOUD-2-CLOUD MASHUPS ARE SERVICES AND DATA ORCHESTRATED ACROSS MULTIPLE CLOUDSServices and data orchestrated between multiple cloudsOrchestration services in the cloudMultiple identitiesData and transforms in the cloud
The reality: There will be multiple cloud platforms
![Page 14: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/14.jpg)
ETROCLOUD-2-PREMISES MASHUPS EXTEND CLOUD MASHUPS INTO YOUR PRIVATE SERVICES AND DATA
Communications from the cloud to on-premises systemsBe they private cloud systems or non-cloud systems
Your stuff is safe at home but still can be used by the cloud
![Page 15: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/15.jpg)
ETROTOGETHERTHEY REPRESENT THE NEXT EVOLUTION OF SOA, PLATFORM AND APPLICATIONS
Business and consumer collaboration exemplified
![Page 16: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/16.jpg)
IDEA
What can I do with this?
![Page 17: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/17.jpg)
CONSUMER / PROVIDER ENERGY COLLABORATION SYSTEMSCollect price data from grid operators,Expose uniform data feed via cloud standards (oData, …),Providers visualize prices with graphs and charts in real-time,Collect meter data from smart grids and dynamically analyze,Process contracts from on-premises systems,Consumers can view usage, pricing and billing info, and Homes integrate with the smart grid
An ecosystem mashed from multiple subsystems in different clouds and private systems
![Page 18: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/18.jpg)
Concepts
Small independent services wired together on a busMultiple cloud providersConsume public data into cloud dataScheduled execution of tasks in the cloudOn-premises data access from the cloudFederated access controlLarge scale event processingScalable cloud servicesIntegration of cloud and on-premises dataData as a Service
This is the stuff you have to know
![Page 19: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/19.jpg)
Subsystems
Price collectionPrice visualizationMeter event processingConsumer PortalHome and smart grid integrationContracts processing
These are the primary parts of the system
![Page 20: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/20.jpg)
Price Collection
Scrape data from energy regulatorsStore in cloud storageProvide access via oData, REST, SOAP
Get the data from elsewhere and make it DaaS
![Page 21: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/21.jpg)
Price Visualization
Access price data from rich clients of various formsStandard data formats allow any clients to consumeStandard “mashlets” allow the same view across platforms
Consume DaaS with mashups and RIA components
![Page 22: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/22.jpg)
Meter Data Event Processing
Thousands if not millions of meters sending data,Every 15 minutes,Across the smart grid,Massive flows of real-time events,How to know what’s going on?How to handle the volume?How to store it?
Flex the ISB and CEP
![Page 23: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/23.jpg)
Consumer Portal
Scalable web application in the cloud,Supporting an ever growing user base,Mashing on-premises customer data and cloud pricing dataAccess control from on-premises custom STS
Scalable cloud web app with data tunnels and federated ID
![Page 24: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/24.jpg)
Home / Smart Grid CollaborationConsumers use portal to establish rules for their homeHome collaborates with the grid via cloud agentsGrid delivers commands based upon events
Having the grid charge your car when prices are lowestControl your home remotely
![Page 25: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/25.jpg)
Contracts Processing
Daily and monthly analytics for tradingUsually requiring big iron on siteMany hours or days to completeData needs to stay out of the cloud
Save money on the big iron and feel safe about the data
![Page 26: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/26.jpg)
DEMO
Show some stuff already will you!
![Page 27: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/27.jpg)
Architecture
![Page 28: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/28.jpg)
HOW-TO
The Building Blocks
![Page 29: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/29.jpg)
Toolbox
AppFabric Service BusMicrosoft AzureAmazon EC2Access Control ServicePort Bridge / On-premises AFSB services
![Page 30: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/30.jpg)
Microsoft Azure
.NET Platform as a Service (PaaS)Scalable Web and Worker RolesRuns .NET applications in the cloudBut also provides capabilities for PHP, Java, and more
Provides Internet Service Bus and Access Control ServiceThese are unique to Azure and Critical for C2C/P
![Page 31: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/31.jpg)
Amazon EC2
Infrastructure as a Service (IaaS)Essentially virtual machine hosting in the cloudMany pre-built virtual machines to pick from (AMIs), orRoll your ownScalable, Durable, Totally Customizable
You are likely using it but don’t even know it
![Page 32: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/32.jpg)
AppFabric Service Bus
Internet scale messaging busEnables inter/intra cloud, cloud-premisesNamed endpoints for services to rendezvousNegotiates end-to-end network traversalsOptimizes network traversalTightly integrated with the Access Control ServiceSynchronous, fire and forget, and pub/sub multicastAccess via WCF or REST
This is the backbone of C2C/P systems
![Page 33: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/33.jpg)
AFSB: NetEventRelay
![Page 34: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/34.jpg)
AFSB: NetTcpRelay
![Page 35: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/35.jpg)
Access Control Service
Abstracts orchestration of auth[*]Claims based modelControls access to the ISBPerforms claims mapping between providersYour apps and services can integrateCan integrate with your auth servicesYou can integrated custom auth services via WIF
Ensures all services on the ISB are only used by who you allow
![Page 36: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/36.jpg)
Access Control Service
![Page 37: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/37.jpg)
Premises #1 AFSB Service
A WCF service that connects to the AFSBAPI exposed to cloud applicationsRequests securely routed to on-premises serviceService can interoperate with on-premises system directly
Makes premises systems accessible to your cloud app
![Page 38: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/38.jpg)
Premises #2 Port BridgeTunneling of level 3 traffic To/from cloud to non-cloud / non-service systemsPort Agent in cloud, Port Bridge on premisesAgent and Bridge use AFSB for connectivity and tunnelingBecause it uses ISB, it also uses ACSCloud enables apps that don’t talk cloud
Makes premises systems accessible to your cloud app
![Page 39: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/39.jpg)
Deep-dive
If we have time
![Page 40: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/40.jpg)
Closing
Wrap up and where is this going?
![Page 41: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/41.jpg)
Some Comments
Plumbing is in place for c2c/p mashupsBuild small servicesGlue them together with AFSBLet ACS handle the securityFocus on dynamic code allocationExpose data through oData services
Better tools are still needed
![Page 42: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/42.jpg)
Future Tools
Declarative and graphical designers for applications Dynamic code storage and allocation to cloud servicesAutomatic deployment of services and wiringEvolutionary upgrade of servicesSemantics data repositoriesAdaptive systems that auto-wire based on usage patternsIntentional systems that auto build based upon needs
This is going to be great!
![Page 43: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/43.jpg)
REFERENCES
WWW.MICROSOFT.COM/WINDOWSAZUREAWS.AMAZON.COMODATA.ORG42SPIKES.COM (my blog)
![Page 44: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/44.jpg)
PRINCIPLES
Architecture for C2C/P mashups
![Page 45: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/45.jpg)
The Principles
ReuseFunctional ServicesData As A ServiceIdentitySecurityInterconnection
DiscoverabilityWiringMashupMashletTransformationSemantics
![Page 46: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/46.jpg)
Reuse
Fundamentally all mashups are reused Either in user interfaces,Other services, orIn other mashups
Nothing lives alone
![Page 47: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/47.jpg)
Functional Services
Provide an operation,An interaction with another application,A retrieval of data from another system, or A change of state
SOA Classic
![Page 48: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/48.jpg)
Data as a Service (DaaS)
Mashups need dataUI’s need dataServices can expose data
Data itself is a service
No need to code!
![Page 49: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/49.jpg)
Identity
Multiple entities each requiring different credentialsNeed Identify FederationProviding Identity Management and mappingUsed to implement security
You or your system will have many
![Page 50: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/50.jpg)
Security
Use of IdentityTo authenticate a user or serviceAgainst another serviceTo control access to services, andWhat can be done with the service
Information wants to be free, but you may not want it to
![Page 51: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/51.jpg)
Interconnection
Services need to talk to each otherProtocols need to be bridgedTunnels need to be createdBuilding the nervous system of the mashup
This is the Internet Service Bus
![Page 52: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/52.jpg)
Wiring
The definition of the flow of the data through the mashupFrom one service to anotherUtilizing an interconnection
These are the rules of how the data flows, not how it is moved
![Page 53: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/53.jpg)
Transformation
Services often disagree on the structure of dataThis is a service that changes the format of dataUsing specific rules
The physical transformation of data according to semantics
![Page 54: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/54.jpg)
Semantics
A description of the meaning of dataNot the content of dataOften used to understand data in a Mashlet, orChange data for another service
The rules of the vocabularies of data between the services
![Page 55: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/55.jpg)
PATTERNS
Things you will do all the time
![Page 56: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/56.jpg)
The Patterns
Classic MashupInternet Service BusDynamic ServiceDeploy ServiceIdentity FederationPremises Tunnel
WiringMashupMashletData as a ServiceHubPlug Into Hub
![Page 57: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/57.jpg)
Classic Mashup
Ingest data from multiple feedsMerge dataTransform dataFilter dataExpose results
Assumes all web services
![Page 58: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/58.jpg)
Internet Service Bus
Backbone for cloud-cloud and cloud-premises composition,Providing discovery through standard naming techniques, andInteroperation through dynamic routing / binding of services,Provides protocol bridging across heterogeneous clouds, andAbility for two services to attach without knowing their actual locations or protocols
The nervous system
![Page 59: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/59.jpg)
Dynamic Service
A service that is provisionedOn a schedule, orOn demand, andIs discoverable and connected automatically to mashups,To provide scalability and availability, whichMay be autonomous, orAccessed through it’s own web service, orVia an endpoint on the ISB
Your mercenaries
![Page 60: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/60.jpg)
Deploy Service
Dynamic spin up of a service in a cloud provider,Connecting the service to and endpoint on the ISB, and Configuration of the ACS and IF
Run it only when you need it
![Page 61: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/61.jpg)
Identity Federation
A service that provides unified mapping of credentials from multiple services and clouds,To provide seamless access controls across all services
Presenting yourself in the light of another
![Page 62: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/62.jpg)
Premises Tunnel
Establishes protocol level tunnel for native protocols,From a cloud service, To an on-premises service,Via the Internet Service Bus,Forming a secure means on integration cloud and premisesCommonly using the port bridge
Safely expose private data, systems and services to the cloud
![Page 63: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/63.jpg)
Mashup
An ordered sequence of wiresThat pass data into servicesUsing the interconnectsRetrieving results from the servicesTransforms data according to semanticsFlows the results into other servicesAnd exposing the result as a new service
Secretly (or no so) a business process
![Page 64: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/64.jpg)
Mashlet
Reads the results of a mashup via its addressApplying a visualizationMay be exposed itself as a web construct, orA platform specific user controlAnd knows how to display one or more types of data
Somewhere, sometimes, you need to see the results
![Page 65: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/65.jpg)
Data As A Service
Data being directly exposed as a serviceWithout the ceremony (code) of normal services
Information wants to be free (within your permission)
![Page 66: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/66.jpg)
Hub
Service integration through Internet Service Bus, withAutomatic data transformation, Automatic wiring and interconnection,Dynamic deployment of services,Abstraction of cloud and premises systems,Automated orchestration of services,Identify federation, andAccess control
No one or thing lives alone anymore
![Page 67: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/67.jpg)
Plug Into Hub
Configuration of a deployed service, To communicated with a Hub,Attaching the service to the hub’s orchestration, Providing data transforms and Access control and identify mapping to the hub
I want to play with others like me
![Page 68: Presentation on Cloud Mashups](https://reader035.fdocuments.net/reader035/viewer/2022070512/588acf231a28ab89058b59d5/html5/thumbnails/68.jpg)
Transform!
Change data from one form to another Using a specific transform, orSemantic information
The Optimus Prime