X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local ....
Transcript of X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local ....
![Page 1: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/1.jpg)
OPENSTACK BEIJING CONFERENCE
by: Steven Hallett
Head of Cloud Infrastructure
Engineering and Operations
August 10, 2012
![Page 2: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/2.jpg)
Agenda
X.commerce, an Introduction
Platform Vision
Current Status
The Opportunity Before Us
2
![Page 3: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/3.jpg)
eBay Inc. Enables Commerce
Enable merchants to succeed in new commerce environment
Enable consumers to buy anything, anywhere, any how
X.commerce Goal: Build a platform that offers world-class, flexible and scalable commerce capabilities for businesses of all sizes
3
![Page 4: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/4.jpg)
X.commerce: Largest Ecosystem of Commerce Capabilities
4
Platform X.Commerce Fabric and Open Commerce Language
Merchant Products
Other Storefronts
Merchant Products
Consumer Products
OVER 1.2M DEVELOPERS Community
8/16/2012
4
Commerce Capabilitie
s
![Page 5: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/5.jpg)
E-commerce Commerce
Social
Mobile Local
Digital
Global
Service & delivery
Accelerating pace of innovation
Tomorrow
Online 6% Web-influenced offline 37%
Online +
Offline Offline
Today
Blurring of online and offline commerce
5
![Page 6: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/6.jpg)
Merchants’ New Competitive Forces
Consumer engagement & loyalty
Multi-channel & devices
Innovation & data
Global reach and scale Assortment, Price, Service Optimization
New competition Amazon, e-tailers
6
![Page 7: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/7.jpg)
The Emerging Commerce Reality
Promotions & coupons
Mobile commerce
Payments
Store location
In-store research
Self-scanning & self-checkout
Social Commerce
Loyalty
Mobile shopping lists
7
![Page 8: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/8.jpg)
Mobile shopping lists
Mail order
Social Commerce
Loyalty
Self-scanning & self-checkout
Online commerce
Store location Promotions & Coupons
Mobile commerce
Offline commerce
Payments
In-store research
Each Consumer Touchpoint Must Interoperate
8
![Page 9: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/9.jpg)
+ Apps
Unprecedented Flexibility to Address Merchant Needs
X.commerce capabilities
Developers Partners
Marketplace
X.commerce Fabric
Technology integrated to eBay assets and an ecosystem of innovation
Inc. Assets
9
![Page 10: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/10.jpg)
X.commerce Fabric and the Open Commerce Language
10
Point-to-point integrations Reuse model
Merchants: easy adoption of new capabilities, low switching cost Developers: low barrier to entry, easy onboarding of customers
Fabric and Open Commerce Language
![Page 11: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/11.jpg)
Platform Guiding Principles
Composability
Evolvability
Developer usability
Operability
Extensibility
Data resiliency
Security
11
![Page 12: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/12.jpg)
The Cloud, a Journey in progress…
Prepare for anything to fail
Capacity modeling
Automate relentlessly
Force simplicity
– Uniform application architecture
– Storage, integration, scaling
Ephemeral environments
– CI/CD
Hybrid - on/off premise
12
![Page 13: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/13.jpg)
Why OpenStack?
OpenStack
– Openness aligns with our need for multi-vendor-ness
OpenStack
– We have lots of moving parts ... flexibility is key
Momentum … you’re gonna be around tomorrow, right?
13
![Page 14: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/14.jpg)
Vision: X.Cloud
14
Application
Data
Runtime
Middleware
O/S
Virtualization
Servers
Storage
Networking
Self Service
Automated
CI/CD
Secure
Customers (Capability Developers + Merchants)
Manage
We Manage
Self Healing
SLA Driven
Multi-Tenant
XFabric
XOCL
PaaS
Commerce Capabilities
Product Taxonomy …
![Page 15: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/15.jpg)
Guiding Principles: An Open Source Philosophy
15
Open Stack (IaaS)
Cloud Foundry (PaaS)
Open TSDB (Time Series Database)
BOSH (Cloud Mgmt. System)
Flume (Log Collection/Transport)
Chef (Config. Mgmt)
Collectd (Metrics Collector)
Do not reinvent the wheel & grow with the community …
Redis (In-Memory Store)
Rabbit MQ (Messaging System)
Mongo DB (Persistence Store)
Hadoop (Persistence Store)
![Page 16: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/16.jpg)
X.Cloud Stack – An Overview
16
Compute Storage Network
IaaS - Open Stack
CI/CD Self-Service Portal Analytics …
Cloud Platform Services
Cloud Infrastructure Management
System
Cloud Foundry
Rabbit MQ
Mongo DB
Redis
Apigee
Hadoop
Flume
…
Logs & Metrics Platform
Monitoring & Alerting System
![Page 17: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/17.jpg)
Development Cloud
17
Consistent Management Tools – Basic Monitoring, Logging, Cloud Mgmt System, etc
Essex, 2:1 Over Subscribed, Tenants/Quotas By Engineering Groups
Physically Isolated from Sandbox/Production Logical Zones – Dev Tools (Nexus, SVN, GIT, Jira, etc) , Continuous Integration, Cloud Engg. Test Bed L&P
GIT/SVN Build My Func My Integ 1 … My L&P
Nexus
Commit Propagate
Promote
Push Button Deployment to Prod
Pipeline Builder/Monitor
Cloud Platform Services
Developer
Stage
![Page 18: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/18.jpg)
Spirit of CI / CD
18
•Environment Type Aware, •Pipeline/Stage Aware, •SCM Aware, •Artifact Aware, •Application Stack Aware, •Application Dependency Aware, •Test Type Aware
•Stage Characterized By Test Type •Automated Test Execution •Automated Environment Setup •Automated Deployment •Automated Propagation •Automated Promotion •n: Named Environments ~ n:Pipeline Stages
Developer
1 2
3
•Provides isolation for logical environments based on users or micro-CF installations •Supports Java, node.js, Python, PHP, Ruby runtimes •Supports all atomic PaaS operations (i.e. deploy, start, stop, restart, scale, etc) •Manages environment variables •Manages Data Service (i.e. Mongo DB, Rabbit MQ, etc) Bindings •Access to logs, files, etc •Manages routing to Application Access Points
![Page 19: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/19.jpg)
Production Cloud
19
Logical Environments = Sandbox & Production Availability Zones = 3 per Logical Environment
Environment Type (COS) = Environment Name
Cloud Platform Services
Self-Service Deployment
Analytics Dashboard
Alerts Console, Monitoring Dashboard
Cloud Management
System
Logs & Metrics Platform
Monitoring & Alerting System
Cloud Foundry
Onboard New App Stack
Upgrade App
Scale App
Logs/Msg. Trace Metrics
Provision Shared Infra.
Scale Data Services Backup Data
Operational Health Alerts
Access Point Configurations Self-Healing
![Page 20: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/20.jpg)
Cloud Management System
20
Current State: Custom Orchestration, Chef based Configuration M
The Problem We Are Working Try to Solve …
Complex Deployment
Orchestration
•Cloud Foundry •Hadoop with HBASE •Apigee •Mongo DB, Rabbit MQ
Scale Up
From: To:
Upgrade
From: 2.0 To: 3.0
Replace Instances
X
Configuration Management
•Manage Instance Sizes/Types •Manage Packages •Versioning •Environment Variables •Security Settings
Future State: BOSH
![Page 21: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/21.jpg)
Logs, Metrics, Monitoring
21
VM
Config
Agent
Monitor
Agent
Config Mgmt
Cloud Manager
Monitoring
System
CEP
Hadoop
Open TSDB
Flume Agent
HBASE
Flume
Console
Pager Duty
External Monitoring
Alarms
Alarms
Metrics
Logs
Logs
Metrics
Enroll
Provision / Repair Config.
Logs/Metrics
Update
Master
Collector
Enroll
Alerts
Alarms
![Page 22: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/22.jpg)
The X.commerce Technology Stack
Built greenfield Designed for the cloud – Assume failure – Model capacity – Automate relentlessly – Force simplicity – Environments are
ephemeral – Expect hybridization
Completely virtualized operational environment Offers a high-level PaaS for commerce applications Tooled for continuous delivery – CI/CD DevOps
MongoDB for all data
22
![Page 23: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/23.jpg)
Current Status
18+ months of work with OpenStack
– X.commerce Production Cloud is running on Diablo
Essex upgrade is underway
Go-live for Essex production cluster is less than 3 weeks away
– X.commerce Development Cloud and Developer Sandbox is now running on Essex
… and growing – from X.commerce to eBay
– eBay has just gone live with Nicira
23
![Page 24: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/24.jpg)
THE OPPORTUNITY BEFORE US
![Page 25: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/25.jpg)
Focus for the future
25
![Page 26: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/26.jpg)
The Open Cloud: a Call to Action
Opportunities
– We see significant opportunities for the OpenStack Community
Big Data, Signal Detection
Automation
Self-healing
Open, Commoditized, Public-cloud Bursting
Challenges
– We see significant challenges for the OpenStack Community
Fragmentation through variability or splintering at the Kernel
Speed of Innovation
26
![Page 27: X.commerce OpenStack Beijing Conference Hallett-X... · 2019-12-24 · Social . Mobile . Local . Digital . Global Service & delivery . Accelerating pace of innovation . Tomorrow .](https://reader033.fdocuments.net/reader033/viewer/2022042313/5edf73caad6a402d666acc80/html5/thumbnails/27.jpg)
THANK YOU