Open source based container solutions in Azure

Jose Miguel Parrella 17 May 2016 DockerCon Meetup Shanghai

About me15 years in the open source community Policy making, advocacy, community building, program management, CTO, entrepreneurship

Debian Developer since 2007 Brought nginx to Debian and Ubuntu

Lead architect of Canaima Linux Venezuela’s national operating system, 4.6M users

Microsoft since 2010 Open Source Strategy, now focused on Open Source in the Cloud

I APT-based distros, embedded Linux & clusters, Perl, Node.js & Docker github.com/bureado

AgendaMicrosoft’s approach to open source in the cloud Microsoft’s approach to containers in the cloud What we’re seeing with Docker in the cloud Q+A

Source: Softpedia Credits: James Niccolai

What is Microsoft’s approach to…?

What is Microsoft’s approach to…?

Office productivity Microsoft Office Office 365, open standards and an open developer ecosystem

Server computing Microsoft Windows Server

A cloud-first approach with Microsoft Azure for Linux, Windows and more

Developer productivity

Microsoft Visual Studio We’ll meet you where you are and give you great tools like Visual Studio Code

Big data solutions Microsoft SQL Server Hadoop, R and many others

Not just about… But also about…

What is Microsoft’s approach to containers?

Docker.

Microsoft cloud

Azure On premises Service Provider

Container management

Docker

Development environments

…

Container technologies

Linux

Docker is where you need it…

Others

…

Virtual Machines…and Docker is everywhere

Microsoft cloud

Azure On premises Service Provider

Container technologies

Linux

Service fabric

Linux

Development frameworks and languages

.Net

PHP

C++JavaRuby Win32

Go PerlPython

JavaScript

Node

20142015

2016May 16

Jun 14 – Docker VM Extension Jul 14 – commitment to support libswarm and Kubernetes Nov 14 – Bring your Own Trusted Registry

Dec 14 – Docker Orchestration APIs to target Win Server

Jan 15 – Docker in Marketplace (Ubuntu-based)

Feb 15 – Support for Machine, Swarm and Compose April 15 – Docker CLI on Windows

Jun 15 – Windows Server Containers to support Docker Jun 15 – Azure CLI as a container

Jul 15 – new Docker VM Extension

Jul 15 – Docker Hub Integration Sep 15 – Container Service ARM provider and prototype

Oct 15 – Swarm clusters via ARM

Mar 16 – Machine updates Mar 16 - Azure Files volume support

April 2016 – Azure Container Service is generally available April 2016 – Microsoft joins the DC/OS project

Developer & Data Agility with Containers in the Cloud

Microsoft Azure

Microsoft Cloud Container PortfolioDevelopers

Cross-cloud orchestration Tools integration

Operations

OMS

Data scientists

Workload portability

Open source container-based PaaS platforms in Azure

Container-ready application platforms that benefit from Azure’s native

partitioning, capacity management and high availability

Azure Container Service

Optimized container hosting in the cloud with familiar tooling and your choice of

orchestrator

Windows Server (preview) Azure Stack (roadmap) Your own platform

Docker VM Extension for

AzureEasy and

programmatic way to add Docker capabilities

to your VMs

Azure Marketplace container partners

Partner solutions that address management challenges of

containers

What we’re seeing

• Density, isolation, portability, multitenancy are usually consequences, not motivators, of a container strategy

• Objectively, a benefit is that containers are not VMs – they’re faster and cheaper to create and move around

• Containers can be more than an implementation decision: some organizations look at containers for strategic reasons

“[Azure’s] speed of delivery is exceptional. If we need more local bandwidth in Los Angeles, for instance, we have it within seconds. And the deep integration with Docker means we can also have new virtual machines online within seconds“ Matej Zalar, CEO, Visionect

Comparing Roadmap Findings of Recent Container Surveys

Source: The New Stack

Sponsor Details

% Using in Production

Robin Systems

December 2015. 200 IT pros were asked, “What is your container adoption status?”

36%

451 Research

451 VotE Cloud, Q3 2015; n=960 cloud users 14%

Ruxit and O’Reilly Media

May 2015. 130 IT pros were asked, “At this time, in which of the following environments do you use containers?”

26%

StackEngine

January 2015. 765 respondents were asked, “What is your familiarity with Docker and container

N/A

What we’re seeing

France

India

Central & Eastern Europe

Greater China

Germany

• Thousands of customers running millions of cloud hours with partners like Canonical, Docker, Mesosphere, CoreOS and Rancher

• Large portion of usage comes from commercial Enterprise & large Education institutions

• Public cloud usage for container projects in China is above WW average and in the Top 5!

Top 5 AVG Hour/Customer Usage

What we’re seeing

• Software alone is not enough to drive digital transformation. Organizations need developer agility and data agility.

• When it comes to agility, containers are a better tool than VMs

• Organizations also benefit from a hyperscale approach

• Microservices and a solution like DC/OS & the cloud can help

Contribute

Enable

Integrate

Release

What is Microsoft’s approach to open source in the cloud?

Happy customers Agile IT Strong

ecosystem

How Why

Q+A

Welcome & thank you!azure.com/opensource

ContainersHow do they differ from virtual machines?

Dependencies: Each virtualized app includes the app itself, required binaries and libraries and a guest OS, which may consist of multiple GB of data. Independent OS: Each VM can have a different OS from other VMs, along with a different OS to the host itself. Flexible: VMs can be migrated to other hosts to balance resource usage and for host maintenance, without downtime. Secure: High levels of resource and security isolation for key virtualized workloads.

Spotlight capabilities

Hypervisor

Guest OS Guest OS

Virtual Machine

App ABins/Libraries

App BBins/Libraries

Server

Hypervisor

Server

Containers and virtual machinesDeployment options suited to many scenarios

Containers in VMs: By combining containers with VMs, users can deploy multiple, different VM operating systems, and inside, deploy multiple containers within those guest OSs. By combining containers with VMs, fewer VMs would be required to support a larger number of apps. Fewer VMs would result in a reduction in storage consumption. Each VM would support multiple isolated apps, increasing overall density. Flexible: Running containers inside VMs enables features such as live migration for optimal resource utilization and host maintenance.

Spotlight capabilities

Virtual Machine

Guest OS

App ABins/Libraries

App BBins/Libraries

Guest OSw/ Container Support

Container

App ABins/Libraries

Docker integrationJoint strategic investments to drive containers forward

Docker Hub: Huge collection of open and curated applications available for download.

Collaboration: Bring Windows Server containers to the Docker ecosystem to expand the reach of both developer communities.

Docker Engine: Docker Engine for Windows Server containers will be developed under the aegis of the Docker open source project.

Docker client: Windows customers will be able to use the same standard Docker client and interface on multiple development environments.

Spotlight capabilitiesDocker Client

Windows Server Linux

Docker Engine (Daemon)

Windows Server Container Support

Linux Container Support (LXC)

Docker Engine (Daemon)

Docker.exe Examples: docker run docker images

Docker Remote API Examples: GET images/json POST containers/create

Investments in the next waveof Windows Server

Open source development of theDocker Engine for Windows Server

Azure support for theDocker Open Orchestration APIs

Federation of Docker Hub images into the Azure Gallery and Portal

Strategic investments

Server CoreNano Server

Container operating system environments

Traditional applications

Highly compatible

Highly optimized

Born-in-the-cloud applications

Windows Server ContainersAnatomy and key capabilities

Build: Developers will use familiar development tools, such as Visual Studio, to write apps to run within containers. By building modular apps leveraging containers, modules can scale independently, and be updated on independent cadences. Run: Container capabilities built into Windows Server Manage: Deploy and manage containers using PowerShell, or using Docker. Resources: Define CPU and memory resources per container along with storage and network throughput. Network: Provide NAT or DHCP/static IP for network connectivity.

Spotlight capabilities

LOB app (+Binaries)

Host OSw/Container Support

Server (Physical or Virtual)

Web tier

Container A

Libraries (Shared across containers)

Container B Container C

LOB app (+Binaries)

App tier

Libraries

LOB app (+Binaries)

DB tier

Windows Server ContainersCreation, deployment, and management

Developers build and test apps in containers,

using development environment

i.e. Visual Studio

Containers pushed to central repository

Operations automates deployment and

monitors deployed apps from central repository

Physical/Virtual Servers

1 2

2

3

Operations collaborates with developers to provide app metrics and insights

Developers update, iterate, and deploy updated containers

Hyper-V ContainersAnatomy and key capabilities

Consistency: Hyper-V Containers use the same APIs Windows Server Containers ensuring consistency across management and deployment toolsets. Compatibility: Hyper-V Containers use the exact same images as Windows Server Containers. Strong Isolation: Each Hyper-V container has it’s own dedicated copy of the kernel Highly Trusted: Built with proven Hyper-V virtualization technology. Optimized: The virtualization layer and the operating system have been specifically optimized for containers

Spotlight capabilities

Hypervisor

Server

Hyper-V Container

App ABins/Libraries

Windows Guest OSOptimized for Hyper-V

Container

Hyper-V Container

App BBins/Libraries

Windows Guest OSOptimized for Hyper-V

Container

Event organised by

“Technology with Impact”

http://wiredcraft.com/