™—„®5ˆ†§ˆ†‹‚‹Mesos…¥é–€...

download ™—„®5ˆ†§ˆ†‹‚‹Mesos…¥é–€ - Mesos £¦½• ï¼

of 67

  • date post

    16-Apr-2017
  • Category

    Technology

  • view

    6.174
  • download

    3

Embed Size (px)

Transcript of ™—„®5ˆ†§ˆ†‹‚‹Mesos…¥é–€...

  • 5Mesos Docker Mesos

    20161118()

    Technology Evangelist

    @zembutsu

    M e s o s

  • 2

    Mesos

    Apache Mesos

    Mesos

  • 3

  • 4

    1

  • 5

  • 6

  • 7

  • 8

    Mesos

    Mesos

    Mesos

    Mesos()

  • 9

  • 10

    Mesos Master

    Mesos Slave

    meta-scheduler

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos

  • 11

    Mesos Master

    Mesos Slave

    (Executor) API

    Marathon

    Apache AuroraChronosetc

    meta-scheduler

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos API Mesos

  • 12

    Mesos Master

    Mesos Slave

    (Executor) API

    Marathon

    Apache AuroraChronosetc

    meta-scheduler

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    (

  • 13

    Mesos Master

    Mesos Slave

    (Executor) API

    Marathon

    Apache AuroraChronosetc

    meta-scheduler

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos

  • 14

    Mesos Master

    Mesos Slave

    (Executor) API

    Marathon

    Apache AuroraChronosetc

    meta-scheduler

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Zookeeper Quorum

  • 15

    Mesos Master

    Mesos Slave

    (Executor) API

    Marathon

    Apache AuroraChronosetc

    meta-scheduler

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Executor

    Zookeeper Quorum

  • 16

    Mesos Master

    Mesos Slave

    (Executor) API

    Marathon

    Apache AuroraChronosetc

    meta-scheduler

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Executor

    Zookeeper Quorum

    Docker

    Containerlizer

  • 17

    Mesos Master

    Mesos Slave

    (Executor) API

    Marathon

    Apache AuroraChronosetc

    meta-scheduler

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Executor

    Zookeeper Quorum

    Containerlizer

    Mesos

  • 18

    Software Projects Built on Mesoshttp://mesos.apache.org/documentation/latest/frameworks/

    DevOps

    http://vamp.io

    http://aurora.apache.org

    https://github.com/mesosphere/marathon

    Marathon

    Singularity

    http://getsingularity.com

    SSSPhttps://github.com/mesosphere/sssp

    http://chapel.cray.com/

    Dparkhttps://github.com/douban/dpark

    Exelixihttps://github.com/mesosphere/exelixi

    Hadoop on Mesoshttps://github.com/mesos/hadoop http://spark.apache.org/

    Stormhttps://github.com/mesos/storm

    Hamahttps://wiki.apache.org/hama/

    MPICH2 Hydrahttps://github.com/mesosphere/mesos-hydra

    Chronoshttps://github.com/mesos/chronos

    Jenkinshttps://github.com/jenkinsci/mesos-plugin

    JobServer

    GoDocker

    Clook

    DCOS Cassandra

    https://github.com/mesosphere/dcos-cassandra-service

    http://www.alluxio.org/

    Elasticsearch Mesos frameworkhttps://github.com/mesos/elasticsearch

    Hypertablehttps://code.google.com/p/hypertable/wiki/Mesos

    mr-redis

    https://github.com/mesos/mr-redis

    Mesos

  • 19

    Mesos

    /3

  • Apache Mesos

    Apache License 2.0

    20

    http://mesos.apache.org/

    Cluster Manager

    Distributed system kernel

    Open Source Software

  • Apache Incubation Project

    Apache Top Project

    Docker

    v1.0 (2016727)

    21

    GitHub https://github.com/apache/mesos/releases?after=

    release-0.9.0-incubating-RC4

  • Mesos

    (2010)*Hadoop MPI (Message Passing Interfece)

    Mesos CPU,,

    )

    22* Mesos: A Platform for fine-grained Resource Sharing in the data center

    http://mesos.berkeley.edu/mesos_tech_report.pdf

  • 23

  • 24

  • 25

  • 26https://blog.twitter.com/2013/mesos-graduates-from-apache-incubation

  • 27

    /3

  • Mesos

    (execution)

    28

    Scalable and resilient core

  • Mesos

    kernelLinux

    Mesos

    29

    What is Mesos? A distributed systems kernel

    Scheduling

    Mesos Slave Mesos Slave Mesos Slave Mesos Slave

    TASK

    TASK

    frameworks

    Mesos

  • Mesos

    kernelLinux

    Mesos

    30

    What is Mesos? A distributed systems kernel

    Scheduling

    Mesos Slave Mesos Slave Mesos Slave Mesos Slave

    CPU

    TASK

    TASK TASKTASKTASK

    TASK

    TASK

    frameworks

  • Mesos

    kernelLinux

    Mesos

    31

    What is Mesos? A distributed systems kernel

    Scheduling

    Mesos Slave Mesos Slave Mesos Slave Mesos Slave

    CPU

    TASK TASK TASK

    TASK

    TASK

    TASK TASKTASK

    TASK

    TASKframeworks

  • Mesos

    32

  • 33

    CPU

    A B C

    1

  • 34

    CPU

    A B C

    1

  • 35

    A B C

    OS

    OS

    OS

  • 36

    A B C

    OS

    OS

    OS

  • 37

    A B C

    OS

    OS

    OS

  • 38

    3

  • 39

  • 40

  • 41

    A B C

    OS OS OS

    Mesos

    Mesos

    Apache Mesos

  • 42

    A B C

    OS OS OS

    Mesos

    Apache Mesos

  • 43

    A B C

    OS OS OS

    Mesos

    Apache Mesos

  • 44

  • 45

  • 46

  • Docker

    Docker Mesos

    Apache Mesos

    47

  • 48

    Docker

    Build Run

    Ship

    Build, Ship, Run, Any App Anywhere

    Docker Engine for Linux / Commercial SupportDocker for Mac, Windows, Windows Server 2016

    Docker Trusted Registry

    Docker Hub

    Universal Control Plane

    Toolbox

    Kitematic

    Dev()

    Ops()

  • 49

  • 50

    DockerDocker

  • Docker

    1

    51

  • 52

    Apache Mesos

  • 53

    Apache Mesos

    TASK TASKTASK

    TASK TASK TASK TASK

  • 54

    Mesos

  • 55

    Mesos

  • ExecutorDocker

    MesosPluggable

    Docker Docker

    Marathon

    56

  • 57

    Marathon

    /3

  • 58

  • Marathon

    Mesos API

    (Apache License v2.0)

    https://mesosphere.github.io/marathon/

    Mesos (cgroup)Docker

    UI

    REST API

    59

  • 60Mesos

  • 61

  • Mesos+Marachon

    CentOS 7.2 rpm -Uvh http://repos.mesosphere.com/el/7/noarch/RPMS/mesosphere-el-repo-7-2.noarch.rpmyum -y install mesos mesosphere-zookeeper marathon chronosfirewall-cmd --add-port=2181/tcp permanentfirewall-cmd --add-port=4400/tcp permanentfirewall-cmd --add-port=5050/tcp permanentfirewall-cmd --add-port=8080/tcp permanentfirewall-cmd reloadsystemctl start zookeepersystemctl start mesos-mastersystemctl start mesos-slavesystemctl start marathon

    http://:5050/ Mesos UI

    http://:8080/ Marathon UI

    62

    http://repos.mesosphere.com/el/7/noarch/RPMS/mesosphere-el-repo-7-2.noarch.rpm

  • Mesos

    Docker

    Marathon

    63

  • 64

    Mesos Master

    Mesos Slave

    (Executor) API

    Marathon

    Apache AuroraChronosetc

    meta-scheduler

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Mesos Slave Mesos Slave

    Mesos Slave Mesos Slave Mesos Slave

    Mesos Slave

    Executor Containerlizer

    Pluggable

    Zookeeper Quorum

  • 65

    Software Projects Built on Mesoshttp://mesos.apache.org/documentation/latest/frameworks/

    DevOps

    http://vamp.io

    http://aurora.apache.org

    https://github.com/mesosphere/marathon

    Marathon