Mesos con 2015 recap meetup-v2
12
© 2015 IBM Corporation Platform Computing 1 SEATTLE MESOSCON 2015 RECAP Guangya Liu ([email protected] ) Senior Software Engineer
-
Upload
guangya-liu -
Category
Software
-
view
441 -
download
5
Transcript of Mesos con 2015 recap meetup-v2
© 2015 IBM Corporation
Platform Computing
1
SEATTLE MESOSCON 2015 RECAP
Guangya Liu ([email protected])
Senior Software Engineer
© 2015 IBM Corporation
Platform Computing
2
Reference
© 2015 IBM Corporation
Platform Computing
3
Reference
Seattle Mesos Conf 2015Vancouver OpenStack Summit 2015
© 2015 IBM Corporation
Platform Computing
4
Brief Introduction
• Apache Mesos community
– 260 attendees in 2014 vs 700+ attendees
– Mesosphere and Twitter are still the two main contributors to core Mesos
• Real-world adoption happening
– Tire kicking last year vs. real production examples this year
• Vibrant ecosystem developing
– Lots of work going on above and around the core Apache Mesos project
– People building frameworks, management tools around core Apache Mesos
– Industry players like Vmware, Cisco, Verizon, Huawei, Apple Siri all active
© 2015 IBM Corporation
Platform Computing
5
Brief Introduction
• MesosSphere progress update
– Announced new product Infinity for IoT
– Announced Verizon was a paying Mesosphere DCOS customer
– Rumor of 1B Microsoft buyout of Mesosphere, Windows support
– Leveraging Apache Mesos as seeding strategy to reach paying customers
• Significant re-invention of HPC history
– Grid Computing
– More than Grid Computing
• Social Time
– Twitter, IBM, Huawei，mesosphere etc
• How to get involved
– Suggested start with Jira tickets tagged “newbie”
– Small bug fix, feature enhancement
© 2015 IBM Corporation
Platform Computing
6
© 2015 IBM Corporation
Platform Computing
7
Mesosphere
© 2015 IBM Corporation
Platform Computing
8
Mesos Support Windows
© 2015 IBM Corporation
Platform Computing
9
Customer Case
• Verizon
– Demonstrated Mesos running in 500 nodes in production data center starting 50K
tasks in 1 minute in keynote
– MesosSphere announced Verizon as paying customer
– Intends to standardize on Mesos as RM layer across multiple data centers supporting
on-line customer facing web and mobile apps
• Baloomberge
– Gave talk on deployment of an app to monitor internal emails/chats to detect internal
fraud
– Leverage Mesos to manage multiple Kafka, Hadoop
– Had to build tooling around Mesos for monitoring, access control
• Paypal
– Using Mesos for internal CI environment with Jenkins
– Not mission critical , small scale deployment
• Digital Ocean
– Deploying Mesos internally while Mesosphere offers DCOS on top
© 2015 IBM Corporation
Platform Computing
10
Project Fenzo from Netflix
• Developed by ex-SUN HPC
engineer familiar with Platform
LSF
• Attempts to solve cross-
framework scheduling concerns
(bin-packing, rack/DC
affinity/anti-affinity)
• Provided as library that can be
leveraged by other frameworks
© 2015 IBM Corporation
Platform Computing
11
Framework Landscape – What can we do?
Mesos
Marathon(
Mesosphe
re)
Chronos
(AirBnb)
Aurora
(Twitter)Singularity
(Hubspot)
Fenzo (Netfix)
Other
Frameworks
Opensource Frameworks
Any Allocator Plugin
Customized
Framework1
Long
running
services
Distributed
Cron
Jobs
Batch Jobs
& ServicesServices &
Tasks
Customized
Framework2
Customized
Frameworkn
Customized Frameworks
Customized
Framework
© 2015 IBM Corporation
Platform Computing
12
THANKS
