PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. ©...

37
PRESENTATION TITLE GOES HERE Building open source products with Ceph Neil Levine Inktank

Transcript of PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. ©...

Page 1: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

PRESENTATION TITLE GOES HERE

Building open source products with Ceph

Neil Levine Inktank

Page 2: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

2 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

CEPH

Page 3: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

3 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

CEPH UNIFIED STORAGE

FILE SYSTEM

BLOCK STORAGE

OBJECT STORAGE

Keystone

Geo-Replication

Native API

Multi-tenant

S3 & Swift

OpenStack

Linux Kernel

iSCSI

Clones

Snapshots

CIFS/NFS

HDFS

Distributed Metadata

Linux Kernel

POSIX

Page 4: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

4 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

ARCHITECTURE

APP HOST/VM CLIENT

Page 5: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

5 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

COMPONENTS

Page 6: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

6 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

OPENSTACK

Page 7: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

7 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

CLOUD STORAGE

S3/Swift S3/Swift S3/Swift S3/Swift

Page 8: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

8 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

WEBSCALE APPLICATIONS

Native Protocol

Native Protocol

Native Protocol

Native Protocol

Page 9: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

9 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

DEVELOPMENT

Page 10: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

10 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

DEVELOPMENT SCHEDULE

Planning

Page 11: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

11 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

0.67 0.68 0.69 0.70 0.71 0.72

DEVELOPMENT SCHEDULE

2 weeks 2 weeks 2 weeks 2 weeks 2 weeks 2 weeks

Planning

Development

Page 12: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

12 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

0.67 0.68 0.69 0.70 0.71 Firefly

DEVELOPMENT SCHEDULE

2 weeks 2 weeks 2 weeks 2 weeks 2 weeks 2 weeks

Planning

Development

Page 13: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

13 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Teuthology: Ceph Test Suite

VM Management

Job Scheduling Unit Testing Functional

Testing Reporting

Page 14: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

14 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Where it happens

github.com/ceph

tracker.ceph.com

ceph-devel, #ceph

Page 15: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

15 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

THE PRODUCT

Page 16: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

16 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Specialized Device Opinionated Software Professional Services

THE MODELS

HW or SW Curation Development

Optimization

Support

SERVICES ONLY VALUE ADD DISTRO APPLIANCE

User Experience

Tools

Pre-built

Proprietary

Page 17: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

INKTANK CEPH ENTERPRISE 1.1

Ceph Object and Ceph Block Calamari Management Platform

Enterprise Plugins (2014) Support Services

Page 18: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

18 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

1.2

1.3

Ceph Ceph-Deploy

2.1

2.2

2.3

3rd Party

0.67

0.68

0.69

Upstream Projects

3.12

3.13

3.14

3rd Party

Curated Packages

Page 19: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

19 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Curated Packages

Ceph Ceph-Deploy

0.67

Upstream Projects

Product

3rd Party

1.3 2.3

3.12

3rd Party

Page 20: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

20 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

LONG TERM SUPPORT

2014 2015

Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2

Page 21: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

21 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

EXPERIENCE AND TOOLS

Page 22: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

22 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

LESSONS

Page 23: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

23 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #1: The Cruft

FILE SYSTEM

BLOCK STORAGE

OBJECT STORAGE

Keystone

Geo-Replication

Native API

Multi-tenant

S3 & Swift

OpenStack

Linux Kernel

iSCSI

Clones

Snapshots

CIFS/NFS

HDFS

Distributed Metadata

Linux Kernel

POSIX

Page 24: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

24 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #1: The Cruft

Keystone

Geo-Replication

Native API

Multi-tenant

S3 & Swift

OpenStack

Linux Kernel

iSCSI

Clones

Snapshots

CIFS/NFS

HDFS

Distributed Metadata

Linux Kernel

POSIX

Bucket Quotas

User Quotas

Pool Quotas

Multi-Part

ACLs

Waldo

RBD FUSE

Striping

BTRFS Support

JAVA bindings

FS FUSE

Messaging

FreeBSD port

ZFS Support

Snapshots

Page 25: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

25 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #2: The Clients

KVM librbd

Linux krbd

OpenStack cinder

Ceph Storage Cluster (RADOS)

Ceph Native Protocol

Page 26: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

26 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #2: The Clients

Ceph Storage Cluster (RADOS)

Ceph Native Protocol

Page 27: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

27 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #2: The Clients

Ceph Storage Cluster (RADOS)

Ceph Native Protocol

Page 28: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

28 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #3: The Community

“What’s on your roadmap?”

CUSTOMER

“Err.. Stuff”

ME

Page 29: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

29 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

The Same, but Different

QA

Reference Architectures

Performance

Page 30: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

30 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

THE OPPORUNTIES

Page 31: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

31 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

What if ONTAP had been open source?

Page 32: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

32 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Hardware Differentiation

Page 33: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

33 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Hardware Differentiation

Page 34: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

34 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Security Differentiation

Page 35: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

35 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Storage Aware Applications

Page 36: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

36 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

ROADMAP

Page 37: PRESENTATION TITLE GOES HERE Neil Levine Inktank...17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved. INKTANK CEPH ENTERPRISE 1.1 Ceph Object

PRESENTATION TITLE GOES HERE

Thanks!

@neilwlevine @inktank

@ceph