Storage for the Next-Generation Datacenter

About Quobyte

• Founded 2013 by the original XtreemFS developers – Many XtreemFS developers on board

• Funded by Target Partners and HTGF

• Focus: Large-scale operations instead of research

• Shares architecture and concepts with XtreemFS

• Complete re-write since August 2013

Our Vision

• The warehouse-scale storage system for next-generation datacenter

• Scalable operations: 100k+ servers with small team

• Decouple storage from hardware

• Fully automated (self-*)

• Unified system – all use cases from legacy to cloud

• On regular commodity servers

Quobyte – Application layer

• Logical storage in volumes

• All Interfaces: – POSIX File System

– NFS

– S3

– VM images

– Hadoop (HDFS)

Quobyte – Hardware layer

• Linux servers

• IP network

• Individual drives – no RAID

– no journal device

– location independent

• Quobyte software

Quobyte – Software Defined

• reconfigure anytime, no downtime – Data placement

– block size

– replication factor

– Failure domains

– Devices

– Monitoring

– Alerting

– Maintenance tasks

– …

Quobyte – Inside Quobyte - Client

• Exports logical storage /mnt/quobyte

• Direct communication

• Integrated failover

• Async. & parallel IO

• Caching

Quobyte – Inside Quobyte - Services

• R – Registry service

• M - Metadata service

• D – Data service

Quobyte – Replication and HA

• Primay/Backup

• Primary per unit

• Best replica

• Quorum based

• Hot stand-by

• p2p leases

• No global state

• Live add/remove

Quobyte – True File Replication

• No log, 1 write = 1 write/drive

• Fast: 1-step-write

• Preserves: – IO patterns

– fsync

• = predictable

Quobyte – Device Tags & Failure Domains

• Reconfigure anytime

• Free-form tags

• Auto-tags: SSD, HDD

• Tray < server < rack < cluster < datacenter

• Used for placement

Quobyte – File Placement

• Per file

• Fully flexible – no limits

• Policy driven

• File system context

• Reconfigure anytime, enforce later

• Tiering

• Locality

• + Tags: virtual pools

Quobyte – Data Safety & Security

• End-to-end checksums on blocks (4k) and metadata

• Automatic data scrubs and repair

• X.509 authentication

• Trusted / untrusted clients

• LDAP for API

• SSL gateway

• Multi-tenancy with resource isolation (quotas)

Quobyte – Ready for

• OpenStack – Full integration, part of upcoming Kilo release

– Cinder/Nova for VM images

– Manila for shared storage

• HPC & Big Data – Ready for massive parallel I/O

– Preserves sequential writes = happy hard drives

• Hosters – Email (dovecot), shared hosting, VMs...

• Mesos

Quobyte - Summary

• Scalable file system (workloads and operations)

• Truly software-defined (and software only)

• 100% Fault-tolerance and data safety

• Automated all the way: No manual intervention

• Product: Ready to go, fully integrated

www.quobyte.com info@quobyte.com Quobyte Inc. Quobyte GmbH One Boston Place, 26th Floor Boyenstr. 41 Boston, MA 02108 10115 Berlin, Germany 617-982-2600 +49-30-814 591 800 © 2015 by Quobyte Inc. Quobyte and XtreemFS are registered trademarks of Quobyte Inc. All other products or brands

are the trademarks or registered trademarks of their respective holders. All information herein is believed to be accurate as of 01/11/2015. Specifications are subject to change without notice.