Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Hat Gluster Storage
Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service...
Transcript of Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service...
![Page 1: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/1.jpg)
Contains proprietary and confidential information
owned by Synacor, Inc. © / 2015 Synacor, Inc.
Zimbra et
RedHat Ceph Storage
1
Comment “Scaler” le
stockage avec Zimbra
Images Ceph : CC-BY :[email protected]
Images RedHat : [email protected]
![Page 2: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/2.jpg)
BeeZim
• Since2012
• Email and collaboration
• Integration, development, maintenance, training
• 100 customers, 4M+ mailboxes
4
![Page 3: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/3.jpg)
What we wanted to fix with ceph ?
• Storage Cost and regular increase
• Backups time and restoration
• Large VM backups (Zimbra Stores)
• Improve user experience
9
![Page 4: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/4.jpg)
Introduction à
RedHat Ceph Storage
11 4/02/2016
![Page 5: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/5.jpg)
Gluster
management
Ceph
data service
Gluster
data service
Ceph
management
OP
EN
SO
UR
CE
SO
FT
WA
RE
ST
AN
DA
RD
HA
RD
WA
RE
Share-nothing, scale-out architecture
provides durability and adapts to
changing demands
Self-managing and self-healing
features reduce operational overhead
Standards-based interfaces and full
APIs ease integration with applications
and systems
Supported by the experts at Red Hat
Standard x86
servers
THE RED HAT STORAGE PORTFOLIO
![Page 6: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/6.jpg)
FOCUSED SET OF USE CASES
ANALYTICS CLOUD / VIRTUAL CONTAINERS
RICH MEDIA
SYNC AND SHARE
AND
COLLABORATION
BACKUP / ARCHIVE
STORAGE FLASH /
SGBD
NAS WORKLOADS
Vmware / Microsoft
![Page 7: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/7.jpg)
18
RADOS
Noeuds de stockages fiables, autonomes, distribués avec réparation automatique.
Accès API
LIBRADOS
Librairie permettant
l’accès direct
à RADOS.
Support pour C, C++
Java, Python,
Ruby et PHP
Accès Block
RBD
Périphé”rique block
complètement
distribué, intégré au
kernel Linux, driver
QEMU/KVM
Système de
fichier
CEPH FS
Système de fichier
compatible POSIX,
intégré au kernel Linux
Accès Objet
RADOSGW
Interface REST
compatible avec S3 et
Swift
APP APP HOST/VM CLIENT
![Page 8: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/8.jpg)
Monitors:
• Contient l’état et la liste des membres du cluster
• Consensus pour la prise de décision distribuée
• Petit nombre
• Ne fournissent pas les données aux clients
19
M
OSDs:
• 1 à 10000 dans un cluster
• Un par disque
• Fournissent les objets aux clients
• Répliquent et réparent les données intelligement
![Page 9: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/9.jpg)
20
![Page 10: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/10.jpg)
21
![Page 11: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/11.jpg)
Zimbra et RedHat Ceph Storage
29 4/02/2016
![Page 12: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/12.jpg)
Where are my data ?
Zimbra : 4 type of data
• MariaDB (≈ 4%)
• Lucene (≈ 9%)
• Blobs (100%)
• Backups (≈ 230%) for 15 days
30
Mysql
Lucene
Emails
Backups
Disque classique
![Page 13: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/13.jpg)
Quick Win to object storage
• Reduce storage Size
• Improve disaster recovery and reliability
• Divide backup time by 25
• Divide restore time by 20
• Deduplication
31
![Page 14: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/14.jpg)
Quick Win to object storage
• Deduplication across servers
• Reduce VM size
• Increase # mailboxes/server
• Easy rolling upgrade
• Easy storage management
• More performance than other object storage connectors
with // Ios
• Idempotent IO
32
![Page 15: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/15.jpg)
Sample
38
Data
Raid 1
PRA
Raid 1
Backup
Classique
Avec Ceph
Raid 5
Data EC E
C
![Page 16: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/16.jpg)
Simple installation
From Zimbra :
• Add a new server
• Configure the Ceph connector
• Move Mailboxes
43
![Page 17: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/17.jpg)
Démo
44
![Page 18: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/18.jpg)
Université de Lorraine
• Migration from april to june without downtime
• 200.000 messages and 32 Go each day
• Double quote for 91000 mailboxes
• 60% deduplication
• Backup 100.000 mailboxes each night
• Instant restore
• Increased backup retention (15 to 60 days)
• Update without downtime
45
![Page 19: Zimbra et RedHat Ceph Storage - In-Tuition Cloud Services · Gluster management Ceph data service Gluster data service Ceph OPEN SOURCE SOFTWARE management STANDARD HARDWARE Share-nothing,](https://reader030.fdocuments.net/reader030/viewer/2022041100/5ed7a88548b98015c2021475/html5/thumbnails/19.jpg)
9/03/2017 46
Florent Manens
@beezimfr
www.beezim.fr
Yoann Legrand
@RedHat_France
www.redhat.com