Articolo Perù uscito su Business People / Press Ruta 40 Tour Operator
IT Press Tour #17 - OpenIO & Technology
-
Upload
openio -
Category
Technology
-
view
523 -
download
0
Transcript of IT Press Tour #17 - OpenIO & Technology
![Page 1: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/1.jpg)
![Page 2: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/2.jpg)
![Page 3: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/3.jpg)
![Page 4: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/4.jpg)
![Page 5: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/5.jpg)
![Page 6: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/6.jpg)
![Page 7: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/7.jpg)
88% (2015)
Unstructured dataworldwide ratio
Each year
Facts:
ESG Digital Archive Market Forecast IDGSource:
+62%
![Page 8: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/8.jpg)
Scalability + PerformanceChallenge:
![Page 9: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/9.jpg)
Object storageSolution: ?
![Page 10: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/10.jpg)
Object storage ?
![Page 11: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/11.jpg)
Object storage ?
![Page 12: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/12.jpg)
Object storage !
![Page 13: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/13.jpg)
Object storage
Advantages But not optimized for
Scalability 100s PBs, low TCO
Ease of access Simple API GET/PUT/DELETE
Resiliency Replication, erasure coding,geodistribution
Heavily updated data
No POSIX-like API
• VMs • SQL DBs
![Page 14: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/14.jpg)
10+ yearsMarket: 1.2 B$ today 4.6 B$ > 2020
Maturity Fast growing
IDCSource:
![Page 15: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/15.jpg)
Gartner, Critical Capabilities for Object Storage
Scalability Efficiency Interoperability Ease of management Performance Resiliency Security
![Page 16: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/16.jpg)
Very high capacity Optimized TCO* Unstructured data Price per GB low
Rather low capacity Very high performanceVMs, SQL DBs Price per GB high
Object store Flash Arrays
Vision: 88% 12%
No future for traditional vendors?
*Total Cost of Ownership
![Page 17: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/17.jpg)
Performance
Tightly integrated application connectors
Quality of Service
< Vision:
Very high capacity Optimized TCO Unstructured data Price per GB low
88%
Object store
![Page 18: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/18.jpg)
Object storage is not only storage. It is a new way to build backend services for applications. As Docker has disrupted sysadmin, we want to disrupt storage management.
![Page 19: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/19.jpg)
![Page 20: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/20.jpg)
WHO
![Page 21: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/21.jpg)
AntiSpam - AntiPhishing - eMail classification 235M MailBoxes in 76 countries
IaaS - PaaS - DaaSNetwork & Security for legacy, SaaS and Web Apps
Lille San Francisco Montréal Hong-Kong Tokyo
Innovative technologiesfor IT infrastructure
100 people
![Page 22: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/22.jpg)
7 8 50fellow co-founders
years experience
million end users
16people
2015launch (June)
![Page 23: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/23.jpg)
2006
Idea & 1st concept
2007
Designdev starts
2009
1st massiveproductionabove 1PB
![Page 24: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/24.jpg)
2006
Idea & 1st concept
2007
Designdev starts
2009
1st massiveproduction above 1PB
2015
OpenIOfork
2012
Opensourced
2014
10+ PBmanaged
![Page 25: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/25.jpg)
Lille
@OpenIO
OpenIO
github.com/open-io
San Francisco
FRANCE
USA
Tokyo
JAPAN
![Page 26: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/26.jpg)
Member of Partners Customers
![Page 27: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/27.jpg)
WE LOVE OPEN SOURCE
![Page 28: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/28.jpg)
• AGPL V3 for core services
• LGPL V3 for libraries andclient APIs
LICENSES
github.com/open-io
![Page 29: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/29.jpg)
WHAT
![Page 30: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/30.jpg)
Grid for apps
ConscienceDirectory with indirections
1. 2. 4.
Grid of nodes
3.
Unique design
![Page 31: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/31.jpg)
…
……
Namespace
Account
Container
Object
Multi tenancy
Flat structure
Track containers, not objects
Directory with indirections1.UNIQUE DESIGN
containers objects
![Page 32: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/32.jpg)
Distributed Hash Tables Consistent Hashing
Single name node
• Good for trillion of objects
• Bad because of rebalancing data when scaling
• Good for few large files
• Bad for numerous small objects
Directory with indirections1.
• Good for trillion of objects
• Good, no need to rebalance data when scaling
Indirection table
Existing technologies OpenIO
UNIQUE DESIGN
![Page 33: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/33.jpg)
Grid of nodes2.UNIQUE DESIGN
• Share nothing architecture
• Scale-out design with no contention
• New nodes are auto discovered
• No gateway in native object mode
• No SPOF, resilient to node failures
![Page 34: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/34.jpg)
1. Collects metrics from the services of each node
2. Computes a score for each service
3. Distributes scores to every nodes and clients
4. On the fly best match making for each request
Conscience3.UNIQUE DESIGN
Realtime load balancing for optimal data placement
The score is computed with a configurable formula usually based on: capacity, io performance, CPU
![Page 35: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/35.jpg)
Storage
CPU/RAMusage
Over the years
> Don’t waste servers Use their free CPU & RAM!
Grid for Apps4.UNIQUE DESIGN
![Page 36: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/36.jpg)
Scality Ceph OpenIO
LICENSE Proprietary Open Source Open Source
ARCHITECTURE RING Crush maps 3-level distributed directory
CONTAINERS External DB RADOS GW only Native with strong consistency
SCALING rebalance rebalanceNo rebalance,immediate availability
LOAD BALANCING
Static, consistent hashing based
Static, consistent hashing based Real time, automatic
Competitors
![Page 37: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/37.jpg)
Hardwareagnostic
0TB > 1000+PB
1. 2.
Never Rebalance
3.
Different
![Page 38: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/38.jpg)
• Simple to use
• Low-latency and linear performance
• Never rebalance when scaling
• Immediate benefits in terms of capacity & performance
• Flexible increments
“True scalability”
0TB > 1000+PB1.DIFFERENT
![Page 39: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/39.jpg)
Consistent hashing
Each node owns a part of the key space
New nodes get parts of the key space from the older ones
Never rebalance2.DIFFERENT
Recalculate key space
Scaling
![Page 40: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/40.jpg)
OpenIO
New nodes automatically discovered and immediately available
Scaling
Immediate benefits in terms of performance from the new nodes
Never rebalance2.DIFFERENT
![Page 41: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/41.jpg)
• Work with heterogeneous hardware
• No vendor lockin
Hardware agnostic3.DIFFERENT
• Hardware is used according to its capacity and performance
• Scores are also based on I/O figures and CPU, not only capacity
Conscience
![Page 42: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/42.jpg)
Interoperability
1. 2. 3.
ConnectorsOpen Source Native APIs
![Page 43: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/43.jpg)
>_Amazon S3® OpenStack
Swift® Optimized native APIs
• Python • Go • C • Java
Command line interface
Native APIs2.INTEROPERABILITY
![Page 44: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/44.jpg)
Storage Email Video
Connectors3.INTEROPERABILITY
• File System (NFS)
• OpenStack SWIFT
• Amazon S3
• Cyrus 3.0
• Zimbra
• Mail Object
• Dovecot
• HTTP connector
• Adaptive streaming connector
• Event based transcoding
![Page 45: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/45.jpg)
Hardware agnostic, True scalability 0 > 1000+PBs
Storage-tier, Conscience auto-optimization, Grid for Apps
Open Source, S3 and SWIFT APIs, Specific App connectors
Human free management, Simple to deploy
Low-latency design, Specific App connectors
Grid of nodes, Replication, Erasure Coding, Geodistribution
Multitenancy, silent corruption checks, WORM for compliance and encryption
Scalability Efficiency Interoperability Ease of management Performance Resiliency Security
Gartner, Critical Capabilities for Object Storage
![Page 46: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/46.jpg)
HOW
![Page 47: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/47.jpg)
Time >
PB >
Deployed Used ISP 40+ M mailboxes
Real life use caseREFERENCES
![Page 48: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/48.jpg)
![Page 49: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/49.jpg)
OIO Core
Standard Support 24/7
Premium Support 24/7
ProfessionalServices
MailConnectors
VideoConnectors
FileConnectors
WebUI
Open SourceSubscriptionService
![Page 50: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/50.jpg)
![Page 51: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/51.jpg)
New release scheme & new release 15.12
• One release for our projects
• Fuse & NFS file connector
• First LTS (long term support) release
• Multiple OpenIO core optimizations
• New python-based CLI
#1
![Page 52: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/52.jpg)
File connector (Fuse & NFS)
• To ease adoption by the market
• Ability to « mount » an account as a filesystem
• Targets performance - close to our core solution
• Files will also appear as read-only objects under the traditional object APIs
#2
![Page 53: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/53.jpg)
Philippe Nicolas
#3
As advisor
Welcome aboard! :-)
![Page 54: IT Press Tour #17 - OpenIO & Technology](https://reader033.fdocuments.net/reader033/viewer/2022042706/587f67e11a28ab9b398b638d/html5/thumbnails/54.jpg)
OpenIO to quickly become a major player