SwiStack : Hardware Reference Architecturesfiles.swiftstack.com/SwiftStack Reference Architectures -...

Property of SwiftStack Inc.

Swi$Stack:HardwareReferenceArchitectures

ChrisNelsonDirector,SystemsEngineering

November2015

ImportantNotes

•  ThefollowingslidesprovideexamplehardwareconfiguraGonsforcommonSwiHStackdeployments;whiletheymaybeagreatstarGngpointtoahardwaredesignconversaGon,theyarenotfixedinstone,andmanyothercombinaGonsofhardwaremayalsobeappropriateforagivenapplicaGonworkload.

•  ThebestguidanceforhardwaredesignforSwiHStackdeploymentsis,“don’tovercomplicateit!”

•  Tounderstandthelogicbehindthefollowingexamplearchitectures,readhPps://swiHstack.com/docs/admin/hardware.html

•  Mostimportantly,contactSwiHStackifyouhavequesGons,andwewouldbegladtohelpyouplanforsuccess.

HardwareBuildingBlocksPhase Size

ExpandbyAdding... GeneralUseCases ArchiveUseCase HighPerformanceUseCases

TesFng

Small

Nodes

1-Fermodel:PACO3zonesx1+PACOnodeperzone

=3+nodesEachnodehas3+harddrives X

Prod

ucFon

Small

100TButo

1PBu

Nodes

1-Fermodel:PACO3zonesx3+PACOnodesperzone

=9+nodesEachnodehas12-24harddrives

PACONode: LoworMed-PerfCPU,32-64GBRAM

2xSSDs12-24HDDspernode

X

Medium

1PButo

10PBu

Racks

2-Fermodel:P/ACO1zoneperrack

Eachrackcontains:•  1MgmtSwitch•  1Top-of-Rackswitch•  2ProxyNodes•  10-15ACONodes

PNode: MedorHigh-PerfCPU,64-128GBRAMACONode: MedorHigh-PerfCPU,64-128GBRAM

2xSSDs~30HDDspernode

2-Fermodel:P/ACO1zoneperrack

Eachrackcontains:•  1MgmtSwitch•  1Top-of-Rackswitch•  1ProxyNode•  7-10ACONodes

PNode: Low-perfCPU,32-64GBRAMACONode: Low-perfCPU,32-64GBRAM

2xSSDs~60HDDspernode

3-Fermodel:P/AC/O1zoneperrack

Eachrackcontains•  1MgmtSwitch•  1Top-of-Rackswitch•  4PNodes•  4ACNodes•  10-20Onodes

PNode: High-perfCPU,64-128GBRAMACNode: High-perfCPU,64-128GBRAM

3xSSDsONode: High-perfCPU,64-128GBRAM

~12HDDspernode

Large

5PButo

>100PBu

Manyracks

CUSTOM:

2-Ger(P/ACO)or3-Ger(P/AC/O)designCustomzones

CustomrackdesigntunedforusecaseandgrowthpaPern

Small:TesGng&General/MixedUseCases

Vendor Generic Supermicro Quanta HP Cisco Seagate Dell

UseCases•  TesGng•  Sub-petabyteproducGonenvironments

Benefits•  Startsmall(~150TBuseable),andgrowfromthere•  Buy“bythenode”•  Single-Gerarchitectureletsyouscalesimply

GeneralDesign •  Inthissingle-Germodel,eachnodeperformsallservices—includingproxy,account/container,andobjectservices.

ExamplePACONodes*

•  2xCPUs(e.g.,E5-2620v3)•  32-64GBDRAM•  Bootdrives/SATADOM•  12x3.5”HHD•  1xdual-port1GbE•  1x1GbEmgmtport

826BE16-R920LPB S210-X22RQ

DL380-or-

DL360+D3600C240

Generic1uServer+

Seagate4u24JBOD

R730XD

CPU&SSDRaFos•  Forlargeobjectcounts(i.e.,1–10millionobjectsinasinglecontainer),add1xSSD(atleast100GB)pernodeforaccount/containerdata•  ForCPUs,choosemodelssuchthattheraGoof(sockets*cores*speed):HDDsisatleast2:3

RecommendaFons•  FortesGngenvironments,startwith3nodes•  ForproducGonenvironments,startwith9nodes(3zones,3nodesperzone),andaddcapacity3nodesataGme.

NetworkSwitches&RackConfiguraFon

•  1xTop-of-Rack(ToR)Switchwith48x1GbEportsand4x10GbEuplinkports•  1xManagementSwitchwith48x1GbEports•  PACONodes(andloadbalancer(s)ifnotinstalledelsewhere)

*Hardware vendors may offer newer or different models which are perfectly appropriate. SwiftStack is very flexible; find hardware that roughly matches the “Generic” requirements, and deploy with confidence.

Medium:General/MixedUseCases


UseCases•  MostobjectstorageusecasesuptoandincludingliveapplicaGoncontentstorage•  GreatforrepatriaGonofdatafrompublic-cloudobjectstorageproviders

Benefits•  CapaciGesvarybydensityofvendorchassis,•  Buy“bytherack”at~500TBusableperrack(with4TBdrives)•  Typicallystrongcost/performanceraGos

GeneralDesign

•  2Proxynodesperrack•  FilluptoremainingrackspacewithAccount/Container/Object(ACO)nodes

ExampleProxyNodes*

•  2xCPUs(e.g.E5-2620v3)•  64-128GBDRAM•  Bootdrives/SATADOM•  1xdual-port10GbE•  1x1GbEmgmtport

SYS-6017R-TDLRF

S810-X52L(1node) DL360 C220 Generic1uServer R630

ExampleACONodes*

•  2xCPUs(e.g.,E5-2620v3)•  64-128GBDRAM•  Mirroredbootdrives•  1xdual-port10GbE•  1x1GbEmgmtport•  1xSASHBA•  JBODwithHDDs(andSSDs)

SSG-6047-E1R36L

S810-X52L(1node)+½M4600H

DL360+½D6000-or-

DL360+2xD3600

C3160(equivalentto

2nodes)

Generic1uServer+

½Seagate5u84JBOD

R630+½MD3060e

CPU&SSDRaFos•  IncludeSSDsinproxyorACOnodesforaccount/containerdatasuchthattheraGoofSSDstoobjectHDDsisapproximately1:15•  ForobjectserverCPUs,choosemodelssuchthattheraGoof(sockets*cores*speed):HDDsisatleast2:3

RecommendaFons•  Startwith3racks(1zoneperrack)•  Expandbyadding3racksataGme


•  1xTop-of-Rack(ToR)Switchwith48x10GbEports•  1xManagementSwitchwith48x1GbEports•  Proxy&ACOnodes(andloadbalancer(s)ifnotinstalledelsewhere)

*Hardware vendors may offer newer or different models which are perfectly appropriate. Swift is very flexible; find hardware that roughly matches the “Generic” requirements, and deploy with confidence.

Medium:ArchiveUseCases


UseCases•  Archive(writeonce,readrarely)•  Greatforstoringpreviouslyofflineornear-linecontent

Benefits•  CapaciGesvarybydensityofvendorchassis•  Buy“bytherack”at~500TBusableperrack(with4TBdrives)•  Typicallystrongcost/capacityraGos

GeneralDesign

•  1Proxynodeperrack•  FilluptoremainingrackspacewithAccount/Container/Object(ACO)nodes

ExampleProxyNodes*

•  2xCPUs(e.g.,E5-2620v3)•  32-64GBDRAM•  Bootdrives/SATADOM•  1xdual-port10GbE•  1x1GbEmgmtport

SYS-6017R-TDLRF

S810-X52L(1node) DL360 C220 Generic1uServer R630

ExampleACONodes*

•  2xCPUs(e.g.,E5-2620v3)•  32-64GBRAM(128for>60HDDs)•  Mirroredbootdrives•  1xdual-port10GbE•  1x1GbEmgmtport•  1xSASHBA•  JBODwithHDDs(andSSDs)

2xSSG-6047-E1R36L

S810-X52L(1node)+M4600H

DL360+D6000-or-

DL380+5xD3600

C3160

Generic1uServer+

Seagate5u84JBOD

R630+MD3060e

CPU&SSDRaFos•  IncludeSSDsinproxyorACOnodesforaccount/containerdatasuchthattheraGoofSSDstoobjectHDDsisapproximately1:30•  ForobjectserverCPUs,choosemodelssuchthattheraGoof(sockets*cores*speed):HDDsisatleast1:3



•  1xTop-of-Rack(ToR)Switchwith48x10GbEports•  1xManagementSwitchwith48x1GbEports•  Proxy&ACOnodes(andloadbalancer(s)ifnotinstalledelsewhere)


Medium:High-PerformanceUseCasesVendor Generic Supermicro Quanta HP Cisco Seagate Dell

UseCases•  Highconcurrency,large-fileread/write,high-volumeread/writeworkloads•  Greatforvideostorage,public-facingobjectstorage,andotherhigh-performanceworkloads

Benefits•  CapaciGesvarybydensityofvendorchassis•  Buy“bytherack”at~250TBusableperrack(with4TBdrives)•  ScalethreeGersindependentlyforopGmalperformance

GeneralDesign

•  4Proxynodesperrack•  4Account/Containernodesperrack•  ~16Objectnodesperrack

ExampleProxyNodes*

•  2xCPUs(e.g.,E5-2650v3)•  64-128GBDRAM•  Bootdrives/SATADOM•  1xdual-port10GbE•  1x1GbEmgmtport

SYS-6017R-TDLRF

S810-X52L(1node) DL360 C220 N/A R630

ExampleAccount/Container

Nodes*

•  2xCPUs(e.g.,E5-2650v3)•  64-128GBDRAM•  Mirroredbootdrives•  1xdual-port10GbE•  1x1GbEmgmtport•  3xSSDsw/1xSASHBA

SYS-6017R-TDLRF

S810-X52L(1node) DL360 C220 N/A R630

ExampleObjectNodes*

•  2xCPUs(e.g.,E5-2650v3)•  64-128GBDRAM•  Mirroredbootdrives•  1xdual-port10GbE•  1x1GbEmgmtport•  12xHDDs

826BE16-R920LPB S210-X22RQ

DL380-or-

DL360+D3600C240 N/A R730XD

RaFos•  TheraGoofSSDsintheaccount/containernodestoHDDsintheobjectnodesshouldbeapproximately1:15•  ForobjectserverCPUs,choosemodelssuchthattheraGoof(sockets*cores*speed):HDDsisatleast1:1



•  1xTop-of-Rack(ToR)Switchwith48x10GbEports•  1xManagementSwitchwith48x1GbEports•  Proxy,A/C,&Objectnodes(andloadbalancer(s)ifnotinstalledelsewhere)


SwiStack : Hardware Reference Architecturesfiles.swiftstack.com/SwiftStack Reference Architectures -...

Documents

Transcript of SwiStack : Hardware Reference Architecturesfiles.swiftstack.com/SwiftStack Reference Architectures -...