SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014...
Transcript of SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014...
![Page 1: SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014 results. At some point, we will At some point, we will settle down to a more top ten](https://reader033.fdocuments.net/reader033/viewer/2022051902/5ff246265ef2f469b0251225/html5/thumbnails/1.jpg)
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM
©2014-2017SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
SPEC SFS®2014 Performance Report SilvertonConsulting,Inc.StorInt™Dispatch ThisStorageIntelligence(StorInt™)dispatchonlycoversSPECsfs2014benchmark1results.TherehavebeentwonewSPECsfs2014submissionssinceourlastreport,bothIBMSpectrumScalewithCiscoUCSandIBMFlashSystem900storage,onefortheSWBUILDandtheotherfortheVDAworkload.
SPECSFS2014_swbuild(SWBUILD)resultsTheSWBUILDworkloadsimulatessoftwarereleasebuilds,essentiallyonebuildisaUnix“make”processagainsttensofthousandsofsourcefilesandisametadataintensiveworkload.Figure1showstheSWBUILDbuildORT(overallresponsetime)andminimumresponsetime.
Figure1SPECSFS2014_swbuildORTandminimumRTresults
Figure1showstheminimumandoverallresponsetimeforthecurrentfoursubmissions.ThelatestIBMSpectrumScalesubmissionisallthewaytotheright.Thisisthefirsttimewecaneverrecallseeingaminimumresponsetimeonany(block,file,email,HPC,etc.)storagesystembenchmarksubmissionwhichshoweda0.0msecresponsetime.Yes,it’sobviouslyaroundedmetricbutthissaystheaverageresponsetimeforthatworkload(@10%ofmaximum)wasunder50µsec.Whichisimpressive,especiallysincethefirstthreerecordedRTallwerelistedas0.0msecresponsetimeandtheworkloadsrangedfrom~12Kto36KSWBUILDops/sec.
1AllSPECSFS2014informationisavailableathttps://www.spec.org/sfs2014/asof23Mar2017
![Page 2: SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014 results. At some point, we will At some point, we will settle down to a more top ten](https://reader033.fdocuments.net/reader033/viewer/2022051902/5ff246265ef2f469b0251225/html5/thumbnails/2.jpg)
24March2017 SCISPEC®SFS2014PERFORMANCEREPORT PAGE2OF4
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM
©2014-2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
ThenewIBMsolution’sORTat1.32msec,cameinat#2.ConsideringtheIBMSpectrumScalesolutionwasdoingabout90KSWBUILDops/secatthetime,seemsveryimpressive.TheSPECSFSreferencesolution,at#1,witha0.96msecORT,wasonlydoingabout9KSWBUILDops/sec,~1/10thasmuchastheIBMSpectrumScalesolution.InFigure2weshowtheSWBUILDops/sec.
Figure2SPECSFS2014_swbuildminimumandtotalops/secresults.
InFigure2,thenewIBMSpectrumScalesolution(again,attherightinFig2)achievedamaximumof~114.7KSWBUILDops/sec,whichcameinsecondbehindtheOracleZFSZS3-2AFAwhichachieved~116.0KSWBUILDops/sec.FortheSWBUILDworkloadsourcefilemetadataisexaminedtoseeifitneedstobecompiled,andthentheselectedsourcecodefilesarecompiled.Althoughwedon’tshowit,theIBMnewsolutionachievedamaximumof240builds.At114.7KSWBUILDops/sec,thismeansthere’s~478SWBUILDopsperSWBUILD.WearestillworkingonchartsfortheSPECsfs2014metrics.WemightprefertoseethesolutionRT’ssomewhereonthischart.Next,weturntotheSPECsfs2014VDAORTandMinimumRTinFigure3.Recallthat,whereasSWBUILDisessentiallymixedread-writeandmetadataintensive,SPECsfs2014VDAisvideodataacquisitionandisessentially,asequentialwriteintensiveworkload.
![Page 3: SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014 results. At some point, we will At some point, we will settle down to a more top ten](https://reader033.fdocuments.net/reader033/viewer/2022051902/5ff246265ef2f469b0251225/html5/thumbnails/3.jpg)
24March2017 SCISPEC®SFS2014PERFORMANCEREPORT PAGE3OF4
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM
©2014-2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
Figure3SPECsfs2014_VDAORTandminimumRTresults
TheORTforthenewIBMSpectrumScalesolutionisournew#1at2.92msecandithadaminimumRTof0.8msec.TheORTiscalculatedasthemedianresponsetimeacrossall10workloaditerationsandwouldhavebeenatabout~6.7GB/secofVDAstreams.InFigure4weshowtheVDAstreamMB/sec.
Figure4SPECsfs2014_VDAstreamMB/secresults
InFigure4,thenewIBMSpectrumScalesolutionachievedamaximumof7.9GB/secofstreamthroughput.ForanAFA,executingawriteintensiveworkloadandperformingat~7.9GB/sec,tellsustheyaredoingsomethingdifferentthanthestandardflashstoragesystem.Thefact
![Page 4: SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014 results. At some point, we will At some point, we will settle down to a more top ten](https://reader033.fdocuments.net/reader033/viewer/2022051902/5ff246265ef2f469b0251225/html5/thumbnails/4.jpg)
24March2017 SCISPEC®SFS2014PERFORMANCEREPORT PAGE4OF4
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM
©2014-2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
thattheIBMSpectrumScaleDeepFlash150andElasticStoragesolutionsalmostmatchedthislevelofperformance,saysthemagicisprobablyattheSpectrumScalelevel.
SignificanceIt’sgoodtoseesomenewSPECsfs2014submissions.It’dbegreatiftherewereevenmoreforthesetwoworkloadsdiscussedaboveandafewforVDIandDATABASEworkloads(whereweonlyhave1each,theSPECSFSreferencesolution).StilltryingtofigureoutthebestwaytoreportSPECsfs2014results.Atsomepoint,wewillsettledowntoamoretoptenlikeformat,whichweuseforotherperformancereports.Butinthemeantime,wemayexperimentwithafewvariantsoftheabovecharts.Anyideasonwhatothermetricsofinteresttoreport,pleasedoletusknowAnysuggestionsonhowtoimproveanyofourperformanceanalysesarealwayswelcomed.Additionally,ifyouareinterestedinmorefileperformancedetails(Top20SPECsfs2008results)andourNFSv3andCIFS/SMB(SPECsfs)ChampionsCharts™,pleaseconsiderpurchasingourrecentlyupdated(March2016)NASBuyingGuide,availableonSCI’swebsite(seeQRcodebelowleft).Thisreportwassentouttosubscribersaspartourfree,monthlyStorageIntelligencee-newsletter.Ifyouareinterestedinreceivingfuturestorageperformanceanalysesalongwithrecentproductannouncementsummaries,pleaseusetheQRcode(belowright)tosignupforyourowncopy.
Silverton Consulting, Inc., is a U.S.-based Storage, Strategy & Systems consulting firm offering products and services to the data storage community
NASBuyingGuideQRcodeNewslettersignupQRcode