IBM Tape Strategy & Roadmap Seismic Aug 2017 - npd.no · Tape Challenge àSoftware stack ......
Transcript of IBM Tape Strategy & Roadmap Seismic Aug 2017 - npd.no · Tape Challenge àSoftware stack ......
IBM SystemsIBM Tape StorageE Childers Aug 2017
Agenda
Storage Outlook – Tape Futures
IBM Tape Strategy And Products
2
IBM SystemsIBM Tape StorageE Childers Aug 2017
Agenda
Storage Outlook – Tape FuturesØ What Is Tape’s Place In Future Storage Systems?Ø The Storage Triple Whammy
IBM Tape Strategy and Products
3
IBM SystemsIBM Tape StorageE Childers Aug 2017 4
We all know that data is growing, demands on IT growing, but why is it such a problem?…
IBM SystemsIBM Tape StorageE Childers Aug 2017
Fundamentally – It’s a Storage Scaling Problem
5
© 2011 IBM Corporation3
• IBM logo must not be moved, added to, or altered inany way.
• Background shouldnot be modified,
• Title/subtitle/confidentiality line: 10pt Arial Regular, whiteMaximum length: 1 line
Information separated by vertical strokes,with two spaces on either side
• Slide heading:28pt Arial Regular, blue R120 | G137 | B251
Maximum length: 2 lines
• Slide body:18pt Arial Regular, black
Square bullet color:teal R045 | G182 | B179
Recommended maximum text length: 5 principal points
• Group name:14pt Arial Regular, white
Maximum length: 1 line
• Copyright: 10pt ArialRegular, white
Optional slide number: 10pt Arial Bold, white
Template release: Oct 02For the latest, go to http://w3.ibm.com/ibm/presentations
Indications in green = Live content
Indications in white = Edit in master
Indications in blue = Locked elements
Indications in black = Optional elements
IBM and BP Internal Use
Smarter Systems Are Creating an Information ExplosionEspecially in Media and Entertainment (M&E)
2005 2006 2007 2008 2009 2010 20110
200
400
600
800
1,000
1,200
1,400
1,600
1,800
Exa
byte
s RFID,Digital TV,
MP3 players,Digital cameras,
Camera phones, VoIP,Medical imaging, Laptops,
smart meters, multi-player games,Satellite images, GPS, ATMs, Scanners,
Sensors, Digital radio, DLP theaters, Telematics,Peer-to-peer, Email, Instant messaging, Videoconferencing,
CAD/CAM, Toys, Industrial machines, Security systems, Appliances
§ Storage requirements growing 20-40% per year
Source:: Semantics, “Linked Data” guidelines, 2006. The rate of data growth is greater than:Ø advances in HDD technology areal density (No increases in IT spend to offset imbalance)
HDDTechnology
CAGR
Data CAGR
“Before” (until late 2010’s)
“Now”
The rate of data growth approx the same as:Ø advances in HDD technology areal density
(ie. double every 2 years = 40% CAGR)
IBM SystemsIBM Tape StorageE Childers Aug 2017 | 6
CD (1982)
BluRay15% CAGR
6 layer300GB
33% CAGR
Tape
~ 10% CAGR
3 layer100GB
2015 Tape Technology Demo
DVD
HDD
Storage Technologies Areal Density Trends
IBM SystemsIBM Tape StorageE Childers Aug 2017
Engineers Solve Technology Problems but…
| 7
Market forces drive business models..
Volu
me
Mature technology, stable market & roadmap
High vol, ,low margin, consumer driven commodity
New technology, Low vol, high margin, special use
Cost, Cost, Cost,…High growth, large investment, many players
Technology companies lead
Consolidation, transition to post-consumer driven
design pointsO
ptical
High Vol mfgcompanies lead
Volu
me
Time
IBM SystemsIBM Tape StorageE Childers Aug 2017 | 8
IBM SystemsIBM Confidential
Engineers Solve Technology Problems but…
| 7
Market forces drive business models..
V
olume
Mature technology, stable market & roadmap
High vol, ,low margin, consumer driven commodity
New technology, Low vol, high margin, special use
Cost, Cost, Cost,…High growth, large investment, many players
Technology companies lead
Consolidation, transition to post-consumer driven
design points
Optical
High Vol mfgcompanies lead
Volu
me
Time
IBM SystemsIBM Confidential | 6
CD (1982)
BluRay15% CAGR
6 layer300GB
33% CAGR
Tape
~ 10% CAGR
3 layer100GB
2015 Tape Technology Demo
DVD
HDD
Storage Technologies Areal Density Trends
Technology Outlook
Fundamental Technology Trends
Consumer Market Trends
IBM SystemsIBM Tape StorageE Childers Aug 2017
HDD Challenges
Technology Scaling Limits$/TB Impacted By Increased Cost Of Brick
Declining Consumer Demand
If grains become too small, magnetic state is unstableà superparamagnetic effect
~10 nm
Technologies to go beyond the superparamagnetic limit = $$• HAMR• MAMR• BPM• BPM+HAMR High Perf & High Margin
Market Taken Away By Flash
13
M. Lantz IBM Zurich
IBM SystemsIBM Tape StorageE Childers Aug 2017
Optical Challenges
0
2000
4000
6000
8000
10000
12000
14000
1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
Units
TotalWWOpticalMediaDemandJIRACompliation
BluRay DVD CD
"Comparison CD DVD HDDVD BD" by Cmglee - Own work. Licensed under CC BY-SA 3.0 via Wikimedia Commons -http://commons.wikimedia.org/wiki/File:Comparison_CD_DVD_HDDVD_BD.svg#/media/File:Comparison_CD_DVD_HDDVD_BD.svg
Semiconductor laser wavelength
limit
0.7 GB 4.7 GB 15 GB 25 GBMulti-layer
+Spot & track squeeze
ODA
Technology Scaling Limits $/TB not reduced with multi-layer Declining Mfg Media Demand
IBM SystemsIBM Tape StorageE Childers Aug 2017
IBM has Demonstrated a Tape Technology Pipeline1TB in 2002, 8TB in 2006, 35TB in 2010, 154TB in 2014, 220TB in 2015, and 330TB in 2017…
| 11
IBM SystemsIBM Tape StorageE Childers Aug 2017
Tape Outlook
No Technology Scaling Limits Increasing Demand
0
2,000
4,000
6,000
8,000
10,000
12,000
14,000
Q200
Q300
Q400
Q101
Q201
Q301
Q401
Q102
Q202
Q302
Q402
Q103
Q203
Q303
Q403
Q104
Q204
Q304
Q404
Q105
Q205
Q305
Q405
Q106
Q206
Q306
Q406
Q107
Q207
Q307
Q407
Q108
Q208
Q308
Q408
Q109
Q209
Q309
Q409
Q110
Q210
Q310
Q410
Q111
Q211
Q311
Q411
Q112
Q212
Q312
Q412
Q113
Q213
Q313
Q413
Q114
Q214
Q314
Q414
Q115
Q215
Q315
Q415
Q116
Q216
Q316
Q416
Q117
TotalPB
TotalPB
Tape Challenge à Software stack transition from backup to archive
IBM SystemsIBM Confidential
Storage Technologies Areal Density Trends
| 30
CD (1982)
BluRay15% CAGR
6 layer300GB
33% CAGR
~2025
~ 10% CAGR
3 layer100GB
2015 Tape Technology Demo
DVD
HDD
Tape
IBM SystemsIBM Tape StorageE Childers Aug 2017
The Storage Triple Whammy
| 13
2) Data is growing faster than previously
1) HDD technology scaling breaking down
3) Consumer market demand shifting focus
IBM SystemsIBM Confidential
Fundamentally – It’s a Storage Scaling Problem
19
© 2011 IBM Corporation3
• IBM logo must not be moved, added to, or altered inany way.
• Background shouldnot be modified,
• Title/subtitle/confidentiality line: 10pt Arial Regular, whiteMaximum length: 1 line
Information separated by vertical strokes,with two spaces on either side
• Slide heading:28pt Arial Regular, blue R120 | G137 | B251
Maximum length: 2 lines
• Slide body:18pt Arial Regular, black
Square bullet color:teal R045 | G182 | B179
Recommended maximum text length: 5 principal points
• Group name:14pt Arial Regular, white
Maximum length: 1 line
• Copyright: 10pt ArialRegular, white
Optional slide number: 10pt Arial Bold, white
Template release: Oct 02For the latest, go to http://w3.ibm.com/ibm/presentations
Indications in green = Live content
Indications in white = Edit in master
Indications in blue = Locked elements
Indications in black = Optional elements
IBM and BP Internal Use
Smarter Systems Are Creating an Information ExplosionEspecially in Media and Entertainment (M&E)
2005 2006 2007 2008 2009 2010 20110
200
400
600
800
1,000
1,200
1,400
1,600
1,800
Exa
byte
s RFID,Digital TV,
MP3 players,Digital cameras,
Camera phones, VoIP,Medical imaging, Laptops,
smart meters, multi-player games,Satellite images, GPS, ATMs, Scanners,
Sensors, Digital radio, DLP theaters, Telematics,Peer-to-peer, Email, Instant messaging, Videoconferencing,
CAD/CAM, Toys, Industrial machines, Security systems, Appliances
§ Storage requirements growing 20-40% per year
Source:: Semantics, “Linked Data” guidelines, 2006.
The rate of data growth is greater than:
Ø advances in HDD technology areal density
(No increases in IT spend to offset imbalance)
HDDTechnology CAGR
Data CAGR
“Before” (until late 2010’s)
“Now”
The rate of data growth approx the same as:
Ø advances in HDD technology areal density
(ie. double every 2 years = 40% CAGR)
IBM SystemsIBM Confidential
Engineers Solve Technology Problems but…
| 20
Market forces drive business models..
V
olume
Mature technology, stable market & roadmap
High vol, ,low margin, consumer driven commodity
New technology, Low vol, high margin, special use
Cost, Cost, Cost,…High growth, large investment, many players
Technology companies lead
Consolidation, transition to post-consumer driven
design points
Optical
High Vol mfgcompanies lead
Volu
me
Time
IBM SystemsIBM Confidential
Storage Technologies Areal Density Trends
7
DVDCD (1982)
BluRay15% CAGR
6 layer300GB
33% CAGRHDD
Tape
~ 10% CAGR
3 layer100GB
2015 Tape Technology Demo
IBM SystemsIBM Tape StorageE Childers Aug 2017
What are the options?
1) Increase the budget, build out more floorspace, spend more $ on disk
2) Pay someone else to deal with it – aka cloud servicesØ Cloud storage, including connectivity bandwidth/$
3) Hope for a storage technology breakthroughØ There is nothing on the horizon
4) Breakdown traditional storage islandsØ Tiered storage solution including flash, HDD, tape
Ø Spectrum Archive as part of the Spectrum Storage family
| 14
Tape Enables
IBM SystemsIBM Tape StorageE Childers Aug 2017
IBM tape storage for hyperscale computingTape is relevant in the place IT is moving…
| 15
How to store a zettabyte on a budget• Aaron Ogus, Microsoft Azure• Global IT Executive Summit - October,
2015• https://tapepower.fujifilmrmd.com/LA2015/vid
eo/id/presentation.5
How Google Backs up the Internet• Raymond Blum, Google Site Reliability• NYC Tech Talk Series - October, 2013• https://www.youtube.com/watch?v=eNliOm9Nt
CM
TS1155 – Ethernet interface and 15 TB tape cartridge
IBM SystemsIBM Tape StorageE Childers Aug 2017
Agenda
Storage Outlook – Tape Futures
IBM Tape Strategy and ProductsØ Investment in Tape TechnologyØ Investment in Tape Product LineupØ Investment in the Tape Software Stack
16
Mark Lantz – Future of Tape
Robert Haas
IBM SystemsIBM Tape StorageE Childers Aug 2017
Agenda
Storage Outlook – Tape Futures
IBM Tape Strategy and ProductsØ Investment in Tape TechnologyØ Investment in Tape Product LineupØ Investment in the Tape Software Stack – LTFS
17
IBM SystemsIBM Tape StorageE Childers Aug 2017
IBM Tape Strategy
| 18
Tape Technology Pipeline - IBM Development & IBM Research• Large research investment Zurich and Almaden laboratories • Technology demonstrations – 220 TB in 2015
ØSubstantiates roadmap thru 2025• Drive technology value into Enterprise, leverage into LTO when industry is
capable TS1150 Enterprise Tape product line
• Reliability, Performance and Function differentiation• Enterprise media cartridge with reuse• Enterprise Automation compatible
LTO Midrange product line• Open Tape Streaming product family• Full Automation Product support – 1U to HD Frames• TPC Consortium driven development/function
Software - LTFS• IBM invented, open source, open standard• Provides file system support, integration of tape into Spectrum Scale
IBM Systems
IBM Tape Solutions: A comprehensive PortfolioEntry Enterpris
e
LTO 7 FH
TS1150
TS3200TS3100 TS3310
Tape
au
tom
atio
nTa
pe
virt
ualiz
atio
n
TS4500 High Density
Tape
D
rives
LTO Media3592 Media
TS2900
LTO 7 HH
Mid-Range
SDS Spectrum Archive
Single Drive Library EditionEnterprise Edition
Grid Cloud
Replication
TS7620 Appliance TS7650G
Gateway
TS7760 VTL
IBM SystemsIBM Tape StorageE Childers Aug 2017
Format Compatibility – Past and FutureHow do you increase capacity and value?1. Make smaller things to magnetize2. Make a better magnetizer/reader (head)3. Get the head closer to the media (smoother media)4. Improve accuracy of placing bits on tape
| 21
Media Technology
Drive Technology
FeO2 CrO2 “MP” (Metal Particles) BaFe (Barium Ferrite)
Reel-Reel 3480/ 3590 3592 3592 Gen 4Format
Red Rust
A brief & approximate history of format changes
Cartridge Track Following
Better Track Following
Timing Based Servo
”Thin Film” heads GMR heads TMR headsAMR heads”wire wound”
heads
Complete format breaks
JC, JD, ..JA, JB
Forward/Backward compatibility changes
“dual coat” media
IBM SystemsIBM Tape StorageE Childers Aug 2017
TS1150 Tape Drive – Summary
| 22
Enhanced Capacity• New 10 TB Data/WORM Tape JD media • 7 TB Data Tape re-use / re-format of legacy JC media
Enhanced Performance • Dual, 8 Gb FC attachment with failover support • 360 MB/s max native data rate , 700 MB/s max compressed data rate• 2 GB main data buffer (2X Jag-4) – improved streaming • Improved file writing performance utilizing SkipSync and FastSync
automatic writing accelerators / tape mark virtualization Improved compression hardware and compatible encryption support
• Larger history buffer provides up to 20% improved compression in Jag-5 format versus Jag-4 compression ratios
• Support for all existing encryption methods at higher performance Oct 24 2014 General availability
IBM SystemsIBM Tape StorageE Childers Aug 2017
TS1155 Tape Drive – Summary
| 23
Extending the capacity and interface functionality on current TS1150/Jag-5 base
TS1155 Models • 3592 55F - Fibre Channel model
• Identical dual port 8Gb FC support as TS1150• 3592 55E – Host Ethernet attached model
• dual 10Ge optical SFP+ physical ports • Initial release target to ISER/RoCE v2 protocol variant
• Both models read and write 15 TB capacity on existing JD media • New J5A format supporting 15TB capacity on existing JD media• Automatic up-format support to the new 15TB format when writing from BOT• JD 10 TB format may be also be read and written by the TS1155• Media back-portable for re-formatting to TS1150 drive back to 10TB• TS1160 will read and write the JD formats(10 TB and 15TB)• JC media supported for read (4TB format) or read/write (7TB format), but no capacity increase
• Other attributes remain unchanged from TS1150• Native data rate remains unchanged at 360 MB/s • Load/ready, locate speeds, access times remain unchanged • Support for other functions such as Recommended Access Ordering remains unchanged
• Current support planned only on TS4500 library, but fibre model could be supported in TS3500 if demand
Video.mpg
Spectrum Scale™Single Global Name Space
NFS / CiFS Open Stack CloudPOSIX
Client workstationsUsers and applicationsCompute Farm
Spectrum Archive™
Flash
Spectrum Archive – How it works
Policy based Lifecycle Management
/Files
/Subdir1 One.txtVideo.mpgDatabase.db2
/Subdir2 Memo.txtcamera1.mpg
/Subdir3Medical.txtsonagram.mpgRecords.db2
/Files
/Subdir1
Database.db2/Subdir2
/Subdir3Records.db2
/Subdir1 One.txt
/Subdir2 Memo.txt
camera1.mpg/Subdir3
Medical.txtsonagram.mpg
/Subdir1
/Subdir2
/Subdir3
Policy Based MigrationEfficient use of performance tier
File access cools – File tiers
Policy Based MigrationCold data migrated after 60 days
Expand the lowest cost tier by adding media
Automatically recalled when accessed
Policy based Lifecycle Management$$$ ¢$
IBM SystemsIBM Tape StorageE Childers Aug 2017
TS4500 Tape Library
| 28
§ Scales to over 175 PB native
§ Supports up to 128 tape drives
§ Next-generation storage density • 5.5 PB native in a single frame tape
library• Scales at up to 1 PB per square foot
§ Simplified management• Magazine I/O• Integrated management• Improved ease-of-use• Extensible platform
IBM SystemsIBM Tape StorageE Childers Aug 2017
What’s New with TS4500 R3?
| 29
§ High availability• Dual active accessors with >2X robotic
performance for mount/demount and insert/eject• Ability to grow left or right with <1 hour downtime• Integrated service bays to reduce inactive service
space by 40%• “Elastic Capacity” option to completely eliminate
inactive service space and/or provide temporary relief for temporary overflow conditions
• Flexible growth options with new flex track design§ Mainframe-ready
• Integrate TS7700 backend switches• Attach to TS7700 TSSC for centralized service• GUI support for preset TS7700 logical library
§ Other customer-requested enhancements• Next generation IMC• Up to 4 Library-Managed Encryption (LME) key
paths per logical library• Miscellaneous GUI enhancements
A B
IBM SystemsIBM Tape StorageE Childers Aug 2017
TS4500 HD2 base frame
| 30
TS3500 Tape Library TS4500 Tape LibraryModel Lx3 Model Lx5
Up to 12 Drives16 or 32 I/O
Up to 12 Drives36 I/O - LTO32 I/O - 3592
Licensed Slot Capacity Licensed Slot Capacity
Entry Interm Full Entry Interm Base HD
LTO 64 129 219-287100 200 400
730
3592 58 117 199-260 550
Up to 5.5 PB native capacity in a single frame tape library
Up to 3.3X the slot density of TS3500 with more standard features including:§ Advanced Library Management System (ALMS)
– Dynamic partitioning– Transparent Capacity on Demand– Virtual I/O (VIO)– Cartridge cache
§ Two I/O Stations§ System console capabilities e.g. broadband call home (formerly TSSC)
IBM SystemsIBM Tape StorageE Childers Aug 2017
High Density Frames – Up to 10PB in 10 sq.ft.
| 31
Tier 0 Slots
Tier 1 Slots
Tier 2 Slots
Tier 3 Slots
Tier 4 Slots
Tier 5 Slots
SideView
Nearline cartridge cache (application independent)
Least recently used
Load balancing of tiers to optimize access
CartridgeCache
IBM SystemsIBM Tape StorageE Childers Aug 2017
Self-contained Air Flow
| 32
Ambient Air Hot Air Exhaust
All library frame perforations to be blocked to create a controlled enclosure.
Design will minimize temperature and humidity excursions when any door is opened for service.
Air Conditioner
Hot aisle