Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management –...
Transcript of Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management –...
Storage Resource Management – Managing SAN Cost & Complexity
Jerry Duggan, Hewlett-Packard
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 22
SNIA Legal Notice
The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in presentations and literature under the following conditions:
Any slide or slides used must be reproduced without modificationThe SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations.
This presentation is a project of the SNIA Education Committee.
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 33
Abstract
SRM and SAN Management: Reducing Management Costs and Complexity
Storage networks were introduced to ease issues with backup, improve access rates and availability as well as the efficiency of managing distributed storage. Storage networks also introduced many new layers of abstraction and network resources to manage, thereby replacing the direct application server to storage relationship.
This problem was amplified as storage administrators were forced to master multiple device managers, fabric managers, performance tools, etc., resulting in a soaring cost of training and administration. Today's SRM and SAN Management solutions allow administrators to become more efficient at managing resources and consequently service levels, and provide the automated discovery, monitoring, reporting and policy-based actions needed to proactively manage a complex, multi-
vendor storage network.
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 4
Agenda
Today’s SRMSRM Use Cases
Reducing Management Costs and ComplexityOperational and ROI Benefits
Importance of Storage StandardsLessons LearnedWhat to Look For
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 5
Storage Management Challenges
Application Application Application
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 6
Yesterday’s SRM
Point ToolsHigh Training Costs, Expertise Limited to Select Few
SpreadsheetsInefficient, Error-Prone, Not Secure
White BoardsA Recipe for Disaster!
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 7
SRM Today
Enterprise RFPs
and Deployments Growing SteadilyWorldwide implementations in Global 200 accounts
Financial, Healthcare, Media, Manufacturing, Telecom
Vendor Consolidation~30 vendors in 2002~10 vendors today
2nd
Generation SRMNot just for file servers anymore
SMI-S in SRMSMI-S implemented by all leading SRM vendorsOver 500 products CTP compliant
SRM as a Storage Management PlatformCommon platform for all things “SRM”Encompassing term for all things “Storage Management”
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 8
The New SRM
SAN/Device Mgt.– Topology– Dependency– Fabric mgt.– Array mgt.
StorageManagement
NetworkManagement
Server Management
Backup Resource Mgt.– Reporting– Topology– Job event mgt.
Provisioning– Fabric zoning– LUN mapping– LUN masking
File SRM– Aging analysis– Consumption– Policy actions
App. Mgt.– Path mgt.– Performance– Capacity
Change Mgt.– Change log– Auditing– Modeling
Enterprise Management Platforms
Storage Resource Management- Common agent - Common repository - Common user interface
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 9
Agenda
Today’s SRMSRM Use Cases
Reducing Management Costs and ComplexityOperational and ROI Benefits
Importance of Storage StandardsLessons LearnedWhat to Look For
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 10
Storage Infrastructure Challenges
Source: ESG Research – Based on ESG survey of 165 storage professionals
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 11
Additional IT Directives
Reduce capital expensesManage more with same number of peopleOptimize utilization of existing assetsFaster trouble shootingReduce the number of point products
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 12
SRM: The Great Enabler
Assists
Daily OperationsAutomates discovery, monitoring, reporting, policy
actions
Reduces
repetitive, manual
administrationMoves admin
from
reactive
to proactive management
Enables
Strategic
IT InitiativesProvides planning information and decision supportAccelerates project timelines and reduces costsReporting/tracking communicates project success
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 13
SRM Use Case Automated Discovery and Topology Mapping
Source: ESG, The Quantified Benefits of Storage Resource Management Software, 12/06
Tool Steps Comments Elapsed Time
Oracle DBA Studio
Launch DBA Studio Enterprise Manager. Select a database to manage. Launch the table space utilization view. Record table space to DB file mapping
DB admin login required
Command Line
Find the storage vendor and LUN (df –k and the Solaris format utility)
Root login required. Different for each operating system
HBA or O/S utility
Find WWN using LUN Different for each HBA
Storage GUI or CLI
Find the device using WWN and LUN. Record the RAID group and level. Record the hard drives in the RAID group and the drive configuration.
Different for each storage array
Manual
Switch GUI or CLI
View active zones Find the ingress port’s WWN. Find the egress port’s WWN. Record zone members and settings.
Different for each switch. Repeat for multi-switch SANs
One hour
Automated SRM Application to spindle discovery and topology
Fast, simple single screen
Less than a minute
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 14
Auto- discovery
Topology visualization
Fabric management
Heterogeneous device support
(active and passive)
Benefits:Improve operational
efficiencyEnsure data availabilityFreedom to buy storage hardware that meets business and budget needs
SRM Solution Automated Discovery and Topology Mapping
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 15
SRM Use Case Capacity Planning and Utilization
Source: ESG, The Quantified Benefits of Storage Resource Management Software, 12/06
Before SRM After SRM
Existing Storage Capacity 50 TB 50 TB
Projected Growth 60% 60%
Storage Utilization 45% 70%
Additional Disk required 30 TB 1.4 TB
Cost of Disk/GB $30 $30
Projected Capital Expense $900,000 $42,857
Savings $857,143
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 16
Application capacity
Host capacity
Switch capacity
Array capacity
SRM Benefits:Prevent capacity shortagesOptimize existing resourcesSimplify consolidation effortsSimplify planning
Capacity details and trends for
each resource
SRM Solution Capacity Planning and Utilization
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 17
SRM Benefits:Defer capital expenditures by reclaiming capacityDetermine what data can be moved to lower cost storage tiersImplement ILM with greater accuracy and speed
Identify old, inappropriate, and duplicate
files
Classify unstructured data for ILM
Monitor end user space
hogs and disk usage by groups
SRM Solution Capacity Planning and Utilization
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 18
SRM Use Case Automated Provisioning
Steps Tool Comments Elapsed Time
Location of unused capacity and/or add more drives Storage Console
Radically different user consoles for each vendor
Allocation of logical volumes Storage Console
Assignment of host addresses Storage Console
Use of LUN mask for security Storage Console
Multi-path Configuration Software and operating system
Available from multiple vendors with operating specific interfaces
Zoning Switch Console
Switch specific user interfaces. Zoning using WWN is tedious and can be error prone
HBA Configuration HBA Console Vendor and adaptor specific
Driver configuration BIOS or utility HBA and O/S specific
Server Recognizes new capacity O/S specific Very different procedures
between O/S
Manual
Application recognizes new capacity
Application specific
One Hour
Automated Provisioning Manager SRM Fast, single screen simplicity
Three Minutes
Source: ESG, The Quantified Benefits of Storage Resource Management Software, 12/06
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 19
SRM Benefits:Improve accuracy and speed of allocating storage capacityAccelerate deployment of revenue-generating applicationsProvision ILM tiers through common interface
End-to-end path
provisioning interface
SmartGuide™ rules for array, host binding, volume, LUN,
and zone operations
Job scheduler minimizes business impact
SRM Solution Automated Provisioning
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 20
SRM Use Case Application Performance Troubleshooting
Source: ESG, The Quantified Benefits of Storage Resource Management Software, 12/06
Tool Steps Comments Elapsed Time
Trap collector
Initial traps are recorded. Hundreds of sympathetic alarms are generated equipment in the data path. All affected group leaders are notified. Wait to hear from applications group
Multiple tools may be required including HP OpenView, MicroMuse etc.
Meetings Group leaders and vendors gather to discuss problem
Finger pointing ensues
Visio Diagrams and Excel spreadsheets
Possibly outdated information is used to try to isolate problem
Tribal knowledge rules
Manual
Physical verification
Teams are dispersed through out the data center to check on their respective domains and isolate the problem
Time consuming, especially if multiple data centers are involved.
Approximately four hours – Extreme cases could days
Automated Database
module
Receive alarms and quickly indicate source of problem and application affected
One screen covers application through storage
Less than 5 minutes
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 21
SRM Benefits:Identify root causes
or performance problemsImprove service levels
Real-time monitoring of storage
supply chainSmartGuide™
filters for fast analysis
Monitor all statistics
concurrently
Storage Essentials Solution Application Performance Troubleshooting
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 22
Who benefits from SRM ?
CxOsReduced Storage TCOImproved Business Continuity
IT DirectorsImproved Operational Efficiencies & ROI of Storage AssetsSupports Storage Management Best PracticesSupports Heterogeneous Open Systems Environments
System/Storage AdministratorsCentralized Web Based SolutionFlexible/Custom Reporting meets reporting needs
Users of Business Systems & Knowledge WorkersImproved Access to ApplicationsPromotes Faster Decision Making, Higher Productivity
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 23
Agenda
Today’s SRMSRM Use Cases
Reducing Management Costs and ComplexityOperational and ROI Benefits
Importance of Storage StandardsLessons LearnedWhat to Look For
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 24
SMI-S in SRM Solutions
SMI-S compliant SRM solutions provide the following benefits:
Agent less management of Windows infrastructureNormalized management for all storage systems, switches and hostsDevice support added quickly, without “shims”
or
“translators”
to proprietary interfaces CIM-standard database schema, instead of a proprietary data model, results in faster administrator ramp-up and less risk of vendor lock-in.
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 25
Capacity
ManagementTotal capacity, total used, total available, unmounted
volume, and percentage used summary statisticsVolume name, partition type (FAT, NTFS, etc.), total capacity, total used, available, and percentage used
SMI-S in SRM Solutions Agentless Management Features through WMI
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 26
Performance MonitoringEach server and the logical disks in each serverProcessor utilization, physical memory used, free physical memory, virtual memory used, and free virtual memory
SMI-S in SRM Solutions Agentless Management Features through WMI
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 27
SMI-S in SRM Solutions
Normalized
Array
ManagementStandardized management UI based on SMI-S defined presentation modelReduces training and administration time
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 28
Management Framework Standard
SAN Mgt.– Dependency– Fabric mgt.– Array mgt.
Backup Mgt.– Reporting–Job event mgt.
Provisioning– Fabric zoning– LUN mapping– LUN masking
File/App. Mgt.– Path mgt.– Performance– Capacity– File analysis
Change Mgt.– Change log– Auditing– Modeling
Development shifts to high value-add
functionality
SMI-S provides a standard way to
discover, model, and provision storage
Storage Management PlatformCommon components/services:- Topology - Data Model - Policy Management - Discovery - Events - Collector
MF extends SMI-S and eases development of
interoperable management apps
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 29
Agenda
Today’s SRMSRM Use Cases
Reducing Management Costs and ComplexityOperational and ROI Benefits
Importance of Storage StandardsLessons LearnedWhat to Look For
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 30
Lessons Learned
Management support and endorsement at the executive level plays a crucial role
In successful deploymentsIn enabling the savingsCritical to get all domain experts on-board
Storage admins, DBAs, system admins, Exchange admins
Move from a culture of provisioning to a culture of managementDriving up utilization requires performance managementUse SRM to create baseline for IT initiatives
Use reports to communicate success of IT initiatives
SMI-S compliance reduces risk and increase choicesThe tools are available today -
pick one and get started
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 31
Agenda
Today’s SRMSRM Use Cases
Reducing Management Costs and ComplexityOperational and ROI Benefits
Importance of Storage StandardsLessons LearnedWhat to Look For
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 32
What to Look for (in an SRM Solution)
Unified PlatformHeterogeneous Device Support ScalabilityStandards-builtBusiness application managementFile-level analysisRemote managementEase of useNormalized provisioning
Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 3333
Q&A / Feedback
Please send any questions or comments on this presentation to SNIA: [email protected]
Many thanks to the following individuals for their contributions to this tutorial.
-
SNIA Education Committee
Jerry Duggan