Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management –...

33
Storage Resource Management – Managing SAN Cost & Complexity Jerry Duggan, Hewlett-Packard

Transcript of Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management –...

Page 1: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management – Managing SAN Cost & Complexity

Jerry Duggan, Hewlett-Packard

Page 2: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 22

SNIA Legal Notice

The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in presentations and literature under the following conditions:

Any slide or slides used must be reproduced without modificationThe SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations.

This presentation is a project of the SNIA Education Committee.

Page 3: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 33

Abstract

SRM and SAN Management: Reducing Management Costs and Complexity

Storage networks were introduced to ease issues with backup, improve access rates and availability as well as the efficiency of managing distributed storage. Storage networks also introduced many new layers of abstraction and network resources to manage, thereby replacing the direct application server to storage relationship.

This problem was amplified as storage administrators were forced to master multiple device managers, fabric managers, performance tools, etc., resulting in a soaring cost of training and administration. Today's SRM and SAN Management solutions allow administrators to become more efficient at managing resources and consequently service levels, and provide the automated discovery, monitoring, reporting and policy-based actions needed to proactively manage a complex, multi-

vendor storage network.

Page 4: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 4

Agenda

Today’s SRMSRM Use Cases

Reducing Management Costs and ComplexityOperational and ROI Benefits

Importance of Storage StandardsLessons LearnedWhat to Look For

Page 5: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 5

Storage Management Challenges

Application Application Application

Page 6: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 6

Yesterday’s SRM

Point ToolsHigh Training Costs, Expertise Limited to Select Few

SpreadsheetsInefficient, Error-Prone, Not Secure

White BoardsA Recipe for Disaster!

Page 7: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 7

SRM Today

Enterprise RFPs

and Deployments Growing SteadilyWorldwide implementations in Global 200 accounts

Financial, Healthcare, Media, Manufacturing, Telecom

Vendor Consolidation~30 vendors in 2002~10 vendors today

2nd

Generation SRMNot just for file servers anymore

SMI-S in SRMSMI-S implemented by all leading SRM vendorsOver 500 products CTP compliant

SRM as a Storage Management PlatformCommon platform for all things “SRM”Encompassing term for all things “Storage Management”

Page 8: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 8

The New SRM

SAN/Device Mgt.– Topology– Dependency– Fabric mgt.– Array mgt.

StorageManagement

NetworkManagement

Server Management

Backup Resource Mgt.– Reporting– Topology– Job event mgt.

Provisioning– Fabric zoning– LUN mapping– LUN masking

File SRM– Aging analysis– Consumption– Policy actions

App. Mgt.– Path mgt.– Performance– Capacity

Change Mgt.– Change log– Auditing– Modeling

Enterprise Management Platforms

Storage Resource Management- Common agent - Common repository - Common user interface

Page 9: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 9

Agenda

Today’s SRMSRM Use Cases

Reducing Management Costs and ComplexityOperational and ROI Benefits

Importance of Storage StandardsLessons LearnedWhat to Look For

Page 10: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 10

Storage Infrastructure Challenges

Source: ESG Research – Based on ESG survey of 165 storage professionals

Page 11: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 11

Additional IT Directives

Reduce capital expensesManage more with same number of peopleOptimize utilization of existing assetsFaster trouble shootingReduce the number of point products

Page 12: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 12

SRM: The Great Enabler

Assists

Daily OperationsAutomates discovery, monitoring, reporting, policy

actions

Reduces

repetitive, manual

administrationMoves admin

from

reactive

to proactive management

Enables

Strategic

IT InitiativesProvides planning information and decision supportAccelerates project timelines and reduces costsReporting/tracking communicates project success

Page 13: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 13

SRM Use Case Automated Discovery and Topology Mapping

Source: ESG, The Quantified Benefits of Storage Resource Management Software, 12/06

Tool Steps Comments Elapsed Time

Oracle DBA Studio

Launch DBA Studio Enterprise Manager. Select a database to manage. Launch the table space utilization view. Record table space to DB file mapping

DB admin login required

Command Line

Find the storage vendor and LUN (df –k and the Solaris format utility)

Root login required. Different for each operating system

HBA or O/S utility

Find WWN using LUN Different for each HBA

Storage GUI or CLI

Find the device using WWN and LUN. Record the RAID group and level. Record the hard drives in the RAID group and the drive configuration.

Different for each storage array

Manual

Switch GUI or CLI

View active zones Find the ingress port’s WWN. Find the egress port’s WWN. Record zone members and settings.

Different for each switch. Repeat for multi-switch SANs

One hour

Automated SRM Application to spindle discovery and topology

Fast, simple single screen

Less than a minute

Page 14: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 14

Auto- discovery

Topology visualization

Fabric management

Heterogeneous device support

(active and passive)

Benefits:Improve operational

efficiencyEnsure data availabilityFreedom to buy storage hardware that meets business and budget needs

SRM Solution Automated Discovery and Topology Mapping

Page 15: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 15

SRM Use Case Capacity Planning and Utilization

Source: ESG, The Quantified Benefits of Storage Resource Management Software, 12/06

Before SRM After SRM

Existing Storage Capacity 50 TB 50 TB

Projected Growth 60% 60%

Storage Utilization 45% 70%

Additional Disk required 30 TB 1.4 TB

Cost of Disk/GB $30 $30

Projected Capital Expense $900,000 $42,857

Savings $857,143

Page 16: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 16

Application capacity

Host capacity

Switch capacity

Array capacity

SRM Benefits:Prevent capacity shortagesOptimize existing resourcesSimplify consolidation effortsSimplify planning

Capacity details and trends for

each resource

SRM Solution Capacity Planning and Utilization

Page 17: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 17

SRM Benefits:Defer capital expenditures by reclaiming capacityDetermine what data can be moved to lower cost storage tiersImplement ILM with greater accuracy and speed

Identify old, inappropriate, and duplicate

files

Classify unstructured data for ILM

Monitor end user space

hogs and disk usage by groups

SRM Solution Capacity Planning and Utilization

Page 18: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 18

SRM Use Case Automated Provisioning

Steps Tool Comments Elapsed Time

Location of unused capacity and/or add more drives Storage Console

Radically different user consoles for each vendor

Allocation of logical volumes Storage Console

Assignment of host addresses Storage Console

Use of LUN mask for security Storage Console

Multi-path Configuration Software and operating system

Available from multiple vendors with operating specific interfaces

Zoning Switch Console

Switch specific user interfaces. Zoning using WWN is tedious and can be error prone

HBA Configuration HBA Console Vendor and adaptor specific

Driver configuration BIOS or utility HBA and O/S specific

Server Recognizes new capacity O/S specific Very different procedures

between O/S

Manual

Application recognizes new capacity

Application specific

One Hour

Automated Provisioning Manager SRM Fast, single screen simplicity

Three Minutes

Source: ESG, The Quantified Benefits of Storage Resource Management Software, 12/06

Page 19: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 19

SRM Benefits:Improve accuracy and speed of allocating storage capacityAccelerate deployment of revenue-generating applicationsProvision ILM tiers through common interface

End-to-end path

provisioning interface

SmartGuide™ rules for array, host binding, volume, LUN,

and zone operations

Job scheduler minimizes business impact

SRM Solution Automated Provisioning

Page 20: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 20

SRM Use Case Application Performance Troubleshooting

Source: ESG, The Quantified Benefits of Storage Resource Management Software, 12/06

Tool Steps Comments Elapsed Time

Trap collector

Initial traps are recorded. Hundreds of sympathetic alarms are generated equipment in the data path. All affected group leaders are notified. Wait to hear from applications group

Multiple tools may be required including HP OpenView, MicroMuse etc.

Meetings Group leaders and vendors gather to discuss problem

Finger pointing ensues

Visio Diagrams and Excel spreadsheets

Possibly outdated information is used to try to isolate problem

Tribal knowledge rules

Manual

Physical verification

Teams are dispersed through out the data center to check on their respective domains and isolate the problem

Time consuming, especially if multiple data centers are involved.

Approximately four hours – Extreme cases could days

Automated Database

module

Receive alarms and quickly indicate source of problem and application affected

One screen covers application through storage

Less than 5 minutes

Page 21: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 21

SRM Benefits:Identify root causes

or performance problemsImprove service levels

Real-time monitoring of storage

supply chainSmartGuide™

filters for fast analysis

Monitor all statistics

concurrently

Storage Essentials Solution Application Performance Troubleshooting

Page 22: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 22

Who benefits from SRM ?

CxOsReduced Storage TCOImproved Business Continuity

IT DirectorsImproved Operational Efficiencies & ROI of Storage AssetsSupports Storage Management Best PracticesSupports Heterogeneous Open Systems Environments

System/Storage AdministratorsCentralized Web Based SolutionFlexible/Custom Reporting meets reporting needs

Users of Business Systems & Knowledge WorkersImproved Access to ApplicationsPromotes Faster Decision Making, Higher Productivity

Page 23: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 23

Agenda

Today’s SRMSRM Use Cases

Reducing Management Costs and ComplexityOperational and ROI Benefits

Importance of Storage StandardsLessons LearnedWhat to Look For

Page 24: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 24

SMI-S in SRM Solutions

SMI-S compliant SRM solutions provide the following benefits:

Agent less management of Windows infrastructureNormalized management for all storage systems, switches and hostsDevice support added quickly, without “shims”

or

“translators”

to proprietary interfaces CIM-standard database schema, instead of a proprietary data model, results in faster administrator ramp-up and less risk of vendor lock-in.

Page 25: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 25

Capacity

ManagementTotal capacity, total used, total available, unmounted

volume, and percentage used summary statisticsVolume name, partition type (FAT, NTFS, etc.), total capacity, total used, available, and percentage used

SMI-S in SRM Solutions Agentless Management Features through WMI

Page 26: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 26

Performance MonitoringEach server and the logical disks in each serverProcessor utilization, physical memory used, free physical memory, virtual memory used, and free virtual memory

SMI-S in SRM Solutions Agentless Management Features through WMI

Page 27: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 27

SMI-S in SRM Solutions

Normalized

Array

ManagementStandardized management UI based on SMI-S defined presentation modelReduces training and administration time

Page 28: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 28

Management Framework Standard

SAN Mgt.– Dependency– Fabric mgt.– Array mgt.

Backup Mgt.– Reporting–Job event mgt.

Provisioning– Fabric zoning– LUN mapping– LUN masking

File/App. Mgt.– Path mgt.– Performance– Capacity– File analysis

Change Mgt.– Change log– Auditing– Modeling

Development shifts to high value-add

functionality

SMI-S provides a standard way to

discover, model, and provision storage

Storage Management PlatformCommon components/services:- Topology - Data Model - Policy Management - Discovery - Events - Collector

MF extends SMI-S and eases development of

interoperable management apps

Page 29: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 29

Agenda

Today’s SRMSRM Use Cases

Reducing Management Costs and ComplexityOperational and ROI Benefits

Importance of Storage StandardsLessons LearnedWhat to Look For

Page 30: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 30

Lessons Learned

Management support and endorsement at the executive level plays a crucial role

In successful deploymentsIn enabling the savingsCritical to get all domain experts on-board

Storage admins, DBAs, system admins, Exchange admins

Move from a culture of provisioning to a culture of managementDriving up utilization requires performance managementUse SRM to create baseline for IT initiatives

Use reports to communicate success of IT initiatives

SMI-S compliance reduces risk and increase choicesThe tools are available today -

pick one and get started

Page 31: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 31

Agenda

Today’s SRMSRM Use Cases

Reducing Management Costs and ComplexityOperational and ROI Benefits

Importance of Storage StandardsLessons LearnedWhat to Look For

Page 32: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 32

What to Look for (in an SRM Solution)

Unified PlatformHeterogeneous Device Support ScalabilityStandards-builtBusiness application managementFile-level analysisRemote managementEase of useNormalized provisioning

Page 33: Storage Resource Management – Managing SAN Cost & Complexity · Storage Resource Management – Managing SAN Cost & Complexity. Jerry Duggan, Hewlett-Packard ... Faster trouble

Storage Resource Management -- Managing SAN Costs & Complexity© 2008 Storage Networking Industry Association. All Rights Reserved. 3333

Q&A / Feedback

Please send any questions or comments on this presentation to SNIA: [email protected]

Many thanks to the following individuals for their contributions to this tutorial.

-

SNIA Education Committee

Jerry Duggan