Backup Rationalisation Reorganisation of the CERN Computer Centre Backups David Asbury IT/DS Friday...

Backup RationalisationBackup Rationalisation

Reorganisation of the CERN

Computer Centre BackupsDavid Asbury IT/DSFriday 6 December 2002

6 Dec 2002 C5 Presentation: Backup Rationalisation

2

Reasons for backupReasons for backup

Accidental corruption of files/mail/data Storage failure, disks, raid arrays(!) Need to get a server running again Backup is very boring until ….!


3

Different sorts of dataDifferent sorts of data

Home Directories AFS Windows DFS

Mail Unix servers Microsoft Exchange

Databases Unix group & project servers Experimental Data

TSM

AFS specific backup

Legato

Legato

Legato

Legato TSM

Castor

TSM


4

Backup Systems Backup Systems availableavailable

IBM Tivoli Storage Manager (TSM) Formerly called ADSM Run by CERN, IBM & DCS

Legato Networker TSM did not support collocation, slow to restore Run by Serco Mostly computer centre backups

Veritas TSM has some functional advantages Expensive on Windows


5

Proposal: Use TSM for Proposal: Use TSM for everything (1)everything (1)

Supports backing up on Unix Solaris 2.6/7/8/9 & Linux 6/7.3.1 + legacy systems Windows DFS & Exchange AFS

Already contains archived data pubarch (613GB, est 5M files) vmarch (160GB, 1.6M files)

Backup exchange 513 613 is running No need to move cartridges out of silos


6

Proposal: Use TSM for Proposal: Use TSM for everything (2)everything (2)

Collocation option supported and in use Minimises tape mounts on restore, but more on backup Works well with current 1TB disk staging areas Backup during day, move to tape overnight With ~2TB disk could keep yesterday’s backup online

Supports journal-style scan for DFS Constructs list of files to backup as they are changed Avoids slow scan of file tree


7

How we propose to get How we propose to get there (1)there (1)

Overlap periods? Keep existing products for restores

Mostly 6 months, max 1 year Archived engineering data to be copied (600 files, 8TB)

Hardware upgraded (see later slide)


8

How we propose to get How we propose to get there (2)there (2)

Timing: Stop Legato service when backups age out Latest, at end of Serco contract (end 2003)

Automation of restores Scripts possible with TSM (may save manpower) Like pubarch allowing controlled user access


9

Costs today (1): LegatoCosts today (1): Legato

Sun Basic Licence 61 KCHF

SercoService Contract

Reloads

105 KCHF

Est 30 KCHF

Sun Hardware

Maintenance

2 x E450 machines

5 STK 9840 drives

9.4 KCHF

15.4 KCHF

9840 Tape Media24 KCHF in 2002


10

Costs today (2): TSM v4Costs today (2): TSM v4

IBM Basic Licence 32 KCHF

IBM Server & product support 20 KCHF

DCS Client support 36 KCHF

IBM

Hardware

Maintenance

2 x IBM F50 machines

8 x 3590E drives

9 KCHF

30 KCHF

3590E Tape Media 0 in 2002


11

Cost ComparisonCost Comparison

Assuming all done with one product Hardware & support costs similar Licences must increase:

Legato: 61 KCHF to (est) 108 KCHF TSM: 32 KCHF to (est) 82 KCHF (in v5) Optional one-time charge for ORACLE hot backup extra

RMAN product

TSM v5 charged differently from v4 Will be cheaper as many machines already in TSM


12

Hardware todayHardware today

TSM: 2 x IBM F50 (previously HPSS): 2/2 cpus 4/4 x IBM 3590E tape drives (40GB capacity) 28/28 x 18GB disk buffer Gigabit Fast back planes – good for I/O

Legato: 2 x Sun E450 2/4 cpus 2/4 STK 9840 drives (20GB capacity) No disk buffer Gigabit


13

TSM experience & testsTSM experience & tests

Unix servers already backed-up: AIX, HP, IRIX, Linux, OSF, Solaris, ULTRIX

Windows servers: Exchange, DFS, (Active Directory)

AFS tested Database servers (15 now in TSM)

File backup today Incremental costs 860 CHF/1st yr/cpu (RMAN)

DFS test (1 server): Legato 65min, TSM 46min


14

Hardware expansionHardware expansion

Little or no extra cost Add ~800 3590E tapes (from HPSS), more needed later add more 3590E drives (2 more available now)

Additional TSM server Use old Legato E450 (expensive), or new machine Use existing 9840 drives & tapes (unsuitable for backup)

Long term server platform AIX or Solaris (linux supported recently)


15

Immediate PlanImmediate Plan

Replace old staging disks and increase Start AFS backup using TSM Move Legato clients into TSM

Nearly all are IT machines

Organise move of archived Legato data Run with current hardware for 2003

TSM to be run by new Operations Team

Review hardware in 2004


16

Future growth expectedFuture growth expected

AFS – 20% increase (COCOtime) < 1TB Windows ~ 20% est increase Small additional unix data Maybe 15 more databases ~ 10TB

Oracle physics dbs ~ 1TB each

Questions?Questions?

Backup Rationalisation Reorganisation of the CERN Computer Centre Backups David Asbury IT/DS Friday...

Documents

Transcript of Backup Rationalisation Reorganisation of the CERN Computer Centre Backups David Asbury IT/DS Friday...