“ Xrootd ” Storage

29

description

“ Xrootd ” Storage. Some new directions From the xrootd and Scalla perspective In the ALICE Computing Fabrizio Furano CERN IT/GS 11-July-08 http://savannah.cern.ch/projects/xrootd http://xrootd.slac.stanford.edu. Outline. So many new directions Designers and users unleashed fantasy - PowerPoint PPT Presentation

Transcript of “ Xrootd ” Storage

Page 1: “ Xrootd ” Storage
Page 2: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 2

Page 3: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 3

Page 4: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 4

Page 5: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 5

Page 6: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 6

Page 7: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 7

Page 8: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 8

Page 9: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 9

Page 10: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 10

Pre-xferdata

“locally”

Pre-xferdata

“locally”

Legacyremoteaccess

Legacyremoteaccess

Remoteaccess+Remoteaccess+Data

Processing

Data access

OverheadNeed for

potentiallyuseless replicas

And a hugeBookkeeping!

OverheadNeed for

potentiallyuseless replicas

And a hugeBookkeeping!

LatencyWasted CPU

cyclesBut easy

to understand

LatencyWasted CPU

cyclesBut easy

to understand

Interesting!Efficientpractical

Interesting!Efficientpractical

Page 11: “ Xrootd ” Storage

ApplicationApplication

11-July-2008Fabrizio Furano - Data access and Storage: new directions 11

Client1Client1

ServerServer

Client2Client2

Client3Client3

TCP (control)

Clients still seeOne Physical

connection perserver

Clients still seeOne Physical

connection perserver

TCP(data)

Async datagets

automaticallysplitted

Async datagets

automaticallysplitted

Page 12: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 12

Page 13: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 13

Page 14: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 14

Page 15: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 15

Page 16: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 16

Page 17: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 17

cmsdcmsd

xrootdxrootdPragueNIHAM

… any other

cmsdcmsd

xrootdxrootd

CERN

cmsdcmsd

xrootdxrootd

ALICE global redirector (alirdr)all.role meta managerall.manager meta alirdr.cern.ch:1312root://alirdr.cern.ch/root://alirdr.cern.ch/

IncludesIncludesCERN, GSI, and othersCERN, GSI, and others

xroot clustersxroot clusters

Meta Managers can be geographically

replicatedCan have several in different places for region-aware load

balancing

cmsdcmsd

xrootdxrootd

GSIall.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312all.role manager all.role manager all.role manager

Page 18: “ Xrootd ” Storage

cmsdcmsd

xrootdxrootd

GSI

11-July-2008Fabrizio Furano - Data access and Storage: new directions 18

cmsdcmsd

xrootdxrootd PragueNIHAM

… any othercmsdcmsd

xrootdxrootd

CERN

cmsdcmsd

xrootdxrootd

ALICE global redirector

all.role meta managerall.manager meta alirdr.cern.ch:1312

all.role manager all.role managerall.role manager

But missing a file?Ask to the global metamgr

Get it from any othercollaborating cluster

all.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312

Local clients worknormally

Page 19: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 19

Page 20: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 20

Page 21: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 21

Page 22: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 22

Page 23: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 23

Page 24: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 24

Page 25: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 25

Page 26: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 26

Page 27: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 27

Page 28: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 28Courtesy of Gerardo Ganis (CERN PH-SFT)

Page 29: “ Xrootd ” Storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 29Courtesy of Gerardo Ganis (CERN PH-SFT)