“ Xrootd ” Storage
description
Transcript of “ Xrootd ” Storage
11-July-2008Fabrizio Furano - Data access and Storage: new directions 2
11-July-2008Fabrizio Furano - Data access and Storage: new directions 3
11-July-2008Fabrizio Furano - Data access and Storage: new directions 4
11-July-2008Fabrizio Furano - Data access and Storage: new directions 5
11-July-2008Fabrizio Furano - Data access and Storage: new directions 6
11-July-2008Fabrizio Furano - Data access and Storage: new directions 7
11-July-2008Fabrizio Furano - Data access and Storage: new directions 8
11-July-2008Fabrizio Furano - Data access and Storage: new directions 9
11-July-2008Fabrizio Furano - Data access and Storage: new directions 10
Pre-xferdata
“locally”
Pre-xferdata
“locally”
Legacyremoteaccess
Legacyremoteaccess
Remoteaccess+Remoteaccess+Data
Processing
Data access
OverheadNeed for
potentiallyuseless replicas
And a hugeBookkeeping!
OverheadNeed for
potentiallyuseless replicas
And a hugeBookkeeping!
LatencyWasted CPU
cyclesBut easy
to understand
LatencyWasted CPU
cyclesBut easy
to understand
Interesting!Efficientpractical
Interesting!Efficientpractical
ApplicationApplication
11-July-2008Fabrizio Furano - Data access and Storage: new directions 11
Client1Client1
ServerServer
Client2Client2
Client3Client3
TCP (control)
Clients still seeOne Physical
connection perserver
Clients still seeOne Physical
connection perserver
TCP(data)
Async datagets
automaticallysplitted
Async datagets
automaticallysplitted
11-July-2008Fabrizio Furano - Data access and Storage: new directions 12
11-July-2008Fabrizio Furano - Data access and Storage: new directions 13
11-July-2008Fabrizio Furano - Data access and Storage: new directions 14
11-July-2008Fabrizio Furano - Data access and Storage: new directions 15
11-July-2008Fabrizio Furano - Data access and Storage: new directions 16
11-July-2008Fabrizio Furano - Data access and Storage: new directions 17
cmsdcmsd
xrootdxrootdPragueNIHAM
… any other
cmsdcmsd
xrootdxrootd
CERN
cmsdcmsd
xrootdxrootd
ALICE global redirector (alirdr)all.role meta managerall.manager meta alirdr.cern.ch:1312root://alirdr.cern.ch/root://alirdr.cern.ch/
IncludesIncludesCERN, GSI, and othersCERN, GSI, and others
xroot clustersxroot clusters
Meta Managers can be geographically
replicatedCan have several in different places for region-aware load
balancing
cmsdcmsd
xrootdxrootd
GSIall.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312all.role manager all.role manager all.role manager
cmsdcmsd
xrootdxrootd
GSI
11-July-2008Fabrizio Furano - Data access and Storage: new directions 18
cmsdcmsd
xrootdxrootd PragueNIHAM
… any othercmsdcmsd
xrootdxrootd
CERN
cmsdcmsd
xrootdxrootd
ALICE global redirector
all.role meta managerall.manager meta alirdr.cern.ch:1312
all.role manager all.role managerall.role manager
But missing a file?Ask to the global metamgr
Get it from any othercollaborating cluster
all.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312
Local clients worknormally
11-July-2008Fabrizio Furano - Data access and Storage: new directions 19
11-July-2008Fabrizio Furano - Data access and Storage: new directions 20
11-July-2008Fabrizio Furano - Data access and Storage: new directions 21
11-July-2008Fabrizio Furano - Data access and Storage: new directions 22
11-July-2008Fabrizio Furano - Data access and Storage: new directions 23
11-July-2008Fabrizio Furano - Data access and Storage: new directions 24
11-July-2008Fabrizio Furano - Data access and Storage: new directions 25
11-July-2008Fabrizio Furano - Data access and Storage: new directions 26
11-July-2008Fabrizio Furano - Data access and Storage: new directions 27
11-July-2008Fabrizio Furano - Data access and Storage: new directions 28Courtesy of Gerardo Ganis (CERN PH-SFT)
11-July-2008Fabrizio Furano - Data access and Storage: new directions 29Courtesy of Gerardo Ganis (CERN PH-SFT)