Esnet Atlas Tier2

download Esnet Atlas Tier2

of 17

Transcript of Esnet Atlas Tier2

  • 7/27/2019 Esnet Atlas Tier2

    1/17

    ATLAS Tier 2 Paths WithinESnet

    Mike OConnor

    ESnet Network Engineering Group

    Lawrence Berkeley National Lab

    [email protected]

  • 7/27/2019 Esnet Atlas Tier2

    2/17

    ATLAS Tier 2 Connectivity Typical ATLAS tier 2 site connectivity

    should be via Abilene and ESnet in orderto reach Brookhaven Lab.

    ESnets Goal is that DOE Lab Univ.connectivity should be as good as Lab

    Lab and Univ. Univ.W. E. Johnston

  • 7/27/2019 Esnet Atlas Tier2

    3/17

    ATLAS Tier 2 Support The role of ESnet is to provide networking that supports and

    anticipates the needs of the Office of Science Labs and their

    collaborators.

    ESnet support for ATLAS tier 2 site connectivity makes highbandwidth and fault tolerant paths between BNL and Abilene anabsolute priority.

    Planning is underway to upgrade BNLs ESnet OC48 circuit to amulti 10G lambda fault tolerant Metropolitan Area Network (MAN).(Targeted for Q1 2006)

    Today ESnet and Abilene peer in Atlanta, Chicago, New York andSunnyvale with a combined bandwidth of 18.2Gbps.These fourlocations comprise a high bandwidth and fault tolerant interconnectbetween these two networks.

  • 7/27/2019 Esnet Atlas Tier2

    4/17

  • 7/27/2019 Esnet Atlas Tier2

    5/17

    ESnet & Abilene Peering points

    *paths do not include all router hops**Example si te logos chosen at random.

  • 7/27/2019 Esnet Atlas Tier2

    6/17

    Abilene Interior Gateway Protocol (IGP) mileage basedmetrics determine the best exit path toward the ESnet.This common method also known as hot potato routing

    it will always compute an exit path to the nearest peeringpoint.

    Abilene Routing Toward ESnet

  • 7/27/2019 Esnet Atlas Tier2

    7/17

    ESnet Routing Toward Abilene

    Abilene Multi Exit Discriminators (MEDs) are used by ESnetto choose the best exit path toward Abilene. These MEDs arebased on the same IGP metrics used in the interior of their

    network. This creates a symmetric path back to Abilene.

  • 7/27/2019 Esnet Atlas Tier2

    8/17

    32 Avenue Of the Americas NYC

    ESnet

    PeeringRouter

    MANLAN

    ESnet CoreAOA (NYC)

    Abilene

    OC48DC

    OC192CHI

    1GE

    10GE

    10GE

    2GE

    Peerings@MANLANnysernet 3754abilene 11537sinet 2907geant 20965

    BNLOC48

    The MANLAN peering is the primary path from ESnet to Abilene atAOA. The directly connected 1Gbps peering is a secondary

    failover connection.

  • 7/27/2019 Esnet Atlas Tier2

    9/17

    Chicago

  • 7/27/2019 Esnet Atlas Tier2

    10/17

    Current Load in Chicago

  • 7/27/2019 Esnet Atlas Tier2

    11/17

    Sunnyvale & Atlanta

    ESnet and Abilene have direct OC48 peerings in Atlanta

    GA and Sunnyvale CA.

    ESnet CoreSunnyvale CA

    Abilene

    OC192

    CHI

    OC48

    ESnet CoreAtlanta GA

    Abilene

    OC48

    OC48

    DC

    OC48

    El PasoTX

    OC48

  • 7/27/2019 Esnet Atlas Tier2

    12/17

    Future DirectionsLong Island MAN Ring

    ESnet Lambda Infrastructure

  • 7/27/2019 Esnet Atlas Tier2

    13/17

    MANLANAbilene

    GEANT

    Manhattan Long IslandIP Coreto Chicago

    IP Core to DC

    111th & 8 th

    BNL

    60 Hudson

    32 AOA

    2 SDN/circuit

    1 production IP

    10 Gb/soptical

    channels

    2 s (10 G circuits)delivered as two 10GigEther circuits

    -8 X current BNL

    bandwidthPhysically diverse fiberpaths forming a ringtopology.

    Will be used as a10 Gb/sproduction IP and a10 Gb/spath for SDN circuitservices

    Services switch over to the

    other service path during acircuit failure.

    ESnet LI MAN Ring

    Circuits based onWDM rings

    *SDN Science Data Network

  • 7/27/2019 Esnet Atlas Tier2

    14/17

    ESnet 2010 Lambda Infrastructure and LHC T0-T1 Networking

    Denver

    Seattle

    Sunnyvale

    LA

    San Diego

    Chicago

    Pitts

    Raleigh

    Jacksonville

    At lanta

    KC

    Baton Rouge

    El Paso -Las Cruces

    Phoenix

    Pensacola

    Dallas

    San Ant .Houston

    Albuq. Tulsa

    New YorkClev

    Boise

    CE

    RN-1

    GANT-1

    GANT-2

    Wash DC

    CERN-2

    Tier 1 Centers

    ESnet IP core hubs

    New hubs

    ESnet SDN/NLR hubsESnet Production IP core (10-20 Gbps)ESnet Science Data Network core (10G/link)(incremental upgrades, 2007-2010)Other NLR linksCERN/DOE supplied (10G/link)International IP connections (10G/link)

    Cross connects with Internet2/Abilene

    NLR PoPs

    TRIUMF

    FNAL

    BNL

    CERN

    -3

    Vancouver

    Toronto

    CANARIE

  • 7/27/2019 Esnet Atlas Tier2

    15/17

    Conclusions

    ESnet provides an infrastructure and servicesthat are critical to ATLAS science

    ESnet is well positioned to provide essential

    network services to the LHC tier 2 community ESnet is working on providing the DOE

    mission science networking requirements with

    several new initiatives and a new architecture

  • 7/27/2019 Esnet Atlas Tier2

    16/17

  • 7/27/2019 Esnet Atlas Tier2

    17/17