iGrid2005 Cyber-infrastructure

iGrid 2005 Cyber-InfrastructureFeb. 27 2006 -

ON*VECTOR Photonics Workshop

iGrid2005 Cyber-infrastructure

Paola Grosso

GigaPort projectUvA



Outline

The question:iGrid showed impressive science that used a custom

built network.What happened behind the scenes to make it happen?

With some background information: What is iGrid and how it has evolved.What is this optical networking about.

The answer:Where, who and how the iGrid 2005 infrastructure

took shape.



What is iGrid?

The official web sites www.igrid2005.org contains the mission statement:

the 4th community-driven biennial International Grid event, is a coordinated effort to accelerate the use of multi-10Gb international and national networks, to advance scientific research, and to educate decision makers, academicians and industry researchers on the benefits of these hybrid networks.

Three key points:

- community driven- multi-10Gb networks- hybrid networks



History of previous iGrids

The themes were already there from the beginning…

iGrid1998: Empowering Global Research Community NetworkingApplications and technologies depend on end-to-end delivery

of multi-tens-of-megabits bandwidth with quality of service control, and need the capabilities of emerging Internet protocols for resource control and reservation.

iGrid2000: An International Grid Application Research Demonstration at INET2000Demonstrate how the power of todays’ research networks

enables access to remote computing resources, distribution of digital media, and collaboration with distant collegues.

iGrid2002: The International Virtual LaboratoryDemonstrate application demand for increased bandwidth.



Lambda networking

The iGrid2005 cyber-infrastructure provided a lambda networking facility to demonstrators.

In the scientific arena, lambda networking indicates: - use of different light wavelengths (i.e. light paths) to

provide independent services over the same strand of optical fiber

- creation of dedicated and application-specific paths

Main lambda networking characteristics of the iGrid setup:- broad international connectivity- large available bandwidth- (user driven) light path provisioning- reconfigurable and flexible setup



Where and when?

The event took place:in the CalIT2 building in the UCSD campus in San

Diego;between Sep. 26-29 September 2005.

Challenge: the building inauguration had not yet taken place:

the network was built while the building was being finished up.



What and who?

There were two main activities: demonstrations and symposium sessions.

Over 300 participants …plus the committee members.

Demonstrations

A global effort:

- 49 demonstrations;- 12 countries as main demo contacts;- 20 participating countries;- 4 continents.

Symposium

In the auditorium:

- 6 keynote speakers;- 12 panels sessions;- 3 master classes.



Demonstrations types

A closer look at the demonstrations types:

- Data Services: 7 demos- E-Science: 4 demos- Lambda Services: 10 demos- Scientific Instrument Services: 3 demos- Supercomputing Services: 3 demos- Video Streaming Services: 5 demos- Visualization Services: 17 demos



How?

… thanks to the effort of:- 16 sponsors- 38 organizing institutions- 15 organizing committee members - 10 subcommittees

On the cyber-infrastructure side:- Cyber-infrastructure CalIT2 Co-Chairs and

Committee members- Cyber-infrastructure Int’l/National Co-Chairs

and Committee members



Demos requirements

The guiding principle: ask what they want, and sometimes tell them what they

need.

A questionnaire that tried to understand the demos’ needs for:

- On-site computers, data storage and visualization displays

- Remote computers and storage- Software- Special-purpose equipment- Audio- Networking topology



Demo stations

The demos were distributed across 4 spaces:

TeraScale Room

Cave Room

Multipurpose Room

Auditorium

3 demo stations:

Rice: 2-Panel display

Goodhue: 2-Panel Display

Quin: 4-Panel display

3 demo stations:

Couts: C-Wall

Spreckels: 100 Mpixel

Bushyhead: 3D Auto-stereo

2 demo stations:

Sessions: Stereo

Projection

Bandini: Side-by-side

Proj.

..plus Research Channel

2 demo stations:

Swing:Sony 4K

Projections

Harrison: Side-by-side Projection



Onsite resources

Two of the jewels:

Tiled Display: 11x5 tiled display of NEC 20” 1600x1200 LCD panels

Sony 4k Projection



Onsite resources (II)Another way to look at it:

24 10GE ports:- 5 interfaces for common infrastructure equipment:

3 x10GE nodes, 2 x 10GE ports for HP switch used for the Tiled Display in Spreckels

- 19 interfaces for demonstrator equipment, network switches and nodes

11 1GE fiber ports:- 11 to demonstrator equipment, network switches and nodes

53 1GE copper ports:- 19 for common infrastructure equipment- 34 for demonstrators equipment



SunLight

To satisfy the needs of the demos: SunLight, the optical exchange built for iGrid at CalIT2.

Ingredients:- Lots (lots!) of planning.

- Committees members met several times before the workshop time

- Network equipment donated by vendors:- Cisco, Force10, Nortel primarily

- Setup in the weeks preceding the workshop- Circuits delivery and installation



SunLight (II)

ConnectionsTo CAVEwave

To outside resources

ConnectionsTo Tiled Display

ConnectionsTo SDSC T320

ConnectionsTo local hosts



CiscoONS 15454

Optical switch

To outside resources

NortelOME 6500Optical switch

NortelHDXc

Optical switch

Force10E1200

Ethernet switch

Cisco 6509Ethernet switch

Cisco 7609Ethernet switchHP

Ethernet switch

ch1

ch4

ch3

ch2



External connectivity

From SunLight:10 x 10gbps = 100gbps available to the

demonstrators.(Side note: during iGrid2002 it was 1 x 10GE)

Some paths to be mentioned:CaveWave link to Chicago, used for many of the

visualization demos.

Layer1 circuits - few. Layer2 circuits - the majority.Layer3 circuits - for the routed connectivity.



Layer1/2 int’l connectivity



Layer1/2 int’l connectivity (II)

An international effort to reach the demonstrators’ countries:Asia - China, Korea, Japan, TaiwanNorth America - Canada, Mexico, USEurope - Czech Republic, Netherlands, Poland, Spain, UK

A central role played by the various optical exchanges:PacificWave in SeattleKRLight in SeoulT-LEX in TokyoStarLight/TransLight in ChicagoMANLAN in New YorkNetherLight in AmsterdamUKLight in LondonCZLight in PragueNorthernLight in Stockholm

… all part of the GLIF.The GLIF meeting followed iGrid



Layer3 infrastructure



Routing

Did I hear well?…Not surprising: routing is a component in hybrid

networks.

Routing needed:

Internet connectivity to demonstrators, via commodity peering from UCSD and connection to major NRENs;

Demos using Layer3 paths via NRENs;

Routing in SunLight to direct multiple demos to shared resources , for example to Tiled Display.



The NOC

Committee members and vendor engineers provided the NOC support during the workshop.

The NOC:- setup the infrastructure: racking, pulling fibers- configure the equipment- provide continuing support to the demonstrators

The biggest challenge:- automatic versus manual configuration.- scheduling of common links

Missing: the user/application _really_ configuring the light paths. Not all demos were “NOC-independent” after the kick-off.



Light paths

What is in a name?

For every demonstrator light paths meant something else:

- optical path without L2 or L3 services;- L2 path over completely dedicated circuits,

with possible need for scheduling;- L2 path over shared link (coexisting demos);- Mix of L3 and L2 features.

For each demo the NOC needed to do the “translation” among the various meaning.



“Dutch” lightpaths

An easy way to see this: 4 demos with a Dutch label NL101,NL102, NL103, NL104…

NL101/2VM Turntable,Token-based network element access control and path selection

NL103IPv4 Link-local addressingfor optical networks

NL104Dead cat demo

Effort?…Medium. VLAN configurationDifficult when L2 is multi-domain

Effort?…Low. Routing doesIt all but performance

Needs to be tuned.

Effort?…High.

AMS

CHI

SAN

AMS

RoutedInternet

SAN

VLAN NL103

VLAN NL103CaveWave link

IRNC link

AMS

CHINY

SAN

SEA



Just after iGrid: SC05

Using the experience gained in September, many tried again.



Lessons learned1. It was a lot of work, but the achievements were rewarding.2. Global lambdas are a reality and a need.3. The community is focusing on the tools for automatic

engineering and setup needed on hybrid networks.

Submitted an article on the topic:The network infrastructure at iGrid2005: lambda networking in

action - Paola Grosso, Pieter de Boer and Linda Winkler.

iGrid2005 Cyber-infrastructure

Documents

Transcript of iGrid2005 Cyber-infrastructure