GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.

GridPP Meeting, Cambridge, 14 Feb 2002Paul Mealor, UCL

Networking

Paul Mealor


DataGrid WP7

• Meetings:– Amsterdam, November– Bologna, Jan

• Deliverables, reports– D7.2– QoS


Deliverable 7.2Demonstration of enhanced monitoring

tools• Delivered

• PingER, RTPL, IperfER, UDPmon, MapCenter, RIPE NCC Test Traffic Measurements

• LDAP Publication

• Future: Prediction and forecasting; NetSaint


Monitoring tools - EDG-PingER

• Available in TB1 v1

• Modification of PingER– PingER used extensively in HEP community

• Measures RTT, Loss (and therefore connectivity)

• Centrally configured



• Configuration system– On install: sends Franck Bonnassieux an email– Every night, cron job gets an individual

configuration file from ccwp7.in2p3.fr– Consultation between WP7 and local sysadmin– Easy way to set up all network monitoring

hosts



Apachecgi-binscripts log files

ping scripts cron


Monitoring tools

• EDG-IperfER– Based on PingER– Measures TCP throughput

• UDPmon– Based on PingER– Measures UDP Ping and 1-way loss; calculates

throughput


Monitoring tools - UDPmon

Zero stats OK done

Get remote statistics

Send statistics

Send data frames atregular intervals

Time to send Time to receive

Inter-packet time


Monitoring tools - RTPL

• Remote throughput, ping, load

• Tests are made between pairs of machines

• Centrally controlled

• Results presented using Java applets


Monitoring tools - MapCenter

• Provides various views showing the connectivity of various nodes on the Grid


Monitoring tools - website

• http://ccwp7.in2p3.fr/

• Links to other monitoring tools (MapCenter, RIPE NCC, NetSaint, RTPL)

• Links to sites with WP7’s monitoring tools installed - 9 with PingER so far


Monitoring tools - NetSaint

• A thing “to do” in D7.2


Monitoring tools - others

• Other systems under consideration are– RIPE NCC Test Traffic Measurements– Surveyor– NIMI– MRTG– Traceping– Netflow and cflowd– NWS


Publication of monitoring data - LDAP

• LDAP backend script to publish data from PingER– Available with TB1– Part of the standard WP3 information system– Script is installed using an extra RPM– Slow-burning update cycle

• Extra information providers for RTPL and NWS on their way


Publication of monitoring data - LDAP

• How it looksMds-Vo-Name=ucl,Mds-Vo-Name=uk,Mds-Vo-Name=datagrid,o=grid

in=netmon

netmonrou=netmon.rl.ac.uk

rou=netmon.dl.ac.uk

netmontool=pinger

netmonpacketsize=256 netmonpacketsize=512


Publication of monitoring data - R-GMA

• Relational implementation of the grid monitoring architecture

• Under development

• WP7 is the first real user of it

• Seems to be far better suited to publishing network monitoring data than the LDAP tree structure


Publication of monitoring data - R-GMA

• Much to decide– schemas, what to publish, where, how

CE

CE

SE SE

NM

GridFTP logging

Monitoring

GridFTP logging

SE/CE/NM associations

Archiver

Archiver

Archiver

SELECT nm1.rtt, cenm.ceid, cenm.ceidFROM nm nm1, nm nm2, cenm, senmWHERE cenm.nmid=nm1.nmidAND senm.nmid=nm2.nmidAND nm1.othernm=nm2.nmidAND mm1.rtt<100


Other Stuff

• Gigabit ethernet performance measurements– characterisation of NICs, Richard Hughes-

Jones

UDP Alteon

0

100

200

300

400

500

600

700

800

900

1000

0 5 10 15 20 25 30 35 40

Transmit Time per frame us

Rec

v W

ire

rate

Mb

its/

s

50 bytes 100 bytes 200 bytes 400 bytes 600 bytes 800 bytes 1000 bytes 1200 bytes 1400 bytes 1472 bytes

UDP Intel Pro/1000 board: 370DLE

0

100

200

300

400

500

600

700

800

900

1000

0 5 10 15 20 25 30 35 40


Rec

v W

ire

rate

Mb

its/

s


UDP SysKonnect

0

100

200

300

400

500

600

700

800

0 5 10 15 20 25 30 35 40


Rec

v W

ire

rate

Mb

its/

s



Other stuff

• Tests of scavenger mode (DiffServ / QoS)– Cern External Network Division

• Tests of TCP in high-bandwidth situations– Antony Antony

• Tests of various other hardware– Routers and switches and things

• Security (will be D7.5)


END

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.

Documents

Transcript of GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.