Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America...

36
Measurement and Monitoring Yasuichi Kitmaura ([email protected]) Takatoshi Ikeda ([email protected]) 2009624日水曜日

Transcript of Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America...

Page 1: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Measurement and Monitoring

Yasuichi Kitmaura ([email protected])Takatoshi Ikeda ([email protected])

2009年6月24日水曜日

Page 2: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Who are we?

2009年6月24日水曜日

Page 3: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Yasuichi Kitamura

researcher of National Institute of Information and Communications Technology (NICT) since 1989

operator of Asia-Pacific Advanced Network (APAN) Tokyo XP from 1996 to 1999

NOC team of APAN since 1996

2009年6月24日水曜日

Page 4: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Takatoshi Ikeda

visiting researcher of NICT

researcher of KDDI laboratory

operator of KDDI Ootemachi Technical Center

operator of APAN Tokyo XP

Precise Introduction will be done later.

2009年6月24日水曜日

Page 5: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Why do you have to monitor the network?

2009年6月24日水曜日

Page 6: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Why do you have to monitor the network?

Technical reasons

Political reasons

2009年6月24日水曜日

Page 7: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Technical reasons

Everyone wants to use their networks comfortable.

Some applications show the communication performance.

Sometimes, everyone can feel the communication performance isn’t good without reasons.

2009年6月24日水曜日

Page 8: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Political reasons

Circuit utilization has to be reported to the administrators.

At the demonstration by the administrators...

Against the communication failure, the current status should be monitored.

Some administrators want to know “its” communication performance later.

2009年6月24日水曜日

Page 9: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

my experience

2009年6月24日水曜日

Page 10: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

I was planning to hold the video conference between South Korea and Japan.1Gbps direct connection was running between South Korea and Japan.The regular round trip time was 80ms.

my office

Conference place

2009年6月24日水曜日

Page 11: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

The RTT was much longer than usual.One way route from my office to the conference place was in the strange thing. Maybe the reverse route looked strange. Because the video conference quality was really bad.

2009年6月24日水曜日

Page 12: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

This case happened just after TEIN”2” started.

All NOCS of R&E networks believed they kept the close relationship with others, but it was not true.

This case happened at the specific IP address block in Korea only.

2009年6月24日水曜日

Page 13: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

This could be avoided by the continuous active measurement, but it’s not the realistic solution.

To detect this bad route, it took 30 minutes because everyone believed JP and KR was connected directly. They didn’t expect such the detour route.

2009年6月24日水曜日

Page 14: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Active Measurement and Passive Measurement

2009年6月24日水曜日

Page 15: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Active Measurement

The method of measuring the circuit performance

The test traffic is its core element.

Some tools try to give the high load to the target circuits.

iperf, traceroute, ping, ....

2009年6月24日水曜日

Page 16: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Passive Measurement

The tool for monitoring the current status of the circuits

In general, capturing packets is its main concept.

The monitoring machine

Processes of capturing packets causes the high load to the machine.

The way of getting the real communication performance is its issue.

ftp, recent web browsers, polycom, ...

2009年6月24日水曜日

Page 17: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Precise discussion will be done by Mr. Ikeda.

2009年6月24日水曜日

Page 18: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Issues of monitoring

2009年6月24日水曜日

Page 19: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Active Measurement

Measurement actions are treated as the attacks.

Your traffic might be filtered. (worst case)

Secure active measurement tools require the collaborators. (ttcp, iperf, ...)

Because of the security reasons, some network equipments don’t show the precise information even if it’s against RFC.

2009年6月24日水曜日

Page 20: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Passive Measurement

You can capture the packets just near you.

You will have to get the permission of monitoring the remote place.

exchange points

far away places

2009年6月24日水曜日

Page 21: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

For your reference

2009年6月24日水曜日

Page 22: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Our target is Research and Education network (R&E network).

There are some National Research and Education networks (NRENs).

2009年6月24日水曜日

Page 23: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

none-profit network

The network is operated by the R&E network staff.

The routing control is based just on Access Users Policy (AUP). No contracts.

Each NOC can control the routing with thinking both of the bandwidth and of the delay.

R&E network

2009年6月24日水曜日

Page 24: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

In old days, R&E networks were in the hierarchical structure.

NRENs were collected at the International RENs.

International RENs are connected at their international exchange points.

International routes and domestic routes were separated.

2009年6月24日水曜日

Page 25: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Network Research Workshop APAN Xi’An Meeting August 27th, 2007

Pre-1999 International

Connection Model

APAN Abilene GEANT CLARA

AsiaNet A

AsiaNet B

USNet A

USNet B

EuroNet A

EuroNet A

LatinNet A

LatinNet B

18

2009年6月24日水曜日

Page 26: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

When the next generation Internet projects started, some NRENs had already their own international circuits.

These days, NRENs are connected with the multiple regional international RENs.

2009年6月24日水曜日

Page 27: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Network Research Workshop APAN Xi’An Meeting August 27th, 2007

Post-1999 International

Connection Model

Abilene

APAN

SINET

JGN2

CH

LA

NY

LA

NY

KREONET2

CHST

GLORIAD

CH

RBNETCSTNET

155M

1G

1G

1G

10G

10G

10G2.5G

2G

10G

10GCERNET

1G

TWAREN

622MNY

1G

CH

ST LA

1G

1G

1G

SV

1G

2.5G

GEANT

NY

DC

CLARA

622M

10G

10G

LA

1G

155M

622M

155M

19

2009年6月24日水曜日

Page 28: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

At the hierarchical period, the length of AS paths showed the distance of the connection.

These days, the length of AS paths does not show the best routes.

structure of RENs

L2 services (VLAN, DCN, VPN...)

2009年6月24日水曜日

Page 29: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

South east Asia status

Some area has the multiple international REN connection. (AI3, TEIN3,...)

Some area has their own international connection. (TH, SG,...)

Available bandwidth depends on the routes in some area. (TH, PH, ....)

2009年6月24日水曜日

Page 30: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

2009年6月24日水曜日

Page 31: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

2

AU

CN

HK

ID

JP

KR

MY

PH

SG EU

EU

TH

VN

North America

*

IN

LK

PK

AF

NP BT

BD

LA

KH

10 Mbps155 Mbps2.5 Gbps

1 Gbps622 Mbps

TEIN3 PoPs

TEIN3 NOC

2 Number of Links

* SingAREN connected to TEIN3 SG PoP at 45 Mbps

HARNET connected to TEIN3 HK PoP at 18 Mbps

LA Laos

MY Malaysia

PH The Philippines

VietnamVN

ThailandTH

SG Singapore

KoreaKR

JapanJP

IndonesiaID

ChinaCN

AustraliaAU

TEIN3 Project Partners

NP Nepal

KH Cambodia

PK Pakistan

LK Sri LankaIndiaIN

BangladeshBD

AfghanistanAF

BhutanBT

TEIN3 Candidate Countries

a

b

c

d

e

fg

h

i

j

k

Link Ownersa

b

c

d

e

f

h

i

j

k

g

The research and education network for Asia-Pacific

Linking Asia-Pacific to Europe and beyond

TEIN3 is co-funded by the European Commission through the EuropeAid Co-operation Office www.tein3.net

This map has been produced with the financial assistance of the European Union. The contents of this document are the sole responsibility of DANTE and can under no circumstances be regarded as reflecting the position of the European Union.

TEIN3 is receiving generous support from

TEIN3 Backbone Topology March 2009

2009年6月24日水曜日

Page 32: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

2009年6月24日水曜日

Page 33: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

This map can show you the bird’s eye view of the international connection.

Because of AUP, this map is showing just the possibility of the connection.

In case of violating the AUP, NOCs will have to have the discussion at the case.

This is the different point between R&E networks and commercial networks.

2009年6月24日水曜日

Page 34: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

What will you learn here?

2009年6月24日水曜日

Page 35: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Active measurement tools and passive measurement tools

Some of you might use them already.

perfSONAR

monitoring management tool

measurement actions are authorized.

monitoring the remote places is possible.

2009年6月24日水曜日

Page 36: Measurement and Monitoring · 2011-04-01 · 2 AU CN HK ID JP KR MY PH SG EU EU TH VN North America * IN LK PK AF NP BT BD LA KH 10 Mbps 2.5 Gbps 155 Mbps 1 Gbps 622 Mbps TEIN3 PoPs

Summary

Monitoring is very important to detect your NREN’s status.

Collaboration of monitoring will solve your problem much faster.

Human network is very important, but the automatic monitoring system can avoid the time difference.

2009年6月24日水曜日