Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband...
-
date post
20-Dec-2015 -
Category
Documents
-
view
218 -
download
2
Transcript of Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband...
![Page 1: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/1.jpg)
Statistical Modelling of Internet Traffic
Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information
NetworksElectrical and Electronic Engineering Dept.,
The University of Melbourne
![Page 2: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/2.jpg)
Outline
Comparison with road traffic
Macroscopic traffic information
Microscopic traffic modelling
Single server queue insights – link utilization
Implications for future developments
![Page 3: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/3.jpg)
Disclaimer• I will represent views and conclusions from an
academic traffic modelling point of view.• The conclusions are optimistic and rosy from the traffic
perspective.• They do not consider: cyber terrorism, Denial of
Service attacks, viruses, disasters, hardware or software failures, or any other practical possible event(s) that may lead to network bottlenecks or congestion.
• All these are issues related to important telecommunications research topics but are beyond the scope of this talk.
![Page 4: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/4.jpg)
New Jersey Traffic and Teletrafficists
![Page 5: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/5.jpg)
Similarity between road and Internet traffic
• Network should be designed to meet the traffic demands.
• Congestion leads to delays and unsatisfied customers with impact on the economy.
• Infrastructure is expensive especially for a large country like Australia.
![Page 6: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/6.jpg)
Some differences between road and Internet traffic
• Loss and collisions are not viable options in road traffic. Internet messages are lost and retransmitted all the time.
• Vehicles move in different speeds leading to inefficiencies.
• To increase capacity in roads there is a need to widen or add roads. For Internet this can be done without touching the fiber in the ground.
• Size of Internet messages are significantly more variable than those of vehicles.
• Internet traffic growth has been much much stronger than road traffic growth.
![Page 7: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/7.jpg)
Moore’s Law
• Moore's Law: power and speed of computers will double every 18-24 months.
• Internet backbone traffic grew from 1 Tbit/sec = 1 million million bits per second in 1990 to 3,000 Tbit/sec in 1997.
• Number of Internet hosts more than doubled every year for the last 20 years.
![Page 8: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/8.jpg)
![Page 9: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/9.jpg)
Macroscopic Approach:
Multi Hour Traffic Matrixgives you, for every origin-destination pair,
the total traffic within every relevant time
interval (e.g. every hour).
![Page 10: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/10.jpg)
Physical versus Logical Network
B
A
M
S
Physical Network
A M
B S
Logical Network
![Page 11: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/11.jpg)
Example for the use of multi hour traffic data
Physical NetworkLogical Network
L T
NY
C
C
C
L T
NY
2C
2C
2C
Assume each city is asleep in a different 8 hour period, when T is asleep, all the traffic between NY and L goes through T.
![Page 12: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/12.jpg)
Packet Switching versus Circuit Switching
Circuit Switching: exclusive capacity end-to- endexample: telephone network (organize ) Packet Switching: store and forwardexample: Internet (very massy, but has its benefits)
![Page 13: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/13.jpg)
Internet – A Network of Queues
![Page 14: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/14.jpg)
Microscopic Approach
Focuses on statistical characteristics of traffic streams.
For example, what are the statistical characteristics of arrival times of Internet packets in a certain Internet router on a certain link.
There may be thousands or even millions of these packets arriving within a second.
![Page 15: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/15.jpg)
Single Server Queue
Input Buffer (waiting room) Server Output
Two key contrasting performance measures:1. Utilization2. Queueing delay(Packet loss is translated to delay or to quality.)
![Page 16: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/16.jpg)
Single Server Queue
Input Buffer (waiting room) Server Output
Utilization = Proportion of time the server is Busy, or ratio between work processed and server capacity; measure for system efficiency.
The aim is to maximize utilization subject to meeting queueing delay (and loss) requirements.
![Page 17: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/17.jpg)
Single Server Queue
Input Buffer (waiting room) Server Output
Utilization = Proportion of time the server is Busy, or ratio between work processed and server capacity; measure for system efficiency.
The aim is to maximize utilization subject to meeting queueing delay (and loss) requirements.
![Page 18: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/18.jpg)
I have been waiting for 40 minutes!!
Well, this is because we had too many calls
come in.
![Page 19: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/19.jpg)
An Example
Input Buffer (waiting room) Server Output
Consider an Internet service provider (ISP)with 1000 customers, each transmit at a rate of one million bits per second (1 Mbit/s) a 1/3 of the time and is idle 2/3 of the time. What is the minimal capacity you need so that
no more than 1/1,000,000th of the time queueing delay is more than one second?
1000sources
![Page 20: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/20.jpg)
An Example (cont.)
Input Buffer (waiting room) Server Output
The answer should be between the MEAN (333.33 Mbit/sec) and the PEAK (1000 Mbit/sec). To give a better answer we need traffic modelling.
1000sources
![Page 21: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/21.jpg)
An Example (cont.)
Input Buffer (waiting room) Server Output
If Server capacity = MEAN (333.33 Mbit/sec) then Utilization = 1. If Server capacity = PEAK (1000 Mbit/sec) then Utilization = 1/3.
1000sources
![Page 22: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/22.jpg)
An Example (cont.)
Input Buffer (waiting room) Server Output
It is unlikely that we need the peak – right?It is unlikely that all 1000 sources will need their
1 Mb at a random point in time – the probability of this event is 1/(31000), so to guarantee that no more than 1 out of 1,000,000 will be lost or suffer delay of more than a second we can do with probably way less than service capacity of 1000 Mbit/sec.
1000sources
![Page 23: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/23.jpg)
Another Example
Input Buffer (waiting room) Server Output
Now we know we need the peak – right?It is more likely that all 3 sources will need their 1
Mb at a random point in time – the probability of this event is 1/27, so to guarantee that no more than 1 out of 1,000,000 will be lost or suffer delay of more than a second, we must have service capacity of 3 Mbit/sec. In this case, the utilization is 1/3.
3sources
![Page 24: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/24.jpg)
Multiplexing Gain
Input Buffer (waiting room) Server Output
nsources
From these examples, we see that the more sources we have, the higher is the utilization we can achieve. This is called “Multiplexing Gain” and it is similar to Economy of Scale.
![Page 25: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/25.jpg)
Multiplexing Gain (continued)
Input Buffer (waiting room) Server Output
nsources
We have developed a traffic model using AT&T Internet traffic measurements taken in 1998. And we computed the required capacity for queueing probability of 1/1000000. This gives us the Utilization. We consider growth predictions and data, and we obtained the following graphs.
![Page 26: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/26.jpg)
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
0 100 200 300 400 500
Number of streams, M
Uti
lizat
ion
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
0 100 200 300 400 500
Number of streams, M
Uti
lizat
ion
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
0 100 200 300 400 500Number of streams, M
Uti
liza
tio
n
More efficient Internet in the future
![Page 27: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/27.jpg)
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
0 100 200 300 400 500
Number of streams, M
Uti
lizat
ion
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
0 100 200 300 400 500
Number of streams, M
Uti
lizat
ion
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
0 100 200 300 400 500Number of streams, M
Uti
liza
tio
n
More efficient Internet in the future
2005 2006 2007 Year
![Page 28: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/28.jpg)
“Bell Labs Internet traffic discovery could point the way to more efficient networks”
FOR RELEASE WEDNESDAY JUNE 06, 2001
http://www.lucent.com/press/0601/010606.bla.html
![Page 29: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/29.jpg)
MURRAY HILL, N.J. - A recent discovery by researchers at Bell Labs, the R&D arm of Lucent Technologies (NYSE: LU), sheds new light on the nature of Internet traffic and could lead to more efficient routers and other network components. Using sophisticated new software programs to analyze and simulate data traffic in unprecedented detail, the researchers found that the "burstiness" seen in traffic at the edges of the Internet disappears at the core.
Their surprising discovery - that traffic on heavily loaded, high-capacity network links is unexpectedly regular - may point the way to more efficient system and network designs with better performance at lower cost.
![Page 30: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/30.jpg)
At the edge of this desert of bursty traffic which we have been traversing, while the communication infrastructure of the third millennium is put in place, there sits, just on the horizon, a land of milk and honey – the realm of integrated multi-service networks, in which all services receive good service, despite the high utilization levels on all links … and the reason things are so good in this realm is that the traffic there is Gaussian!
(Gaussian = bell shaped = smooth)
R. Addie, M. Zukerman, T. Neame, Broadband Traffic modeling: simple solutions to hard problems, IEEE Comm. Magazine, August 1998.
![Page 31: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/31.jpg)
150 Mbit/sec
frequency
Bit rate
1000 Mbit/sec
Bursty traffic
![Page 32: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/32.jpg)
850 Mbit/sec
frequency
Bit rate1000 Mbit/sec
Smooth traffic
![Page 33: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/33.jpg)
It’s all about using the scraps!
Bursty traffic = low utilization and bad service
Smooth traffic = high utilization and good service
time
time
![Page 34: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/34.jpg)
Test for consideration of new switching technologies
If your network already runs on high utilization, and provides good quality of service, do not “fix” it!!
![Page 35: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/35.jpg)
Things get even better!
• Input rate Average delay = Average queue size Or • Average delay = Average queue size/ Input rate• Average queue size depends on the ratio of: Input rate/ output rate Thus, • Scaling upwards improves the delay!!!!
Input Buffer (waiting room) Server Output
![Page 36: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/36.jpg)
The New Technological Concept:Optical Packet Switching
• Packet Switching but without buffers;• Packets cannot be delayed along the way.• Delay is possible at the edges. • Something between packet switching and
circuit switching.• Can it use significantly more of the scraps
than circuit switching?
![Page 37: Statistical Modelling of Internet Traffic Presenter: Moshe Zukerman ARC Centre for Ultra Broadband Information Networks Electrical and Electronic Engineering.](https://reader036.fdocuments.net/reader036/viewer/2022062714/56649d4d5503460f94a2c259/html5/thumbnails/37.jpg)
Conclusion:
Two reasons for Performance improvement:
1. More sources - traffic becomes smoother.2. Scaling reduces delay.