Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems...
-
Upload
trinity-glass -
Category
Documents
-
view
221 -
download
4
Transcript of Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems...
![Page 1: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/1.jpg)
Random ProcessesRandom ProcessesIntroduction Introduction (2)(2)
Professor Ke-Sheng ChengProfessor Ke-Sheng ChengDepartment of Bioenvironmental Systems Department of Bioenvironmental Systems EngineeringEngineering
E-mail: [email protected]
![Page 2: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/2.jpg)
Stochastic continuity
![Page 3: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/3.jpg)
![Page 4: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/4.jpg)
![Page 5: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/5.jpg)
![Page 6: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/6.jpg)
![Page 7: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/7.jpg)
![Page 8: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/8.jpg)
Stochastic Convergence A random sequence or a discrete-time random
process is a sequence of random variables {X1(), X2(), …, Xn(),…} = {Xn()}, .
For a specific , {Xn()} is a sequence of
numbers that might or might not converge. The notion of convergence of a random sequence can be given several interpretations.
![Page 9: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/9.jpg)
Sure convergence (convergence everywhere)
The sequence of random variables {Xn()} converges surely to the random
variable X() if the sequence of functions Xn() converges to X() as n for all
, i.e.,
Xn() X() as n for all .
![Page 10: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/10.jpg)
![Page 11: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/11.jpg)
![Page 12: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/12.jpg)
Almost-sure convergence (Convergence with probability 1)
![Page 13: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/13.jpg)
![Page 14: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/14.jpg)
Mean-square convergence
![Page 15: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/15.jpg)
Convergence in probability
![Page 16: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/16.jpg)
![Page 17: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/17.jpg)
Convergence in distribution
![Page 18: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/18.jpg)
Remarks Convergence with probability one applies
to the individual realizations of the random process. Convergence in probability does not.
The weak law of large numbers is an example of convergence in probability.
The strong law of large numbers is an example of convergence with probability 1.
The central limit theorem is an example of convergence in distribution.
![Page 19: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/19.jpg)
Weak Law of Large Numbers (WLLN)
![Page 20: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/20.jpg)
Strong Law of Large Numbers (SLLN)
![Page 21: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/21.jpg)
The Central Limit Theorem
![Page 22: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/22.jpg)
Venn diagram of relation of types of convergence
Note that even sure convergence may not imply mean square convergence.
![Page 23: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/23.jpg)
Example
![Page 24: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/24.jpg)
![Page 25: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/25.jpg)
![Page 26: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/26.jpg)
![Page 27: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/27.jpg)
Ergodic Theorem
![Page 28: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/28.jpg)
![Page 29: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/29.jpg)
![Page 30: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/30.jpg)
The Mean-Square Ergodic Theorem
![Page 31: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/31.jpg)
The above theorem shows that one can expect a sample average to converge to a constant in mean square sense if and only if the average of the means converges and if the memory dies out asymptotically, that is , if the covariance decreases as the lag increases.
![Page 32: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/32.jpg)
Mean-Ergodic Processes
![Page 33: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/33.jpg)
Strong or Individual Ergodic Theorem
![Page 34: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/34.jpg)
![Page 35: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/35.jpg)
![Page 36: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/36.jpg)
Examples of Stochastic Processes
iid random process A discrete time random process {X(t), t = 1, 2, …} is said to be independent and identically distributed (iid) if any finite number, say k, of random variables X(t1), X(t2), …, X(tk) are mutually independent and have a common cumulative distribution function FX() .
![Page 37: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/37.jpg)
The joint cdf for X(t1), X(t2), …, X(tk) is
given by
It also yields
where p(x) represents the common probability mass function.
)()()(
,,,),,,(
21
221121,,, 21
kXXX
kkkXXX
xFxFxF
xXxXxXPxxxFk
)()()(),,,( 2121,,, 21 kXXXkXXX xpxpxpxxxpk
![Page 38: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/38.jpg)
![Page 39: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/39.jpg)
Random walk process
![Page 40: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/40.jpg)
Let 0 denote the probability mass
function of X0. The joint probability of
X0, X1, Xn is
)|()|()(
)()()(
)()()(
,,,
),,,(
10100
10100
101100
101100
1100
nn
nn
nnn
nnn
nn
xxPxxPx
xxfxxfx
xxPxxPxXP
xxxxxXP
xXxXxXP
![Page 41: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/41.jpg)
)|(
)|()|()(
)|()|()|()(
),,,(
),,,,(
),,,|(
1
10100
110100
1100
111100
110011
nn
nn
nnnn
nn
nnnn
nnnn
xxP
xxPxxPx
xxPxxPxxPx
xXxXxXP
xXxXxXxXP
xXxXxXxXP
![Page 42: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/42.jpg)
The property
is known as the Markov property.
A special case of random walk: the Brownian motion.
)|(),,,|( 1110011 nnnnnnnn xXxXPxXxXxXxXP
![Page 43: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/43.jpg)
Gaussian process A random process {X(t)} is said to be a
Gaussian random process if all finite collections of the random process, X1=X(t1), X2=X(t2), …, Xk=X(tk), are jointly Gaussian random variables for all k, and all choices of t1, t2, …, tk.
Joint pdf of jointly Gaussian random variables X1, X2, …, Xk:
![Page 44: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/44.jpg)
![Page 45: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/45.jpg)
Time series – AR random process
![Page 46: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/46.jpg)
The Brownian motion (one-dimensional, also known as random walk)
Consider a particle randomly moves on a real line.
Suppose at small time intervals the particle jumps a small distance randomly and equally likely to the left or to the right.
Let be the position of the particle on the real line at time t.
)(tX
![Page 47: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/47.jpg)
Assume the initial position of the particle is at the origin, i.e.
Position of the particle at time t can be expressed as where are independent random variables, each having probability 1/2 of equating 1 and 1.
( represents the largest integer not exceeding .)
0)0( X
]/[21)( tYYYtX
,, 21 YY
/t/t
![Page 48: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/48.jpg)
Distribution of X(t)
Let the step length equal , then
For fixed t, if is small then the distribution of is approximately normal with mean 0 and variance t, i.e., .
]/[21)( tYYYtX
)(tX
tNtX ,0~)(
![Page 49: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/49.jpg)
Graphical illustration of Distribution of X(t)
Time, t
PDF of X(t)
X(t)
![Page 50: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/50.jpg)
If t and h are fixed and is sufficiently small then
httt
httt
tht
YYY
YYY
YYYYYYtXhtX
2
]/)[(2]/[1]/[
]/[21]/)[(21)()(
![Page 51: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/51.jpg)
Distribution of the displacement
The random variable is normally distributed with mean 0 and variance h, i.e.
)()( tXhtX
)()( tXhtX
duh
u
hxtXhtXP
x
2exp
2
1)()(
2
![Page 52: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/52.jpg)
Variance of is dependent on t, while variance of is not.
If , then ,
are independent random variables.
)(tX
)()( tXhtX
mttt 2210 )()( 12 tXtX
,),()( 34 tXtX )()( 122 mm tXtX
![Page 53: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/53.jpg)
t
X
![Page 54: Random Processes Introduction (2) Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering E-mail: rslab@ntu.edu.tw.](https://reader033.fdocuments.net/reader033/viewer/2022061306/55147f2c550346ea6e8b48a6/html5/thumbnails/54.jpg)
Covariance and Correlation functions of )(tX
t
YYYE
YYYYYYYYYE
YYYYYYE
htXtXEhtXtXCov
t
httttt
htt
2
21
2121
2
21
2121
)()()(),(
htt
t
htt
htXtXCov
htXtXCorrel
)(),(
)(),(