MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For...

53
Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles (Chair) Dr. Christopher Allen Dr. Shannon Blunt

Transcript of MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For...

Page 1: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

Master’s Thesis Defense

Reduced Rank Filtering Techniques ForProcessing Multi-Aperture Radar

Peng Seng TanAugust 08, 2006

CommitteeDr. James Stiles (Chair)

Dr. Christopher AllenDr. Shannon Blunt

Page 2: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

2

OUTLINE

IntroductionThe Non-Uniformly Distributed Aperture Radar SystemThe Radar modelPrevious work done on Filtering TechniquesThesis motivation

The Reduced Rank Square Root Filter ApproachDesign and ImplementationChoice of criterion determinationDiscussion of Results

The Multi-Stage Wiener Filter ApproachDesign and ImplementationDiscussion of ResultsInnovative Implementations

Conclusions and Future work

Page 3: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

3

INTRODUCTION

With advance in technology, the modern concept is to go for distributed sensor collection and processing as compared to a single sensor system In most cases where the sensors are not fixed mounted to their location, distribution of the sensors’ locations is not uniformWhen using such a system, it also involves much more complex signal processing techniques to piece the data from different sensors into a complete pictureFor example, when using a Non-Uniformly Distributed Space borne Multiple Satellite System to collect SAR images, conventional processing technique like the Matched Filter will not function properly.Instead, a more complex technique is required in the form of theWiener or Minimum Mean Square Error (MMSE) Filter

Page 4: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

4

RADAR MODEL USED

Currently, as we do not have real data from a Non-Uniformly Distributed Aperture Radar System, a radar model is designed from Mathematical modeling and implemented using MATLAB

z

x

Non-Uniformly Distributed Aperture Radar System

Center of target area

Velocity vector vx of Radar

system

y

‘NY’ pixels

‘NX’ pixels

R0

h

y0

θi

Page 5: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

5

WIENER VERSUS MATCHED FILTER

When using the radar model to simulate a image collected, the ambiguity function obtained for each pixel is as shown on the rightIn such a situation, due to the various ambiguities present in the system, matched filter processing will yield degraded results even in the midst of no measurement noiseBased on work done by previous students, it is found that the MMSE filter will be able to provide a good answer even in low or moderate SNR situations

Page 6: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

6

EFFICIENT WIENER IMPLEMENTATION

As Wiener filter requires a computational expensive matrix inverse operation, thus it is possible to re-implement the filter in a recursive manner using the Kalman filterPrevious work by other students have proven the functionality of the Kalman filter and sample results are shown below

5 10 15 20 25 30

5

10

15

20

25

3070

80

90

100

110

120

130

140

150

160

170

5 10 15 20 25 30

5

10

15

20

25

3070

80

90

100

110

120

130

140

150

160

170

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1-45

-40

-35

-30

-25

-20

-15

-10

-5

0Performance of the Developed KF for KU image pixels

Fraction of Measurement vector processed ---->

Nor

mal

ized

MS

E (i

n dB

)---->

Numerical ComputationError Covariance Values

Input Image Output Image

MSE versus Data processed

Page 7: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

7

MOTIVATION OF THESIS

Although Kalman filter is efficient, it can suffer from instability as a result of finite machine precisionBesides Kalman filter, there are other filters that are more efficient than the full rank Wiener filter when these filters are implemented in reduced rank echelon formThus, the 1st research motivation is to find alternative filters type that are more robust than Kalman filter in situations of finite machine precision2nd research motivation is to implement these alternative filters in a manner such that they are more efficient than the Wiener filterThis give rise to the search for Reduced Rank Linear filtering Techniques in my thesis research

Page 8: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

8

OUTLINE

IntroductionThe Non-Uniformly Distributed Aperture Radar SystemThe Radar modelPrevious work done on Filtering TechniquesThesis motivation

The Reduced Rank Square Root Filter ApproachDesign and ImplementationChoice of criterion determinationDiscussion of Results

The Multi-Stage Wiener Filter ApproachDesign and ImplementationDiscussion of ResultsInnovation Implementations

Conclusions and Future work

Page 9: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

9

SQUARE ROOT COVARIANCE FILTER

Potter introduced the concept of Square Root Covariance filter (SRCF) in 1964 when dynamic driving noise is absent in the systemThe SRCF was developed for scalar measurement update implementation.The basic concept is to replace the propagation of the Error Covariance Matrix with its square root matrix instead where the relationship between the 2 matrices are as follows:

γK S

Hγ =K SS

In this manner, the positive semi-definiteness of the Error Covariance Matrix will be maintained in all iterationsHence, it will no longer suffer from instability problems

Page 10: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

10

POTTER’S SRCF MODEL

In Potter’s SRCF, the equations involved in each iteration step of the filter is shown belowAlso, Potter’s SRCF is a full rank filter just like the Kalman filter

H H

H 2

12 2

H

( ) ( / 1) ( )

1( )[ ( ) ( ) ( )]

1( )[1 { ( ) ( )} ]

( ) ( ) ( / 1) ( )

ˆ ˆ ˆ( / ) ( 1/ 1) ( )[ ( ) ( ) ( 1/ 1)]

ˆ( 1/ 1) ( ) ( )

( / ) ( / 1) ( ) ( ) ( )

l l l l

b ll l l

lb l l

l b l l l l

l l l l l r l l l l

l l l v l

l l l l l l l

σ

ησ

η

= −

=+

=+

= −

= − − + − − −

= − − +

= − −

n

n

a S p

a a

g S a

g p

g

S S g a

γ γ γ

γ

Page 11: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

11

Vector Format of SRCF

As Potter’s SRCF is using scalar measurement update which is not as efficient as a vector measurement update implementation, thus Andrew came up with the vector version of SRCF that is more efficient and it is defined as follows:

H H

H

1 H 1

1 H 1

1 H H

( ) ( / 1) ( )

( ) ( ) ( ) ( )

ˆ ˆ( / ) ( 1/ 1) ( / 1) ( )[ ( ) ] ( ) ( )

ˆ( 1/ 1) ( / 1) ( )[ ( ) ] ( ) ( )

( / ) ( / 1) ( / 1) ( )[ ( ) ] ( ) ( )] ( )

c

l l l l

l l l l

l l l l l l l l l l

l l l l l l l l

l l l l l l l l l l l

− −

− −

= −

= +

= − − + −

= − − + −

= − − − [ +

n

n

A S P

A A K

S A v

S A v

S S S A K A

Σ

γ γ Σ Σ

γ Σ Σ

Σ Σ

Both scalar and vector version of the SRCF are then executed in simulation runs so as to examine the results obtained

Page 12: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

12

RESULTS FROM SRCF

Using data from the radar model simulator, the results of both Potter and Andrew’s algorithm are plottedBoth SRCF filters are able to achieve identical performance in accuracy with Kalman filter but requires longer computational time

0 500 1000 1500 2000 2500 3000 3500-45

-40

-35

-30

-25

-20

-15

-10

-5

0Performance of the Potter SRCF for randomly chosen scattering coefficients

Number of iterations ---->

Nor

mal

ized

MS

E (i

n dB

)---->

Numerical ComputationError Covariance Values

0 500 1000 1500 2000 2500 3000 3500-45

-40

-35

-30

-25

-20

-15

-10

-5

0Performance of the Andrew SRCF Type 1 for randomly chosen scattering coefficients

Number of iterations ---->

Nor

mal

ized

MS

E (i

n dB

)---->

Numerical ComputationError Covariance Values

Page 13: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

13

REDUCED RANK SRCF (RRSQRT)

Since the full rank SRCF is not as efficient as Kalman filter, thus the reduced rank version of Andrew SRCF is implemented to tackle this issueRank reduction is achieved by discarding non dominant Eigen vectorsas the iteration proceeds alongHowever, we will need to determine the criterion to discard or keep the Eigen vectorsTwo approaches are attempted, 1st approach using just guesswork and 2nd approach based on the variation of the Eigen Spectrum of Error Covariance Matrix as the iteration proceedsResults obtained from guesswork are bad, therefore requiring the 2nd

approach to determine the criterion

Page 14: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

14

2ND APPROACH FOR RRSQRT CRITERION

This approach requires the Eigen Spectrum of the SRCF at variousstages of iteration to be make knownThe Eigen Spectrum for a sample measurement and target size are shown below

0 5 10 15 20 25 30 35 40 45 500

0.5

1

1.5

2

2.5Eigen Spectrum of Error Covariance Matrix

Eigen Number

Eig

en V

alue

0 % of iteration process0 5 10 15 20 25 30 35 40 45 50

0

0.5

1

1.5

2

2.5Eigen Spectrum of Error Covariance Matrix

Eigen Number

Eig

en V

alue

25 % of iteration process

Page 15: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

15

EIGEN SPECTRUM OF SRCF - CONTINUED

0 5 10 15 20 25 30 35 40 45 500

0.5

1

1.5

2

2.5Eigen Spectrum of Error Covariance Matrix

Eigen Number

Eig

en V

alue

0 5 10 15 20 25 30 35 40 45 500

0.5

1

1.5

2

2.5Eigen Spectrum of Error Covariance Matrix

Eigen Number

Eig

en V

alue

50 % of iteration process 62.5 % of iteration process

As seen below, the dominant Eigen vectors decreases as the iteration proceeds until all Eigen vectors become insignificantThis behavior is then used to develop the criterion for keeping the Eigen vectors in the iteration steps

Page 16: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

16

FINAL CRITERION FOR RRSQRT

Using the behavior of the SRCF Eigen Spectrum, the final criterion consists of 2 sub criterions shown below

% of initial Eigen Value used for Criteria 2

Step size in dB used for Criteria 1

4 8 12 16 20

0.001

0.01

0.05

0.1

0.5

1.0

4.0

Page 17: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

17

RESULTS FOR RRSQRT

The MSE and Timing results obtained for the RRSQRT using the 2 criterions are shown below for comparisons with the Kalman filter

S/N Description of Filter Time Final MSE

1 Kalman filter 37.206 sec -42.216 dB

% of initial Eigen Valueused for Criteria 2

Step size in dB used for Criteria 1

4 8 12 16 20

0.001 -42.216 dB / 961 -42.216 dB / 961 -42.216 dB / 961 -42.216 dB / 961 -42.216 dB / 961

0.01 -39.906 dB / 230 -40.649 dB / 245 -40.818 dB / 285 -41.210 dB / 313 -41.144 dB / 257

0.05 -32.726 dB / 26 -35.422 dB / 35 -36.855 dB / 54 -38.222 dB / 89 -38.148 dB / 40

49.500 sec49.748 sec47.052 sec46.594 sec48.978 sec0.05

57.667 sec58.405 sec60.305 sec64.331 sec78.994 sec0.01

96.552 sec95.145 sec120.879 sec168.691 sec289.275 sec0.001

20161284

Step size in dB used for Criteria 1% of initial Eigen Value used for Criteria 2

Page 18: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

18

3D PLOT OF RRSQRT RESULTS

05

1015

20 -30-20

-100

10

-50

-40

-30

-20

-10

0

Eigen Threshold (dB)

MSE obtained for RRSQRT versus the 2 criterions

Step Size (dB)

MS

E (d

B)

-40

-35

-30

-25

-20

-15

-10

-5

05

1015

20 -30-20

-100

100

200

400

600

800

1000

Eigen Threshold (dB)

Remaining Eigen vectors for RRSQRT versus the 2 criterions

Step Size (dB)

# of

Rem

aini

ng E

igen

vec

tors

100

200

300

400

500

600

700

800

900

0

5

10

15

20 -30-20

-100

10

0

100

200

300

Eigen Threshold (dB)

Computational Time required for RRSQRT versus the 2 criterions

Step Size (dB)

Tota

l Com

puta

tiona

l tim

e (s

ec)

50

100

150

200

250

Page 19: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

19

TIMING RESULTS W/O EIGEN OPERATION

% of initial Eigen Value used for Criteria 2

Step size in dB used for Criteria 1

4 8 12 16 20

0.001 289.275 sec 168.691 sec 120.879 sec 95.145 sec 96.552 sec

0.01 78.994 sec 64.331 sec 60.305 sec 58.405 sec 57.667 sec

0.05 48.978 sec 46.594 sec 47.052 sec 49.748 sec 49.500 sec

From investigation, the Eigen decomposition operation of the RRSQRT takes up a significant portion of the total computational timeIf this operation is ignored, the difference in the timing results are as shown below

28.562 sec28.857 sec26.521 sec25.734 sec24.203 sec0.05

34.432 sec35.264 sec34.945 sec34.894 sec35.367 sec0.01

53.348 sec52.691 sec58.097 sec63.785 sec80.454 sec0.001

20161284

Step size in dB used for Criteria 1% of initial Eigen Valueused for Criteria 2

Page 20: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

20

SUMMING UP RRSQRT

From the results obtained, it is shown that the RRSQRT is able to produce good estimation of the target pixels even when the rank is greatly reducedIf a faster method is available for performing the Eigen Decomposition operation, then this technique will be as computational efficient as the Kalman filter while not suffering from instability problems

Page 21: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

21

OUTLINE

IntroductionThe Non-Uniformly Distributed Aperture Radar SystemThe Radar modelPrevious work done on Filtering TechniquesThesis motivation

The Reduced Rank Square Root Filter ApproachDesign and ImplementationChoice of criterion determinationDiscussion of Results

The Multi-Stage Wiener Filter ApproachDesign and ImplementationDiscussion of ResultsInnovation Implementations

Conclusions and Future work

Page 22: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

22

MULTI-STAGE WIENER FILTER

Besides the RRSQRT filter, there is also another filter that is also found to be much more efficient than the Wiener filterThis filter was introduced in 1997 and is now gaining much popularity with the Communication and Radar communityIt is known as the Multi-Stage Wiener Filter (MSWF for short) based on orthogonal projectionsThis filter can be also implemented in a full rank or reduced rank manner. But it has been shown in various applications that it is able to achieve full rank performance even when implemented in reduced rank fashion

Page 23: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

23

MULTI-STAGE WIENER FILTER - CONT

The basic MSWF is used for estimating a scalar desired signal from a series of measurement data (called it scalar MSWF)It makes use of the cross correlation between the measurement data vector and the desired signal to project an initial estimate of the desired signal after the so called 1st stage of decompositionWhen there are correlations between the desired signal and the unwanted signals present in the measurement data, this 1st estimate will contain errorsThus, using a blocking matrix orthogonal to the cross correlation vector, a new measurement data and a new cross correlation vector is formed againThis action is then repeated at the 2nd stage of decomposition and so forth until the error in the final estimate is diminished to an acceptable value

Page 24: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

24

GRAPHICAL VISUALIZATION OF MSWF

Desired Signal

Signal estimate after 1st projection

Signal estimate after 2nd projection

Page 25: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

25

EQUATIONS OF SCALAR MSWF

Note that the MSWF consists of 3 main steps, namely the forward iteration step, turn-around step and the backward iteration stepThe equations for implementing the forward iteration step are shown

1 1 1 1

1 1

1

1

1

H

H1

2 H

1

H

{ }

=

i i i i

i i

i i

i i

i i i

i x d x d

x di

i

i i i

d i x i

i i

i i i

x i x i

x d i x i

d

null

δ

δ

σ

− − − −

− −

=

=

=

=

=

=

=

r rr

h

h x

h R h

B h

x B x

R B R B

r B R h

Page 26: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

26

RESULTS FROM SCALAR MSWF

The scalar MSWF is then implemented and run sequentially to estimate all the target pixels in the SAR image using 40 stages of decompositionThe final errors of the estimates using the scalar MSWF is then compared with that from the Kalman filter

55 60 65 70 75 80 85 90 95 1000

0.005

0.01

0.015

0.02

0.025

Target Number

Ste

ady

Sta

te E

rror M

agni

tude

Plot of Steady State Error versus Target Number for Kalman filter and MSWF

Steady State Error of KalmanSteady State Error of MSWF

755 760 765 770 775 780 785 790 795 8000

0.005

0.01

0.015

0.02

0.025

Target Number

Ste

ady

Sta

te E

rror M

agni

tude

Plot of Steady State Error versus Target Number for Kalman filter and MSWF

Steady State Error of KalmanSteady State Error of MSWF

Page 27: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

27

SUMMING UP SCALAR MSWF

From results obtained, the scalar MSWF is able to estimate the target pixels with as much accuracy as the Kalman filterFurthermore, the scalar MSWF only requires 40 stages of decomposition to achieve these results instead of full rank processing of 961 stagesThe computational time needed per target pixel is much lesser than that of the Wiener filterHowever, one undesirable feature is that it can only estimate 1 target pixel at a time, thus requires a long period to complete estimation of all target pixels if done in a serial manner, unless there are enough machines for parallel processingAnother weak point is that the processing of each target pixel also takes a longer time than the Kalman filter

Page 28: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

28

VECTOR MSWF

Therefore, these shortcomings necessitates the development of the vector version of the MSWF that can estimate more than 1 target pixel per target group at a timeNow, for the vector MSWF implementation, it can also be implemented by executing each group of targets in a serial manner for all targets or using parallel processing with 1 MSWF processor per target groupTherefore, both options are explored and results are presented for discussionNote that the Mean Square Error (MSE) obtained for both methods are identical for the same combination of number of targets per group versus stages of decomposition

Page 29: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

29

RESULTS OF MSE FOR VECTOR MSWF

0.1

1.0

10.0

100.0

05

1015

2025

-50

-40

-30

-20

-10

0

Tgt Group Size in % (logscale)

Average Expected MSE obtained for MSWF

Stages of Decomposition

MS

E (d

B)

-40

-35

-30

-25

-20

-15

-10

-5

Tgt Group Size in % (logscale)

Sta

ges

of D

ecom

posi

tion

Average Expected MSE (dB) obtained for MSWF

0.1 1.0 10.0 100.0

0

5

10

15

20

25-40

-35

-30

-25

-20

-15

-10

-5

Page 30: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

30

RESULTS OF EXECUTION TIME (PARALLEL)

0.11.0

10.0100.0

010

20

10

100

1000

10000

100000

Tgt Group Size in % (logscale)

Time (Parallel) in sec required for MSWF

Stages of Decomposition

Tim

e (P

aral

lel)

in s

ec (l

ogsc

ale)

40

100

398

1000

3980

Tgt Group Size in % (logscale)

Sta

ges

of D

ecom

posi

tion

Time (Parallel) in sec required for MSWF

0.1 1.0 10.0 100.0

0

5

10

15

20

25 40

100

398

1000

3980

Page 31: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

31

RESULTS OF EXECUTION TIME (SERIAL)

0.1

1.0

10.0

100.0

05

1015

202510

100

1000

10000

100000

Tgt Group Size in % (logscale)

Time (Serial) required for MSWF

Stages of Decomposition

Tim

e (S

eria

l) in

sec

(log

scal

e)

100

316

1000

3162

10000

31623

Tgt Group Size in % (logscale)

Sta

ges

of D

ecom

posi

tion

Time (Serial) in sec required for MSWF

0.1 1.0 10.0 100.0

0

5

10

15

20

25100

316

1000

3162

10000

31623

Page 32: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

32

OVERALL COMBINATION OF RESULTS

Tgt Group Size in % (logscale)

Sta

ges

of D

ecom

posi

tion

Average Expected MSE (dB) obtained for MSWF

0.1 1.0 10.0 100.0

0

5

10

15

20

25-40

-35

-30

-25

-20

-15

-10

-5

Tgt Group Size in % (logscale)

Sta

ges

of D

ecom

posi

tion

Time (Parallel) in sec required for MSWF

0.1 1.0 10.0 100.0

0

5

10

15

20

25 40

100

398

1000

3980

Tgt Group Size in % (logscale)

Sta

ges

of D

ecom

posi

tion

Time (Serial) in sec required for MSWF

0.1 1.0 10.0 100.0

0

5

10

15

20

25100

316

1000

3162

10000

31623

Page 33: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

33

SUMMING UP VECTOR MSWF

The vector MSWF is able to provide pixel estimates with the sameaccuracy as Wiener and Kalman filter using less than full rank processingSome combinations of target group size and stages of decomposition will require lesser computational time than Wiener filter with an efficiency ratio of up to 1.65For both parallel and serial method of implementation, putting all targets in one group and using 1 stage of decomposition currently provides the best deal in terms of computational time and accuracy of resultsHowever, this best deal is still not as efficient as that of Kalman filter. Therefore, will need to check whether the trend holds true for larger data set

Page 34: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

34

LARGER DATA SET

Next, the target size and the measurement size are each increased by about 4 timesThe results for the Wiener filter, Kalman filter and MSWF are shown below

0

2εσ

Filter Type Total Time /sec

Average/dB

Average Computed MSE /dB

Wiener 9349.3 -39.483 -39.439

Kalman 1192.1 -39.483 -39.439

MSWF 3432.5 -39.479 -39.439

We can see that the trend continues but MSWF’s edge over Wiener filter has increased significantly over the smaller data set from 1.65 to 2.72

Page 35: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

35

INNOVATIVE MSWF IMPLEMENTATIONS

We have observed that the MSWF is able to outperform the Wiener filter in terms of speed but it is not as efficient as Kalman filterTherefore, several variations are carried out to the standard implementation structure of the MSWFIt is hoped that some of these variations will be able to speed up the MSWF but at little or no cost to its accuracy obtained for the resultsThese approaches are termed as Innovative MSWF ImplementationsA total of 3 approaches are attempted

Page 36: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

36

MODIFIED DATA INITIALIZATION

In this approach, instead of using the same initial conditions for all target groups, the results of the 1st target group is used to fine tune the initial conditions of the 2nd target groupNext, the results of the 1st and 2nd target group are used to modify the initial condition of the 3rd target group and so forthThis form of initialization bears some similarity to the way the Kalman filter is being operated

Page 37: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

37

STRUCTURE OF MODIFIED INITIALIZATION

Full set ofMeasurement Data used for

MSWF processing

Initial Conditions for

Group #1

Start ofMSWF

processingfor

Target Group

#1

Start ofMSWF

processingfor

Target Group

#2 after processing Group #1

Start ofMSWF

processingfor

Target Group

#3 after processing Group #2

Start ofMSWF

processingfor

Target Group#J after

processing Group #J-1

…..

Final

Initial Conditions for

Group #2

Initial Conditions for

Group #J

Initial Conditions for

Group #3

0 0ˆ ,Kγγ 1 1ˆ ,Kγγ 2 2ˆ ,Kγγ j 1 j 1ˆ ,− Kγ −γ

ˆ,Kγγ

Page 38: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

38

RESULTS FOR MODIFIED DATA APPROACH

Using the modified initialization approach, the results obtained for a few target group sizes are obtained and shown below

0 2 4 6 8 10 12 14 16 18 20-45

-40

-35

-30

-25

-20

-15

-10

-5

0

Stages of Decomposition for MSWF

Ave

rage

Exp

ecte

d M

SE

(dB

)

Average Expected MSE of Target versus Stages of Decomposition

Avg Expected MSE of Group 1Avg Expected MSE of Group 20Avg Expected MSE of Group 30Avg Expected MSE of Group 40Avg Expected MSE of Group 48

Total # of groups = 48Group size = 20

1 2 3 4 5 6 7 8 9 10-45

-40

-35

-30

-25

-20

-15

-10

-5

Stages of Decomposition for MSWF

Ave

rage

Exp

ecte

d M

SE

(dB

)

Average Expected MSE of Target versus Stages of Decomposition

Avg Expected MSE of Group 1Avg Expected MSE of Group 3Avg Expected MSE of Group 5Avg Expected MSE of Group 8Avg Expected MSE of Group 9

Total # of groups = 10Group size = 100

1 2 3-45

-40

-35

-30

-25

-20

-15

-10

-5

Stages of Decomposition for MSWF

Ave

rage

Exp

ecte

d M

SE

(dB

)

Average Expected MSE of Target versus Stages of Decomposition

Avg Expected MSE of Group 1Avg Expected MSE of Group 2

Total # of groups = 2Group size = 480

Page 39: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

39

SUMMING UP MODIFIED DATA APPROACH

From the results obtained, we can see that the average number ofdecomposition stages required for any target group size decreases with the use of the modified data initialization approachAfter performing some computation and taking into account the overheads associated with this approach, the net gain in the efficiency is about 28%At the same time, there is no loss at all in the final results’ accuracyThus, this improvement is significant and this approach should be used whenever the serial MSWF implementation is chosen

Page 40: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

40

GROUPING TARGET BY CORRELATION

The 2nd approach is to group the targets together using their cross correlation to one other as a criteriaThe criteria can be to group targets based on their least correlation to one other or their highest correlation to one anotherThis grouping mechanism is applied before the start of the MSWF processing and can be applied to either serial MSWF implementation or parallel MSWF implementationBoth groupings based on least correlation and highest correlation are attempted

Page 41: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

41

STRUCTURE FOR TARGET GROUPING

Full set ofMeasurement Data used for

MSWF processing

Initial Conditions for all Target groups

Start ofMSWF

processingfor

Target Group

#1

Start ofMSWF

processingfor

Target Group

#2

Start ofMSWF

processingfor

Target Group

#3

Start ofMSWF

processingfor

Target Group

#J

…..

Final

Pre-Processing TaskUsing Grouping Scheme A to rearrange the targets

and the columns of the P matrix

0 0ˆ ,Kγγ

ˆ,Kγγ

Page 42: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

42

RESULTS FOR LEAST CORRELATION

0 5 10 15 20 25-45

-40

-35

-30

-25

-20

-15

-10

-5

0

Stages of Decomposition for MSWF

Targ

et E

xpec

ted

MS

E (d

B)

Expected MSE of Target versus Stages of Decomposition

Original Expected MSE of Grp 1 Tgt 1New Expected MSE of Grp 1 Tgt 1Original Expected MSE of Grp 48 Tgt 1New Expected MSE of Grp 48 Tgt 1

Total # of groups = 48Group size = 20

1 2 3 4 5 6 7 8 9 10-45

-40

-35

-30

-25

-20

-15

-10

-5

0

Stages of Decomposition for MSWF

Targ

et E

xpec

ted

MS

E (d

B)

Expected MSE of Target versus Stages of Decomposition

Original Expected MSE of Grp 1 Tgt 1New Expected MSE of Grp 1 Tgt 1Original Expected MSE of Grp 9 Tgt 1New Expected MSE of Grp 9 Tgt 1

Total # of groups = 10Group size = 100

1 2 3-45

-40

-35

-30

-25

-20

-15

-10

-5

0

Stages of Decomposition for MSWF

Targ

et E

xpec

ted

MS

E (d

B)

Expected MSE of Target versus Stages of Decomposition

Original Expected MSE of Grp 1 Tgt 1New Expected MSE of Grp 1 Tgt 1Original Expected MSE of Grp 2 Tgt 1New Expected MSE of Grp 2 Tgt 1

Total # of groups = 2Group size = 480

Page 43: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

43

RESULTS FOR HIGHEST CORRELATION

0 5 10 15 20 25-45

-40

-35

-30

-25

-20

-15

-10

-5

Stages of Decomposition for MSWF

Targ

et E

xpec

ted

MS

E (d

B)

Expected MSE of Target versus Stages of Decomposition

Original Expected MSE of Grp 1 Tgt 1New Expected MSE of Grp 1 Tgt 1Original Expected MSE of Grp 48 Tgt 1New Expected MSE of Grp 48 Tgt 1

Total # of groups = 48Group size = 20

1 2 3 4 5 6 7 8 9 10-45

-40

-35

-30

-25

-20

-15

-10

-5

Stages of Decomposition for MSWF

Targ

et E

xpec

ted

MS

E (d

B)

Expected MSE of Target versus Stages of Decomposition

Original Expected MSE of Grp 1 Tgt 1New Expected MSE of Grp 1 Tgt 1Original Expected MSE of Grp 5 Tgt 1New Expected MSE of Grp 5 Tgt 1Original Expected MSE of Grp 9 Tgt 1New Expected MSE of Grp 9 Tgt 1

Total # of groups = 10Group size = 100

1 2 3-45

-40

-35

-30

-25

-20

-15

-10

-5

Stages of Decomposition for MSWF

Targ

et E

xpec

ted

MS

E (d

B)

Expected MSE of Target versus Stages of Decomposition

Original Expected MSE of Grp 1 Tgt 1New Expected MSE of Grp 1 Tgt 1Original Expected MSE of Grp 2 Tgt 1New Expected MSE of Grp 2 Tgt 1

Total # of groups = 2Group size = 480

Page 44: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

44

SUMMING UP TARGET GROUPING

From the 2 trends observed, we can conclude that grouping targets that are highly correlated to one another into the same group will help to decrease the number of stages of decomposition requiredHowever, due to the imperfection of my grouping schemes, not all the targets are grouped based on this desired criteria and therefore no numerical figures are available to show the improvementNevertheless, with a robust grouping scheme, this approach should bear fruitful results

Page 45: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

45

RECURSIVE MSWF

Now, beside trying different approaches on the target space as in the last 2 approaches, we can also look into the measurement data space itselfDrawing inspiration from the Kalman filter which is a recursive Wiener filter, we can also implement the MSWF in a recursive fashion bybreaking up the total measurement data into smaller subsets and iteratively applying the MSWF on these data subsets.In this manner, it is hoped that computations involving smaller matrix dimensions in the forward iteration step will help to speed up the MSWF execution

Page 46: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

46

STRUCTURE OF RECURSIVE MSWF

Measurement datasubset 1

Measurement datasubset 2

Initial Conditions for all Target groups

Start ofMSWF

processingfor

Target Group#1

Start ofMSWF

processingfor

Target Group#2

Start ofMSWF

processingfor

Target Group#3

Start ofMSWF

processingfor

Target Group#J

…..

Initial Conditions for all Target groups

Start ofMSWF

processingfor

Target Group#1

Start ofMSWF

processingfor

Target Group#2

Start ofMSWF

processingfor

Target Group#3

Start ofMSWF

processingfor

Target Group#J

…..

Final

0 0ˆ ,Kγγ

11 11ˆ ,Kγγ

ˆ,Kγγ

Page 47: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

47

SETUP FOR RECURSIVE MSWF

Now, to examine the performance of the recursive MSWF, various measurement subset and target group sizes are chosen so as to get a good picture of this approachThe combination used in the simulation is as shown

Measurements per subset

Number of subsets

Target Group size = 961

Target Group size = 480

Target Group size = 320

Target Group size = 160

2856 1 √ √ √ √

1428 2 √ √ √ √

714 4 Χ √ √ √

476 6 Χ Χ √ √

Note that some combinations are not achievable because of the vector MSWF constraints

Page 48: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

48

RESULTS FOR RECURSIVE MSWF

Results obtained for the recursive MSWF are encouraging and somecombination is able to achieve faster computational time with no loss of results’ accuracyThe results for the recursive parallel MSWF is shown here Measurements persubset

Number ofsubsets

Target Group size = 961

Target Group size = 480

Target Group size = 320

Target Group size = 160

2856 1 113.203 sec 241.112 sec 222.498 sec 215.547 sec

1428 2 103.735 sec 151.110 sec 130.548 sec 103.331 sec

714 4 Χ 78.728 sec 69.301 sec 54.669 sec

476 6 Χ Χ 43.549 sec 37.560 sec

Measurements per

subset

Number ofsubsets

Target Group size = 961

Target Group size = 480

Target Group size = 320

Target Group size = 160

2856 1 -41.037 dB -41.037 dB -41.037 dB -41.037 dB

1428 2 -41.037 dB -39.880 dB -39.350 dB -38.959 dB

714 4 Χ -37.093 dB -34.392 dB -30.052 dB

476 6 Χ Χ -25.015 dB -21.524 dB

Page 49: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

49

SUMMING UP RECURSIVE MSWF

Implementing the MSWF as a recursive filter seems to be a good approach for both the parallel and serial MSWF implementationWith certain combinations of measurement data subset and target group size, we can get improvements in the computational speed by up to 100% with little loss in accuracyThis ability to process new data iteratively also makes the MSWF to be more attractive than the Wiener filter

Page 50: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

50

OUTLINE

IntroductionThe Non-Uniformly Distributed Aperture Radar SystemThe Radar modelPrevious work done on Filtering TechniquesThesis motivation

The Reduced Rank Square Root Filter ApproachDesign and ImplementationChoice of criterion determinationDiscussion of Results

The Multi-Stage Wiener Filter ApproachDesign and ImplementationDiscussion of ResultsInnovation Implementations

Conclusions and Future work

Page 51: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

51

CONCLUSIONS

We are able to successfully implement Reduced Rank Filtering Techniques for the Non-Uniformly Distributed Aperture Radar System that are faster in execution than the Wiener filter while achieving the same accuracy in the final resultsWith a more efficient Eigen Decomposition engine, the RRSQRT filter will be able to match or exceed the computational speed of the Kalman filter while avoiding the Kalman filter’s pitfall of divergence or instability issueIt has been shown that the Multi-Stage Wiener filter is able to achieve the same accuracy as the Wiener filter but requiring lesser rank in the filter processingAlthough the MSWF is not as fast as the Kalman filter, innovative implementations will help to narrow the gap between the two filters

Page 52: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

52

FUTURE WORK

For the RRSQRT filter, we can look into faster ways to compute the Eigen Decomposition as compared to the existing function in MATLABWe can also design some target scenarios where it is possible to start the RRSQRT filter processing with a smaller rank that will speed up its subsequent iteration processFor the MSWF, we can also look into a more optimal grouping scheme for the targets such that the deficiencies in the current scheme can be corrected and then use the optimal scheme for implementationWe can also look into alternative model of the MSWF that is moresimple than the current MSWF model that is based on orthogonal projections. For example, one alternative model will be the Conjugate Gradient MSWF model

Page 53: MS Thesis Defense - KU ITTC · Master’s Thesis Defense Reduced Rank Filtering Techniques For Processing Multi-Aperture Radar Peng Seng Tan August 08, 2006 Committee Dr. James Stiles

53

QUESTIONS

THANK YOU