Source Localization on a budget Volkan Cevher [email protected] Rice University Petros RichAnna Martin...
-
Upload
charlene-carroll -
Category
Documents
-
view
226 -
download
0
Transcript of Source Localization on a budget Volkan Cevher [email protected] Rice University Petros RichAnna Martin...
![Page 1: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/1.jpg)
Source Localizationon a budget
Volkan Cevher
[email protected] University
Petros Rich Anna Martin Lance
![Page 2: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/2.jpg)
Localization Problem
• Goal: Localize targetsby fusing measurementsfrom a network of sensors
[Cevher, Duarte, Baraniuk; EUSIPCO 2007| Model and Zibulevsky; SP 2006| Cevher et al.; ICASSP 2006| Malioutov, Cetin, and Willsky; IEEE TSP, 2005| Chen et al.; Proc. of IEEE 2003]
![Page 3: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/3.jpg)
Localization Problem
• Goal: Localize targetsby fusing measurementsfrom a network of sensors
– collect time signal data– communicate signals across
the network– solve an optimization
problem
![Page 4: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/4.jpg)
Digital Revolution
• Goal: Localize targetsby fusing measurementsfrom a network of sensors
– collect time signal data– communicate signals across
the network– solve an optimization
problem
<>
![Page 5: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/5.jpg)
Digital Data Acquisition
Foundation: Shannon/Nyquist sampling theorem
time space
“if you sample densely enough (at the Nyquist rate), you can perfectly reconstruct the original analog data”
![Page 6: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/6.jpg)
Major Trends in Sensing
higher resolution / denser sampling
large numbers of sensors
increasing # of modalities / mobility
![Page 7: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/7.jpg)
• Goal: Localize targetsby fusing measurementsfrom a network of sensors
– collect time signal data requires potentially
high-rate (Nyquist)sampling
– communicate signalsacross the network potentially large
communicationburden
– solve an optimizationproblem e.g., MLE
Need compression
Problems of the Current Paradigm
![Page 8: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/8.jpg)
Approaches
• Do nothing / Ignore
be content with the existing approaches
– generalizes well
– robust
![Page 9: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/9.jpg)
Approaches
• Finite Rate of Innovation
Sketching / Streaming
Compressive Sensing
[Vetterli, Marziliano, Blu; Blu, Dragotti, Vetterli, Marziliano, Coulot; Gilbert, Indyk, Strauss, Cormode, Muthukrishnan; Donoho; Candes, Romberg, Tao; Candes, Tao]
![Page 10: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/10.jpg)
Approaches
• Finite Rate of Innovation
Sketching / Streaming
Compressive Sensing
PARSITY
![Page 11: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/11.jpg)
Agenda
• A short review of compressive sensing
• Localization via dimensionality reduction
– Experimental results
• A broader view of localization
• Conclusions
![Page 12: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/12.jpg)
A Short Review of Compressive Sensing
Theory
![Page 13: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/13.jpg)
Compressive Sensing 101
• Goal: Recover a sparse orcompressible signal from measurements
• Problem: Randomprojection not full rank
• Solution: Exploit the sparsity / compressibilitygeometry of acquired signal
![Page 14: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/14.jpg)
• Goal: Recover a sparse orcompressible signal from measurements
• Problem: Randomprojection not full rankbut satisfies Restricted Isometry Property (RIP)
• Solution: Exploit the sparsity / compressibility geometry of acquired signal
– iid Gaussian– iid Bernoulli– …
Compressive Sensing 101
![Page 15: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/15.jpg)
• Goal: Recover a sparse orcompressible signal from measurements
• Problem: Randomprojection not full rankbut satisfies Restricted Isometry Property (RIP)
• Solution: Exploit the sparsity / compressibility geometry of acquired signal
via convex optimization or greedy algorithm
– iid Gaussian– iid Bernoulli– …
Compressive Sensing 101
![Page 16: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/16.jpg)
• Sparse signal: only K out of N coordinates nonzero
– model: union of K-dimensional subspacesaligned w/ coordinate axes
Concise Signal Structure
sorted index
![Page 17: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/17.jpg)
• Sparse signal: only K out of N coordinates nonzero
– model: union of K-dimensional subspaces
• Compressible signal: sorted coordinates decay rapidly to zero
well-approximated by a K-sparse signal(simply by thresholding)
sorted index
Concise Signal Structure
power-lawdecay
![Page 18: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/18.jpg)
Restricted Isometry Property (RIP)• Preserve the structure of sparse/compressible signals
• RIP of order 2K implies: for all K-sparse x1 and x2
K-planes
![Page 19: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/19.jpg)
Restricted Isometry Property (RIP)• Preserve the structure of sparse/compressible signals
• Random subGaussian (iid Gaussian, Bernoulli) matrix has the RIP with high probability if
K-planes
![Page 20: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/20.jpg)
Recovery Algorithms
• Goal:given
recover
• and convex optimization formulations– basis pursuit, Dantzig selector, Lasso, …
• Greedy algorithms– orthogonal matching pursuit,
iterative thresholding (IT), compressive sensing matching pursuit (CoSaMP)
– at their core: iterative sparse approximation
![Page 21: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/21.jpg)
Performance of Recovery
• Using methods, IT, CoSaMP
• Sparse signals
– noise-free measurements: exact recovery – noisy measurements: stable recovery
• Compressible signals
– recovery as good as K-sparse approximation
CS recoveryerror
(METRIC)
signal K-termapprox error
noise
![Page 22: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/22.jpg)
Universality
• Random measurements can be used for signals sparse in any basis
![Page 23: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/23.jpg)
Universality
• Random measurements can be used for signals sparse in any basis
![Page 24: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/24.jpg)
Universality
• Random measurements can be used for signals sparse in any basis
sparsecoefficient
vector
nonzeroentries
![Page 25: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/25.jpg)
![Page 26: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/26.jpg)
Signal recovery is not always required.
ELVIS:
Enhanced Localization via Incoherence and Sparsity
(Back to Localization)
![Page 27: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/27.jpg)
An Important Detail
• Solve two entangled problems for localization
– estimate source locations
– estimate source signals
![Page 28: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/28.jpg)
Today
• Instead, solve one localization problem
– estimate source locations by exploiting random projections of
observed signals– estimate source signals
![Page 29: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/29.jpg)
ELVIS
• Instead, solve one localization problem
– estimate source locations by exploiting random projections of
observed signals– estimate source signals
• Bayesian model order selection & MAP estimation in a decentralized sparse approximation framework that leverages
– source sparsity
– incoherence of sources
– spatial sparsity of sources
[VC, Boufounos, Baraniuk, Gilbert, Strauss; IPSN’09]
![Page 30: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/30.jpg)
Problem Setup
• Discretize space into a localization grid withN grid points
– fixes localization resolution
– P sensors do not have tobe on grid points
![Page 31: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/31.jpg)
Localization as Sparse Approximation
localizationgrid
actual sensormeasurements true
targetlocation
local localizationdictionary
![Page 32: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/32.jpg)
Multiple Targets
localizationgrid
actual sensormeasurements 2 true
targetlocations
![Page 33: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/33.jpg)
Local Dictionaries
• Sample sparse / compressible signal using CS
– Fourier sampling [Gilbert, Strauss]
• Calculate at sensor i using measurements
– for all grid positionsn=1,…,N:
assume that target is at grid position n
– for all sensors j=1,…,P: use Green’s function to
estimate signal sensor j would measure if target was at position n
![Page 34: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/34.jpg)
Valid Dictionaries • S.A. works when columns of
are mutual incoherent
• True when target signal has fast-decaying autocorrelation
• Extends to multiple targets with small cross-correlation
![Page 35: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/35.jpg)
Typical Correlation FunctionsToyota Prius
Isuzu Rodeo
Chevy Camaro
ACF: Toyota Prius
ACF: Isuzu Rodeo
ACF: Chevy Camaro
CCF: Rodeo vs. Prius
CCF: Rodeo vs. Camaro
CCF: Camaro vs. Prius
![Page 36: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/36.jpg)
An Important Issue
localizationgrid
actual sensormeasurements
Need to sendacross
the network
![Page 37: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/37.jpg)
Enter Compressive Sensing
• Sparse localization vector <>acquire and transmit compressive measurementsof the actual observations without losing information
![Page 38: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/38.jpg)
So Far…
• Use random projections of observed signals two ways:
– create local sensor dictionaries that sparsify source locations
– create intersensor communication messages
(K targets on N-dim grid)
populatedusing recovered
signalsrandom iid
![Page 39: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/39.jpg)
ELVIS Highlights
• Use random projections of observed signals two ways:
– create local sensor dictionaries that sparsify source locations
sample at source sparsity– create intersensor communication
messagescommunicate at spatial sparsityrobust to (i) quantization (1-bit quantization–paper)
(ii) packet drops
No Signal Reconstruction
ELVIS Dictionary
![Page 40: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/40.jpg)
ELVIS Highlights
• Use random projections of observed signals two ways:
– create local sensor dictionaries that sparsify source locations
sample at source sparsity– create intersensor communication
messagescommunicate at spatial sparsityrobust to (i) quantization (1-bit quantization–paper)
(ii) packet drops
• Provable greedy estimation for ELVIS dictionaries
Bearing pursuit – computationally efficient reconstruction
No Signal Reconstruction
![Page 41: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/41.jpg)
Experiments
![Page 42: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/42.jpg)
Field Data Results5 vehicle convoy
>100 × sub-Nyquist
![Page 43: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/43.jpg)
![Page 44: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/44.jpg)
Sensing System Problems
• Common theme so far…
sensors > representations > metrics > “do our best”
• Purpose of deployment
– Multi-objective: sensing, lifetime, connectivity, coverage,
reliability, etc…
![Page 45: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/45.jpg)
Competition among Objectives
• Common theme so far…
sensors > representations > metrics > “do our best”
• Purpose of deployment
– Multi-objective: sensing, lifetime, connectivity, coverage,
reliability, etc…
• Limited resources > conflicts in objectives
![Page 46: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/46.jpg)
Diversity of Objectives
• Multiple objectives
– localization area– lifetime time– connectivity probability– coverage area– reliability probability
• Unifying framework
– utility
![Page 47: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/47.jpg)
Optimality
• Pareto efficiency
– Economics / optimization literature
• Pareto Frontier
– a fundamental limit for achievable utilities
![Page 48: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/48.jpg)
Pareto Frontiers for Localization
• Mathematical framework for multi objective design best sensors portfolio
• Elements of the design
– constant budget > optimization polytope
– sensor dictionary
– random deployment
– communications
[VC, Kaplan; IPSN’09, TOSN’09]
![Page 49: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/49.jpg)
Pareto Frontiers for Localization
• Mathematical framework for multi objective design
• Elements of the design
– constant budget
– sensor dictionary > measurement type (bearing or range) and error, sensor reliability,
field-of- view, sensing range, and mobility
… …
$10 $30 $200 $1M $5M
![Page 50: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/50.jpg)
Pareto Frontiers for Localization
• Mathematical framework for multi objective design
• Elements of the design
– constant budget
– sensor dictionary
– random deployment > optimize expected / worst case
utilities– communications
![Page 51: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/51.jpg)
Pareto Frontiers for Localization
• Mathematical framework for multi objective design
• Elements of the design
– constant budget
– sensor dictionary
– random deployment
– communications > bearing or range
![Page 52: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/52.jpg)
Statement of Results – 1
• Theory to predict the localization performancewith management
– signals > performance characterizations
– key idea:
duality among sensors <>existence of a reference sensing system
• Provable diminishing returns
![Page 53: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/53.jpg)
• Optimal heterogeneity
– sparse solutions
bounded by # of objectives
– key theorems:
concentration of resources
dominating sensor pairs
• Solution algorithms
– integer optimization
Statement of Results – 2
![Page 54: Source Localization on a budget Volkan Cevher volkan@rice.edu Rice University Petros RichAnna Martin Lance.](https://reader036.fdocuments.net/reader036/viewer/2022062410/56649ec55503460f94bd02da/html5/thumbnails/54.jpg)
Conclusions
• CS
– sensing via dimensionality reduction
• ELVIS
– source localization via dimensionality reduction
– provable and efficient recovery via bearing pursuit
• Current work
– clock synchronization
– sensor position errors via linear filtering
• Pareto Frontiers w/ ELVIS: reactive systems