The Sparse FFT: From Theory to...
Transcript of The Sparse FFT: From Theory to...
![Page 1: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/1.jpg)
The Sparse FFT:From Theory to Practice
Dina Katabi
O. Abari, E. Adalsteinsson, A. Adam, F. adib, A. Agarwal, O. C. Andronesi, Arvind, A. Chandrakasan, F. Durand, E. Hamed, H. Hassanieh, P. Indyk, B. Ghazi, E. Price,
L. Shi, V. Stojanovik
![Page 2: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/2.jpg)
Ongoing sFFT Projects (Beyond Theory)
Light Field Photography
Spectrum Sharing
Medical Imaging
GPS
sFFT Chip
![Page 3: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/3.jpg)
Spectrum Crisis• The FCC predicts a spectrum crunch starting 2013• But at any time, most of the spectrum is unused
Spectrum SharingSense to find unused bands; Use them!How do you capture GHz of spectrum?
Seattle January 7, 2013
![Page 4: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/4.jpg)
Challenges in Sparse GHz Acquisition
• GHz sampling is expensive and high-power
Tens of MHz ADC< a dollar
Low-power
A Few GHz ADCHundreds of dollars
10x more power
• Compressive sensing using GHz analog mixing is expensive, and requires heavy computation
![Page 5: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/5.jpg)
Hash the spectrum into a few buckets
f
Estimate the large coefficient in each non‐empty bucket
Recap of sFFT1‐ Bucketize
2‐ Estimate
Can ignore empty bucket
![Page 6: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/6.jpg)
Spectrum Sensing & Decoding with sFFT
Bucketize Estimate
![Page 7: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/7.jpg)
Spectrum Sensing & Decoding with sFFT
Bucketize Estimate
Sub-sampling time Aliasing the frequencies
![Page 8: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/8.jpg)
Spectrum Sensing & Decoding with sFFT
• Hash freqs. using multiple co-prime aliasing filters– Same frequencies don’t collide in two filters
• Identify isolated freq. in one filter and subtract them from the other; and iterate …
Bucketize Estimate
Low‐speed ADCs, which are cheap and low‐power
![Page 9: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/9.jpg)
Spectrum Sensing & Decoding with sFFT
Estimate frequency by repeating the bucketization with a time shift ∆T
Bucketize Estimate
∆Phase
![Page 10: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/10.jpg)
Low-Power GHz Receiver
• Built a 0.9 GHz receiver using three 50 MHz software radios
• First off-the-shelf receiver that captures a sparse signal larger than its own digital bandwidth
![Page 11: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/11.jpg)
Concurrent Senders Hopping in 0.9 GHz
Number of MHz Senders Randomly Hopping gin in 0.9 GHz
![Page 12: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/12.jpg)
Realtime GHz Spectrum SensingCambridge, MA January 2013
sFFT enables a GHz low‐power receiver using only a few MHz ADCs
![Page 13: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/13.jpg)
Probability of Declaring a Used Frequency as Unused
![Page 14: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/14.jpg)
Ongoing sFFT Projects (Beyond Theory)
Light Field Photography
Spectrum Sharing
Medical Imaging
GPS
sFFT Chip
![Page 15: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/15.jpg)
Magnetic Resonance SpectroscopyAnalyses the chemical making of a brain voxel Disease Bio-markers
![Page 16: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/16.jpg)
Challenges
• Long acquisition time–patient is in the machine for 40min to hours
• Artifacts due to acquisition window
![Page 17: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/17.jpg)
Windowing Artifacts• Fourier transform of a window is a sinc
(Inverse) Fourier Transform
Acquisition Window Convolution with a sinc
![Page 18: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/18.jpg)
Windowing Artifacts
-5 -4 -3 -2 -1 0 1 2 3 4 50
0.2
0.4
0.6
0.8
1
-5 -4 -3 -2 -1 0 1 2 3 4 50
0.2
0.4
0.6
0.8
1
-5 -4 -3 -2 -1 0 1 2 3 4 50
0.2
0.4
0.6
0.8
1
-5 -4 -3 -2 -1 0 1 2 3 4 50
0.2
0.4
0.6
0.8
1
-5 -4 -3 -2 -1 0 1 2 3 4 50
0.2
0.4
0.6
0.8
1
-5 -4 -3 -2 -1 0 1 2 3 4 50
0.2
0.4
0.6
0.8
1
Convolve
Convolve
Discretization
Discretization
Tail
![Page 19: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/19.jpg)
Challenges with In-Vivo Brain MRS
1) clutter due to sinc tail
2) hours in machine
Can sparse recovery help?
![Page 20: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/20.jpg)
Compressive Sensing + 30% data
Lost some Biomarkers
![Page 21: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/21.jpg)
Non-Integer Sparse FFT
• Problem and Model– Sparse in the continuous case– The railings are because of non-integer frequencies
• Algorithm– Use original sparse FFT to estimate integer
frequencies– Use gradient descent algorithm to find the non-
integer frequencies to minimize the residue of our estimation over the samples
![Page 22: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/22.jpg)
Challenges with In-Vivo Brain MRS
1) clutter due to sinc tail
2) hours in machine
Can sparse recovery help?
![Page 23: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/23.jpg)
Sparse FFT + 30% of data
Removed Clutter without losing Biomarkers
sFFT provides clearer images while reducing the acquisition time by 3x
![Page 24: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/24.jpg)
Light-Field Photography• Generate depth and perspective using images from a
2D camera array • Images are correlated 4D frequencies are sparse• Goal: Same performance but with fewer images
![Page 25: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/25.jpg)
Original Reconstructed with 11% of data
![Page 26: The Sparse FFT: From Theory to Practicegroups.csail.mit.edu/netmit/sFFT/sFFT_Workshop_Feb2013-v...The Sparse FFT: From Theory to Practice Dina Katabi O. Abari, E. Adalsteinsson, A.](https://reader034.fdocuments.net/reader034/viewer/2022042313/5edc52e9ad6a402d6666f167/html5/thumbnails/26.jpg)
Conclusion
• Many applications are sparse in the frequency domain and hence can benefit from sFFT
• We showed that sFFT enables GHz low-power spectrum sensing and decoding, and improves MRS medical imaging and 4D light-filed capture
• We just scratched the surface and expect more applications soon