Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter...
Transcript of Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter...
![Page 1: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/1.jpg)
Advanced Image Denoising Methods: TV, NLM, and BM3D
Zhifei Zhang
![Page 2: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/2.jpg)
2
Outline
• TV [Rudin, et al. 1992]:
Total Variation minimization
• NLM [Buades, et al. 2005]:
Non-Local Means
• BM3D [Dabov, et al. 2006/2007]:
Block-Matching and 3D filter
![Page 3: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/3.jpg)
3
Total Variation minimization (TV)
Observed imageClean Image
Additive noise
, , ,g x y f x y n x y
f̂ g h Smooth kernel (local method)
![Page 4: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/4.jpg)
4
Total Variation minimization (TV)Global method:
=
124 100 3069 80 20066 92 211
⋯
⋮
Lower TV
2 2
,
ˆ ˆ ˆ ˆ ˆ( 1, ) ( , ) ( , 1) ( , )x y
TV f f x y f x y f x y f x y
![Page 5: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/5.jpg)
5
Total Variation minimization (TV)
Fidelity term
2
ˆ 2
1 ˆ ˆarg min2f
g f TV f
g 𝒇, 𝝀 = low 𝒇, 𝝀 = high 𝒇, 𝝀 = ∞
𝒇 =
![Page 6: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/6.jpg)
6
Total Variation minimization (TV)
𝝈 = 12
𝝈 = 25
• Straight edges are maintained. • Details and texture can be over
smoothed if 𝝀 is too large.
![Page 7: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/7.jpg)
7
Non-Local Means (NLM)
p
q1
q2
q3
,
( , ) , ,xy
i j
NLM x y w i j g i j
,
0 , 1, , 1xy xy
i j
w i j w i j
2
2
2
2
2
2
( )exp
,
( )exp
xy ij
xy
xy ij
ij
g g
w i j
g g
![Page 8: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/8.jpg)
8
Non-Local Means (NLM)
Noisy image𝝈 = 𝟐𝟎
Gaussian kernel TV NLM
Local Global Non-Local
• Preserve straight edges, as well as details and texture.
![Page 9: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/9.jpg)
9
Block-Matching and 3D filter (BM3D)
Block matching + 3D transform
![Page 10: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/10.jpg)
10
Block-Matching and 3D filter (BM3D)
Block matching + 3D transform
• Element-wise averaging• Identical blocks• Multiple blocks
• 3D transform (e.g., DWT, DFT, DCT)
![Page 11: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/11.jpg)
11
Block-Matching and 3D filter (BM3D)
• Using the basic estimate instead of the noisy image allows to improve the grouping by block-matching.
• Using the basic estimate as the pilot signal for the empirical Wiener filtering is much more effective and accurate than the simple hard-thresholding.
![Page 12: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/12.jpg)
12
Block-Matching and 3D filter (BM3D)
![Page 13: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/13.jpg)
13
Block-Matching and 3D filter (BM3D)
![Page 14: Advanced Image Denoising Methods: TV, NLM, and BM3D - A... · 11 Block-Matching and 3D filter (BM3D) • Using the basic estimate instead of the noisy image allows to improve the](https://reader036.fdocuments.net/reader036/viewer/2022070504/6141d8702035ff3bc76249d4/html5/thumbnails/14.jpg)
14