Artifacts suppression in images and video
description
Transcript of Artifacts suppression in images and video
![Page 1: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/1.jpg)
Volodymyr Fedak
Artifacts suppression in images and video
![Page 2: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/2.jpg)
Introduction
What is the problem?
Why is it important?
What did I do? What are the results?
So what next?
![Page 3: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/3.jpg)
What is the problem?
blocking
ringing
blurring
flickering
![Page 4: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/4.jpg)
What is the problem?
F - 2F - 1
F
F + 1F + 2
Intra-frame processing… Inter-frame processing…
![Page 5: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/5.jpg)
Why is it important ?
De-coder Artifact detection
Reducing artifacts
Transform to original format
Enhanced information
postprocessingCoder parameters
Compressed information
Postprocessing techniques:•motion-compensated algorithms iterative approaches based on the theory of projections onto convex set
•spatial-temporal algorithmsalgorithms that transform signal to frequency domain
![Page 6: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/6.jpg)
What did I do ?
Analyse modern postprocessing techniques
Implement most encouraging methods
Compare results of mentioned algorithms
Propose approaches for optimization
![Page 7: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/7.jpg)
Wavelet-based de-blocking and de-ringing algorithm proposed by Alan and Liew
Steps:•Detection of Block Discontinuities•Threshold Maps Generation at Different Wavelet Scales•low frequency filtering
![Page 8: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/8.jpg)
Non-Local Means
NLM is an improvement of Bilateral filtering
dyxIyIsxycyIxI ))(),((),()()(
C(y, x) - geometric relationship
S(I(y), I(x)) - luminance ratio
I(y) – pixel luminance
![Page 9: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/9.jpg)
Non-Local Means
NLM could be presented:in general way:
)(),())(( jvjiwivNLIj
v(i) – noisy imageW(i, j) - weighted average of pixels in the image v(j) – pixel luminance
in terms of implementation:
2
2)()(
)(
)()(
1 h
yNxN
xQyh exz
xCxNL
)(
)()(2
2
2
)(xQy
h
yNxN
exC
N(x) - window surrounding pixel x;Q(x) is a search window around pixel x;
![Page 10: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/10.jpg)
Non-Local Means Parameters
•h - determines the amount of averaging (h increases amount of blocking artifacts decrease).•N (x) – the match window/patch – when N(x) increases, blocking artifacts of the processed sequence decreases very slowly •Q(x) – the search window/patch – when Q(x) increases, artifacts of the processed sequence decreases very slowly for an increasing value of the search window size, and we have a large amount of computation time.
![Page 11: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/11.jpg)
![Page 12: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/12.jpg)
Possible ways for optimization:
•Extended NLM to the temporal domain . Use together with motion-compensation algorithm but apply some quality coefficient to the motion vector. •Add smart patch/search window size choosing algorithm.•Use Hierarchical block matching algorithm to find similar windows for speeding-up NLM
![Page 13: Artifacts suppression in images and video](https://reader036.fdocuments.net/reader036/viewer/2022062501/568167da550346895ddd378c/html5/thumbnails/13.jpg)
Any questions ?