Localization of Forgeries in MPEG-2 Video through...
Transcript of Localization of Forgeries in MPEG-2 Video through...
![Page 1: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/1.jpg)
* Politecnico di TorinoITALY
† Università di SienaITALY
# Università di Firenze ITALY
‡ Universidade de VigoSPAIN
June 6th 2013
LOCALIZATION OF FORGERIES IN
MPEG-2 VIDEO THROUGH GOP SIZE
AND DQ ANALYSIS
D. Labartino #, T. Bianchi ∗, A. De Rosa #, M. Fontani †
D. Vázquez-Padín ‡, A. Piva #, M. Barni †
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 2: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/2.jpg)
Outline
1 Motivation and Goal
2 Overall Structure of the Proposed System
3 Description of Two Main StepsLocalization of To-Be-Analyzed FramesDouble Quantization Analysis
4 Experimental Results
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 3: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/3.jpg)
Motivation and Goal
Video forensics today
• Many techniques for detecting double compression (probably,more than for images)
• Revealing video manipulation is much harderI Naïve approach: double compression =⇒ tampered videoI Not always the case (e.g. video may be re-encoded during
device-to-computer transfer)
• Several works focusing on the removal/copying/replication ofwhole frames
• Existing approaches for intra-frame forgery localization makestrong assumptions, e.g. assuming only intra-coded frames, akaM-JPEG
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 4: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/4.jpg)
Motivation and Goal
Video forensics today
• Many techniques for detecting double compression (probably,more than for images)
• Revealing video manipulation is much harderI Naïve approach: double compression =⇒ tampered videoI Not always the case (e.g. video may be re-encoded during
device-to-computer transfer)
• Several works focusing on the removal/copying/replication ofwhole frames
• Existing approaches for intra-frame forgery localization makestrong assumptions, e.g. assuming only intra-coded frames, akaM-JPEG
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 5: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/5.jpg)
Motivation and Goal
Video forensics today
• Many techniques for detecting double compression (probably,more than for images)
• Revealing video manipulation is much harderI Naïve approach: double compression =⇒ tampered videoI Not always the case (e.g. video may be re-encoded during
device-to-computer transfer)
• Several works focusing on the removal/copying/replication ofwhole frames
• Existing approaches for intra-frame forgery localization makestrong assumptions, e.g. assuming only intra-coded frames, akaM-JPEG
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 6: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/6.jpg)
Overall Structure of the Proposed System
Outline
1 Motivation and Goal
2 Overall Structure of the Proposed System
3 Description of Two Main StepsLocalization of To-Be-Analyzed FramesDouble Quantization Analysis
4 Experimental Results
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 7: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/7.jpg)
Overall Structure of the Proposed System
Proposed Scheme
• Leveraging on the double compression undergone by forged video
• Use DQ analysis to localize the forged region within frames that wereintra-coded twice
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 8: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/8.jpg)
Overall Structure of the Proposed System
Proposed Scheme
• Leveraging on the double compression undergone by forged video
• Use DQ analysis to localize the forged region within frames that wereintra-coded twice
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 9: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/9.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
Outline
1 Motivation and Goal
2 Overall Structure of the Proposed System
3 Description of Two Main StepsLocalization of To-Be-Analyzed FramesDouble Quantization Analysis
4 Experimental Results
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 10: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/10.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
MPEG-2 Coding 1/2
• Frame typesI I: coded independently (much like JPEG)I P: predicted from a previous reference frame (I o P)I B: predicted from a previous and/or following reference frame (I o P)
I P B P I
GOP
• Macroblock Types (16x16 pixels)I intra-coded macroblocks (I-MB)I inter-coded macroblocks (P-MB)I skipped macroblocks (S-MB)
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 11: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/11.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
MPEG-2 Coding 2/2
• DCT Coefficients QuantizationI Differently from JPEG, a quantization matrix is provided by the standardI Quantization strength adapted through a multiplier integer kI Different matrices are defined for I- and P- frames (we only care about
I-frame quantization)
Qi,j = k ×
8 16 19 22 26 27 29 3416 16 22 24 27 29 34 3719 22 26 27 29 34 34 3822 22 26 27 29 34 37 4022 26 27 29 32 35 40 4826 27 29 32 35 40 48 5826 27 29 34 38 46 56 6927 29 35 38 46 56 69 83
• VBR codingI We assume Variable BitRate coding (VBR)⇒ k is fixed by the userI Knowing k gives all the quantization step Qi,j used in a compressionI This facilitates the task compared to JPEG
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 12: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/12.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
MPEG-2 Coding 2/2
• DCT Coefficients QuantizationI Differently from JPEG, a quantization matrix is provided by the standardI Quantization strength adapted through a multiplier integer kI Different matrices are defined for I- and P- frames (we only care about
I-frame quantization)
Qi,j = k ×
8 16 19 22 26 27 29 3416 16 22 24 27 29 34 3719 22 26 27 29 34 34 3822 22 26 27 29 34 37 4022 26 27 29 32 35 40 4826 27 29 32 35 40 48 5826 27 29 34 38 46 56 6927 29 35 38 46 56 69 83
• VBR coding
I We assume Variable BitRate coding (VBR)⇒ k is fixed by the userI Knowing k gives all the quantization step Qi,j used in a compressionI This facilitates the task compared to JPEG
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 13: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/13.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
Variation of Prediction Footprint (VPF)1
P PI
P PP
29 30 31First
Compression
SecondCompression
O I-MB
O P-MB
O S-MB
29 30 31
↑ I-MB S-MB ↓
1D. Vázquez-Padín, M. Fontani, T. Bianchi, P. Comesaña, A. Piva, F. Pérez- González, M. Barni
Detection of video double encoding with GOP size estimation, WIFS 2012
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 14: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/14.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
Variation of Prediction Footprint (VPF)1
P PI
P PP
29 30 31First
Compression
SecondCompression
O I-MB
O P-MB
O S-MB
29 30 31
↑ I-MB S-MB ↓
1D. Vázquez-Padín, M. Fontani, T. Bianchi, P. Comesaña, A. Piva, F. Pérez- González, M. Barni
Detection of video double encoding with GOP size estimation, WIFS 2012
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 15: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/15.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
Variation of Prediction Footprint (VPF)1
P PI
P PP
29 30 31First
Compression
SecondCompression
O I-MB
O P-MB
O S-MB
29 30 31
↑ I-MB S-MB ↓1
D. Vázquez-Padín, M. Fontani, T. Bianchi, P. Comesaña, A. Piva, F. Pérez- González, M. BarniDetection of video double encoding with GOP size estimation, WIFS 2012
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 16: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/16.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
Variation of Prediction Footprint (VPF)1
• By estimating GOP1, we can locate those frames that have beenintra-coded twice
1D. Vázquez-Padín, M. Fontani, T. Bianchi, P. Comesaña, A. Piva, F. Pérez- González, M. Barni
Detection of video double encoding with GOP size estimation, WIFS 2012
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 17: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/17.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
Variation of Prediction Footprint (VPF)1
• By estimating GOP1, we can locate those frames that have beenintra-coded twice
1D. Vázquez-Padín, M. Fontani, T. Bianchi, P. Comesaña, A. Piva, F. Pérez- González, M. Barni
Detection of video double encoding with GOP size estimation, WIFS 2012
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 18: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/18.jpg)
Description of Two Main Steps Localization of To-Be-Analyzed Frames
Variation of Prediction Footprint (VPF)1
• By estimating GOP1, we can locate those frames that have beenintra-coded twice
FORGERY LOCALIZATION TECHNIQUES
1D. Vázquez-Padín, M. Fontani, T. Bianchi, P. Comesaña, A. Piva, F. Pérez- González, M. Barni
Detection of video double encoding with GOP size estimation, WIFS 2012
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 19: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/19.jpg)
Description of Two Main Steps Double Quantization Analysis
Outline
1 Motivation and Goal
2 Overall Structure of the Proposed System
3 Description of Two Main StepsLocalization of To-Be-Analyzed FramesDouble Quantization Analysis
4 Experimental Results
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 20: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/20.jpg)
Description of Two Main Steps Double Quantization Analysis
From Double Quantization to Forgery Localization1
hDQ(x) hSQ(x)
hmix (x) = α hDQ(x) + (1− α)hSQ(x)
1Bianchi, De Rosa, Piva Improved DCT coefficient analysis for forgery localization in JPEG images, ICASSP’11
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 21: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/21.jpg)
Description of Two Main Steps Double Quantization Analysis
From Double Quantization to Forgery Localization1
hDQ(x) hSQ(x)
hmix (x) = α hDQ(x) + (1− α)hSQ(x)
1Bianchi, De Rosa, Piva Improved DCT coefficient analysis for forgery localization in JPEG images, ICASSP’11
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 22: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/22.jpg)
Description of Two Main Steps Double Quantization Analysis
Estimation of hSQ (calibration technique)
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 23: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/23.jpg)
Description of Two Main Steps Double Quantization Analysis
Estimation of hSQ (calibration technique)
• hcal is an estimate of h0(histogram of unquantized coeffs)
• hSQ(x) ' h̃(x) = ∆k2(hcal)
30 20 10 0 10 20 300
50
100
150
200
250hcal
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 24: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/24.jpg)
Description of Two Main Steps Double Quantization Analysis
Estimation of hDQ1
• For a given k1, k2 and Q, wecan count how many bins ofh0 fall in each bin of hDQ
• Assuming h0 locally uniformhDQ(x) ' n(x ; k1, k2,Q) · h̃(x)
? ? ?
1Bianchi, De Rosa, Piva Improved DCT coefficient analysis for forgery localization in JPEG images, ICASSP’11
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 25: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/25.jpg)
Description of Two Main Steps Double Quantization Analysis
Estimation of hDQ1
• For a given k1, k2 and Q, wecan count how many bins ofh0 fall in each bin of hDQ
• Assuming h0 locally uniformhDQ(x) ' n(x ; k1, k2,Q) · h̃(x)
? ? ?
1Bianchi, De Rosa, Piva Improved DCT coefficient analysis for forgery localization in JPEG images, ICASSP’11
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 26: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/26.jpg)
Description of Two Main Steps Double Quantization Analysis
Estimation of hDQ1
• For a given k1, k2 and Q, wecan count how many bins ofh0 fall in each bin of hDQ
• Assuming h0 locally uniformhDQ(x) ' n(x ; k1, k2,Q) · h̃(x)
MPEG-2 de-quantization formula differs from JPEG ones.The function n(·) was derived, resulting in:
n(x ; k1, k2,Q) = k1×Q16
(⌈16
Q×k1
⌈k2×Q
16
(x + 1
2
)⌉⌉−⌈
16Q×k1
⌈k2×Q
16
(x − 1
2
)⌉⌉)
? ? ?
1Bianchi, De Rosa, Piva Improved DCT coefficient analysis for forgery localization in JPEG images, ICASSP’11
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 27: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/27.jpg)
Description of Two Main Steps Double Quantization Analysis
Estimation of hDQ1
• For a given k1, k2 and Q, wecan count how many bins ofh0 fall in each bin of hDQ
• Assuming h0 locally uniformhDQ(x) ' n(x ; k1, k2,Q) · h̃(x)
MPEG-2 de-quantization formula differs from JPEG ones.The function n(·) was derived, resulting in:
n(x ; k1, k2,Q) = k1×Q16
(⌈16
Q×k1
⌈k2×Q
16
(x + 1
2
)⌉⌉−⌈
16Q×k1
⌈k2×Q
16
(x − 1
2
)⌉⌉)? ? ?
1Bianchi, De Rosa, Piva Improved DCT coefficient analysis for forgery localization in JPEG images, ICASSP’11
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 28: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/28.jpg)
Description of Two Main Steps Double Quantization Analysis
Estimating k1
Model h̃mix (x ; k1, α) = α · n(x ; k1) · h̃(x)︸ ︷︷ ︸hDQ estimate
+ (1− α) · h̃(x)︸︷︷︸hSQ estimate
Error e(k1, α) =∑x 6=0
[hmix (x)− h̃mix (x ; k1, α)
]2
Estimate k1 and α by minimizing e(k1, α)
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 29: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/29.jpg)
Description of Two Main Steps Double Quantization Analysis
Estimating k1
Model h̃mix (x ; k1, α) = α · n(x ; k1) · h̃(x)︸ ︷︷ ︸hDQ estimate
+ (1− α) · h̃(x)︸︷︷︸hSQ estimate
Error e(k1, α) =∑x 6=0
[hmix (x)− h̃mix (x ; k1, α)
]2
Estimate k1 and α by minimizing e(k1, α)
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 30: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/30.jpg)
Description of Two Main Steps Double Quantization Analysis
Estimating k1
Model h̃mix (x ; k1, α) = α · n(x ; k1) · h̃(x)︸ ︷︷ ︸hDQ estimate
+ (1− α) · h̃(x)︸︷︷︸hSQ estimate
Error e(k1, α) =∑x 6=0
[hmix (x)− h̃mix (x ; k1, α)
]2
Estimate k1 and α by minimizing e(k1, α)
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 31: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/31.jpg)
Description of Two Main Steps Double Quantization Analysis
Probability mapKnowing k1 allows us to write, for the i-th coefficient xi :
p(xi |T ) = h̃(xi ) p(xi |O) = n(xi ; k1) · h̃(xi ).
By Bayes rule, and assuming equal priors:
p(T |xi ) =P(xi |T ) · P(T )
P(xi |T ) · P(T ) + P(xi |O) · P(O)=
11 + n(xi , k1)
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 32: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/32.jpg)
Description of Two Main Steps Double Quantization Analysis
Probability mapKnowing k1 allows us to write, for the i-th coefficient xi :
p(xi |T ) = h̃(xi ) p(xi |O) = n(xi ; k1) · h̃(xi ).
By Bayes rule, and assuming equal priors:
p(T |xi ) =P(xi |T ) · P(T )
P(xi |T ) · P(T ) + P(xi |O) · P(O)=
11 + n(xi , k1)
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 33: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/33.jpg)
Description of Two Main Steps Double Quantization Analysis
Probability mapKnowing k1 allows us to write, for the i-th coefficient xi :
p(xi |T ) = h̃(xi ) p(xi |O) = n(xi ; k1) · h̃(xi ).
By Bayes rule, and assuming equal priors:
p(T |xi ) =P(xi |T ) · P(T )
P(xi |T ) · P(T ) + P(xi |O) · P(O)=
11 + n(xi , k1)
HYPOTHESISstatistical independence between coeffs within a block
⇓PB =
1∏i|x (i) 6=0
n(xi ; k1) + 1
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 34: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/34.jpg)
Description of Two Main Steps Double Quantization Analysis
Probability mapKnowing k1 allows us to write, for the i-th coefficient xi :
p(xi |T ) = h̃(xi ) p(xi |O) = n(xi ; k1) · h̃(xi ).
By Bayes rule, and assuming equal priors:
p(T |xi ) =P(xi |T ) · P(T )
P(xi |T ) · P(T ) + P(xi |O) · P(O)=
11 + n(xi , k1)
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 35: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/35.jpg)
Experimental Results
Outline
1 Motivation and Goal
2 Overall Structure of the Proposed System
3 Description of Two Main StepsLocalization of To-Be-Analyzed FramesDouble Quantization Analysis
4 Experimental Results
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 36: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/36.jpg)
Experimental Results
Dataset
Dataset built from 7 “raw” videos available in the Internet (resolution: 720x576 pixels)
ducks_take_off.y4m in_to_tree.y4m old_town_cross.y4m park_joy.y4m
shields.y4m sunflower.y4m touchdown_pass.y4m
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 37: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/37.jpg)
Experimental Results
Dataset – Tampering Procedure
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 38: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/38.jpg)
Experimental Results
Dataset – Tampering Procedure
Chosen parameters for creating the dataset (112 video)
• GOP1 = 12, GOP2 = 15
• k1 ∈ {12,16,20,24}
• k2 ∈ {4,6,8,10}
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 39: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/39.jpg)
Experimental Results
Dataset – Tampering Procedure
Chosen parameters for creating the dataset (112 video)
• GOP1 = 12, GOP2 = 15
• k1 ∈ {12,16,20,24}
• k2 ∈ {4,6,8,10}
}−→ constant throughout the frame (VBR coding)
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 40: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/40.jpg)
Experimental Results
Localization example
Tampered frame Ground truth_
Probability map
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 41: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/41.jpg)
Experimental Results
ROC curves
k1 = 12 k1 = 16
k1 = 20 k1 = 24
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 42: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/42.jpg)
Experimental Results
ROC curves
AUC obtained with the proposed method:
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 43: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/43.jpg)
Experimental Results
Future works
Relax constraints:
• Robustness to framede-synchronization
• Variable GOP
• Presence of B-frames
⇓VPF
• Varying k throughout theframe (CBR coding mode)
• k2 > k1
• Cropping detection
⇓Localization Algorithm
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 44: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/44.jpg)
Experimental Results
Future works
Relax constraints:
• Robustness to framede-synchronization
• Variable GOP
• Presence of B-frames
⇓VPF
• Varying k throughout theframe (CBR coding mode)
• k2 > k1
• Cropping detection
⇓Localization Algorithm
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 45: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/45.jpg)
Experimental Results
Future works
Relax constraints:
• Robustness to framede-synchronization
• Variable GOP
• Presence of B-frames
⇓VPF
• Varying k throughout theframe (CBR coding mode)
• k2 > k1
• Cropping detection
⇓Localization Algorithm
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 46: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/46.jpg)
Experimental Results
Future works
Relax constraints:
• Robustness to framede-synchronization
• Variable GOP
• Presence of B-frames
⇓VPF
• Varying k throughout theframe (CBR coding mode)
• k2 > k1
• Cropping detection
⇓Localization Algorithm
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 47: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/47.jpg)
Experimental Results
Future works
Relax constraints:
• Robustness to framede-synchronization
• Variable GOP
• Presence of B-frames
⇓VPF
• Varying k throughout theframe (CBR coding mode)
• k2 > k1
• Cropping detection
⇓Localization Algorithm
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.
![Page 48: Localization of Forgeries in MPEG-2 Video through …clem.dii.unisi.it/~vipp/files/publications/2013_KEYNOTE_MMSP... · Localization of Forgeries in MPEG-2 Video through GOP Size](https://reader031.fdocuments.net/reader031/viewer/2022022605/5b7859a97f8b9a31308b621f/html5/thumbnails/48.jpg)
Experimental Results
Thanks for your attention
Thanks for your attention.
This work was partially supported by the REWIND project.More info at www.rewindproject.eu
Localization of Forgeries in MPEG-2 Video through GOP Size and DQ Analysis D. Labartino et al.