Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But...
Transcript of Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But...
![Page 1: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/1.jpg)
Kaleido: You Can Watch It But Cannot Record It
Tsinghua University, ChinaUniversity of North Carolina at Charlotte, USA
Illinois Institute of Technology, USA
MobiCom’15
Lan Zhang, Cheng Bo, Jiahui Hou, Xiang-Yang Li, Yu Wang, Kebin Liu, Yunhao Liu
![Page 2: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/2.jpg)
Outline
Background
Preliminary
System Design
Evaluation
![Page 3: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/3.jpg)
Background
![Page 4: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/4.jpg)
• Movie screen, phone, tablet, TV, electronic board…
• Entertainment, news, advertising, tour guide…
Video playback has contributed to about 80% of the Internet traffic [1].
[1] CISCO, I. Cisco visual networking index: Forecast and methodology, 2013–2018. CISCO White paper (2014), 2013–2018.
Blooming of Visual Displays
![Page 5: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/5.jpg)
Piracy - A Growing Threat
Film piracy causes lost of revenue about $20.5 billion annually.
Over 90% of this illegal online content is delivered from these pirate movies.
Unauthorized videotaping during the exhibition, presentation or project demonstration could cause infringement of copyright and even plagiarism.
![Page 6: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/6.jpg)
Copyright Protection
Watermark No camera policy Camera detect
![Page 7: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/7.jpg)
Copyright Protection
Watermark No camera policy Camera DetectIneffective in preventing attendees from taking pirate video for later redisplay, especially when using mobile devices.
![Page 8: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/8.jpg)
Copyright Protection
Watermark No camera policy Camera Detect
Is there a universal technology that can be used to protect the video displayed from pirate videotaping using typical mobile devices?
You Can Watch It But Cannot Record It?
![Page 9: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/9.jpg)
Screen-Camera v.s. Screen-Eye
![Page 10: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/10.jpg)
Screen-Camera v.s. Screen-Eye
• Discrete global/rolling shutter , higher temporal resolution.
• Continuous “global shutter”, low-pass filter.
![Page 11: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/11.jpg)
Screen-Camera Communication
• Encode information into the screen-camera side-channel.
• The extra signal can be captured by camera but not the human eye.
![Page 12: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/12.jpg)
PixNet leverages 2D OFDM to modulate high-throughput 2D barcode frame.
PixNet (SiGCOMM’11) COBRA (MobiSys’12)
COBRA [20] achieves real-time phone-to-phoneoptical communication.
Ex
isti
ng
Me
tho
ds
![Page 13: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/13.jpg)
Strata supports wide range of frame capture resolutions and rates so as to deliver information rate correspondingly.
Strata (MobiCom’14) InFrame++ (MobiSys’15)
InFrame++ achieves dual-mode full frame communication between screen and both humans and devices simultaneously.
Ex
isti
ng
Me
tho
ds
![Page 14: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/14.jpg)
PixNet (SiGCOMM’11) COBRA (MobiSys’12)
Strata (MobiCom’14)InFrame++ (MobiSys’15)
Try to maximize decodability of screen-camera channel.
Ex
isti
ng
Me
tho
ds
![Page 15: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/15.jpg)
Copyright ProtectionK
ale
ido
Prevent unauthorized users from videotaping a video played on a screen for high-quality redisplay.
OriginalVideo
PiratedVideo
OriginalVideo
DisplayCamera
PiratedVideo
Display
(1) Play Original Video
(2) Pirate Shooting
(3) Recording (4) Play Pirated Video
Legitimacy
Piracy
![Page 16: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/16.jpg)
Copyright ProtectionK
ale
ido
Do not affect the viewing experience of live audiences.Do not use any extra hardware device.
OriginalVideo
PiratedVideo
OriginalVideo
DisplayCamera
PiratedVideo
Display
(1) Play Original Video
(2) Pirate Shooting
(3) Recording (4) Play Pirated Video
Legitimacy
Piracy
![Page 17: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/17.jpg)
OriginalVideo
PiratedVideo
OriginalVideo
DisplayCamera
PiratedVideo
Display
(1) Play Original Video
(2) Pirate Shooting
(3) Recording (4) Play Pirated Video
Legitimacy
Piracy
(0) Generate Watch-only Video
Kaleido
Copyright ProtectionK
ale
ido
Kaleido: generate a watch-only version of the video .
Good view quality.
Bad view quality.
![Page 18: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/18.jpg)
Copyright Protection
Ka
leid
o We seek to maximize the quality degradation of the display-camera channel while retain the quality of the screen-eye channel.
Ex
isti
ng
Try to maximize decodability of screen-camera channel.
![Page 19: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/19.jpg)
Ch
all
en
ge
s
Cameras are designed to mimic the human eye.
Limited disparities, very small design opportunity.
![Page 20: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/20.jpg)
Preliminary
![Page 21: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/21.jpg)
Human Vision
Different light wavelengths stimulate the three kinds of cone cells of a viewer in different degrees, providing her perception of distinct colors.
![Page 22: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/22.jpg)
(White)
RGB Color gamut: subset of colors that
can be represented by mixing RGB system
CC1
C2
C3
C4
C5
C6
x
E
y
• Two aspects: • illuminance • chromaticity (composition of the
light spectra).
• to present a color• Y determines the illuminance • x and y give chromaticity at that
luminance.
19
31
CIE
Co
lor
Sp
ace
CIE chromatic diagram
![Page 23: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/23.jpg)
(White)
RGB Color gamut: subset of colors that
can be represented by mixing RGB system
CC1
C2
C3
C4
C5
C6
x
E
y
Sp
ectr
al
Co
lor
Mix
CIE chromatic diagram
Shining them simultaneously
• Mixed color depending on the relative brightness.• The combination of colors to produce a given
perceived color is not unique.
Spectral Color Additive Rule
![Page 24: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/24.jpg)
Te
mp
ora
l C
ha
ng
e C
olo
r
• The averaged chromaticity is determined based on the spectral color additive rule.
• Typically, human eyes can only resolve up to 50Hz to luminance flicker and 25Hz to chromatic flicker .
Temporal Color Additive Perception
1/30 s 1/30 s
Display Frames(120fps)
Captured Frames(Rolling Shutter)
Recorded Frames
(30fps)
Human Vision
Tf
tl
Time
tr te td
30 60 90
0.2
0
0.4
0.6
0.8
1.0
Temporal Frequency (Hz)
7° 10° 30° 50° 65°
Norm
aliz
ed A
mplit
ude M
odula
tion T
hre
shold
• When the flicker frequency is larger than Critical Flicker Frequency (CFF), the illuminance/chromatic flicker stimulus from a sequence of continuous frames are only perceived as time-averaged luminance/wavelength respectively.
![Page 25: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/25.jpg)
Video Encoding & Display
Gamut of an RGB display
• LCD monitor & Projector>=120 refresh rate
• Video: 24 or 30 frame rate
![Page 26: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/26.jpg)
1/30 s 1/30 s
Display Frames(120fps)
Captured Frames(Rolling Shutter)
Recorded Frames
(30fps)
Human Vision
Tf
tl
Time
tr te td
Video Recording
• Rolling Shutter• By 2013, CMOS (low cost) image
sensors takes 97% market share.• Total acquisition duration
• Effective light sampling frequency
• Varying Recording Rate• 24, 30, 60, 120, 240 fps
• Unstable Inter-frame Interval
![Page 27: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/27.jpg)
Screen-Camera v.s. Screen-Eye
• Discrete rolling shutter , higher temporal resolution.
• Continuous “global shutter”, low-pass filter.
![Page 28: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/28.jpg)
System Design
![Page 29: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/29.jpg)
OriginalVideo
PiratedVideo
OriginalVideo
DisplayCamera
PiratedVideo
Display
(1) Play Original Video
(2) Pirate Shooting
(3) Recording (4) Play Pirated Video
Legitimacy
Piracy
(0) Generate Watch-only Video
Kaleido
Good view quality.
Bad view quality.
Kaleido: addon to generate a watch-only version of the video .
Challenge & Opportunity
![Page 30: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/30.jpg)
OriginalVideo
PiratedVideo
OriginalVideo
DisplayCamera
PiratedVideo
Display
(1) Play Original Video
(2) Pirate Shooting
(3) Recording (4) Play Pirated Video
Legitimacy
Piracy
(0) Generate Watch-only Video
Kaleido
Good view quality.
Bad view quality.
Introduce illuminance flicker and chromatic distortion into the re-encoded frames.
Challenge & Opportunity
![Page 31: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/31.jpg)
OriginalVideo
PiratedVideo
OriginalVideo
DisplayCamera
PiratedVideo
Display
(1) Play Original Video
(2) Pirate Shooting
(3) Recording (4) Play Pirated Video
Legitimacy
Piracy
(0) Generate Watch-only Video
Kaleido
Good view quality.
Bad view quality.
Challenge & Opportunity
How to ensure the encoded flicker and distortion are imperceivable to the legitimate viewers at first,
and then become perceivable after a piracy procedure?
![Page 32: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/32.jpg)
Ca
se
#1
Display rate is larger than record rate:
1/30 s 1/30 s
Display Frames(120fps)
Captured Frames(Rolling Shutter)
Recorded Frames
(30fps)
Human Vision
Tf
tl
Time
tr te td
Rolling shutter effect
tc (te < tc /2)
If signal is time-varying
Temporal variation loss
Eye perceives time-averaging signal
Perceivable distortion
![Page 33: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/33.jpg)
Copyright ProtectionC
ase
#2
Display rate is less than record rate:
1/120 sDisplay Line
(120fps)
Phase-out Captured Line
(120fps)
Recorded Line
(120fps)
Display Illuminance Amplitude
Time
Displayed Flicker(Duration = 1/60 s)
1/120 s
Recorded Illuminance Amplitude
Recorded Flicker(Duration = 1/40 s)
Flicker frequency is down-converted from 60Hz to 40Hz. Asynchronized frames
Out-phase recorded lines
Down-conversion flicker frequency
ff >CFF ff <CFF
Perceivable flicker
• A flicker at a frequency ff will be captured by temporal successive out-phase lines.
• The flicker is recorded but its frequency is
• Unstable inter-frame intervals of cameras aggravate the information loss and distortion.
![Page 34: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/34.jpg)
Generate Watch-only Video
`
`
``
`
`
`
``
`
`
`
``
`
Frame 2
Frame 3
Time (s)
0
1/30
2/30
1/30
0
`
`
`
```
`
`
```
`
`
```
`
`
``
3/120
1/120
2/120Frame 1-1
Frame 1-2
Frame 1-3
Frame 1-4
Frame 2
Time (s)
`
`
`
``
Frame 1
• Most current videos are 30fps
• High refresh rate display (e.g., 120Hz)
• One frame 4 successive frames following
the additive rule of human eyes.
• The flicker frequency is 60, which is larger than the CFF.
• Original Frame
Sub-frames
We need to determine of each pixel
Illuminance Flicker & Chromatic Distortion
![Page 35: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/35.jpg)
Tech #1: Illuminance Frame Pollution
Successive Frames
Illuminance Flicker Pair
`
`
`
``
` ``
`
`
`
``
` ``
Polluted Frame Pair
`
`
`
``
` ``
`
`
`
``
` ``
• A pair of pollution frames: add an illuminance complementary perturbation
to each pixel pair.
• The time averaging illuminance of each pixel from two pollution frames equals 0.
• Flicker frequency is just above CFF and the amplitude and block size should be maximized to aggravate the pollution.
• If any down-conversion and instable interval happens, the flicker will become perceivable.
![Page 36: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/36.jpg)
Tech #2: Chromatic Frame Decomposition
`
`
``
`
`
`
``
`
`
`
``
`
Frame 2
Frame 3
Time (s)
0
1/30
2/30
1/30
0
`
`
`
```
`
`
```
`
`
```
`
`
``
3/120
1/120
2/120Frame 1-1
Frame 1-2
Frame 1-3
Frame 1-4
Frame 2
Time (s)
`
`
`
``
Frame 1
• Metamerism: a color can be decomposed to an infinite number of different color pairs.
• Choose a set of combinations that will (approximately) maximize the potential color distortion and spatial deformation.
(White)
RGB Color gamut: subset of colors that
can be represented by mixing RGB system
CC1
C2
C3
C4
C5
C6
x
E
y
Determined by the original video and the illuminance pollution.
Determined by camera parameter.
• We propose an algorithm to achieve the optimum with constant time complexity.
![Page 37: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/37.jpg)
Tech #3: Embrace Spatial Deformation
• Make display colors appear as random as possible.
• Metamerism: a color can be decomposed to an infinite number of different color pairs.
• Randomizing different decomposition color pairs will make each display frame like a random noise.
![Page 38: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/38.jpg)
Watch-Only Video Generation
Maximize Spatial Deformation
Tradeoff between maximization of color distortion and spatial deformation.
Radom Mix
3
1
3
3
1
3
3
1 3 1 1
5 3 5
3 1 3
5 3 5
5
3
5
3
6
4
6
6
4
6
6
4 6 4 4
2 6 2
6 4 6
2 6 2
2
6
2
6
2 6
Vk,1 Pattern Vk,2 Pattern
3
1
3
3
1
3
3
1 3 1 1
5 3 5
3 1 3
5 3 5
5
3
5
3
6
4
6
6
4
6
6
4 6 4 4
2 6 2
6 4 6
2 6 2
2
6
2
6
2 6
Vk,1 Pattern Vk,2 Pattern
Pattern
![Page 39: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/39.jpg)
Watch-Only Video Generation
Maximize Spatial Deformation
Radom MixPattern
![Page 40: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/40.jpg)
Watch-Only Video Generation
Reducing the Encoding Cost
Frame n Frame n+1 Frame n+2 Frame n+3 Frame n+4
Scene ChangeSame Scene/Big Motion Same Scene/Small Motion
Scene ChangeSame Scene/Big Motion Same Scene/Small Motion
![Page 41: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/41.jpg)
Evaluation
![Page 42: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/42.jpg)
Experiment Setting
• LCD monitor and projector (120fps).• 5 different smartphones (iPhone 5s, iPhone 6, Samsung Note3, Note4 Edge, HTC M8)• Capturing rate is 1080p in 30fps or 60fps and 720p in 120fps• 20 diverse high-definition (1280*720) video clips• 50 volunteers
![Page 43: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/43.jpg)
• Random: 96% volunteers did not even notice they are watch-only video clips. • Pattern: 92% volunteers did not distinguish them. • Mix: 38% volunteers noticed, but the degradation is acceptable (the average score is above 4).• LCD monitors have a slightly better performance than projectors.• Light condition and video type do not cause significant differences of watching experience.
Watch-Only Video Quality Assessment
Average Subjective Score
![Page 44: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/44.jpg)
Pirated Video Quality Assessment
• Pirated
• Original
![Page 45: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/45.jpg)
Pirated Video Quality Assessment
Original VideoPirate Video of Original Video (camera fps=30)
Pirate Video of Watch-only Video (LCD Screen, camera fps=30)
Pirate Video of Watch-only Video (LCD Screen, camera fps=120)
Pirate Video of Watch-only Video (Projector, camera fps=30)
Pirate Video of Watch-only Video (Projector, camera fps=120)
![Page 46: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/46.jpg)
• The score for pirated original video is about 4, which indicates acceptable quality.• 96% volunteers claim the quality degradation is intolerable, and the average
rating score is below 2.
Pirated Video Quality Assessment
Average Subjective Score
![Page 47: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/47.jpg)
• All our methods distort the color of original frames, which leads to significant quality degradation in all videos in all conditions.
Pirated Video Quality Assessment
Different decomposition methods
Different light conditions and capture rates
![Page 48: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/48.jpg)
• Pirate watch-only video also has severe quality degradation compared to the pirate original video of non-modified version.
Pirated Video Quality Assessment
Compare pirate video from original and watch-only
![Page 49: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/49.jpg)
• Common post denoising process not only cannot recover the original video, but also deteriorate the video quality compared to the watch-only version due to recognizing noise incorrectly.
Pirated Video Quality Assessment
Video Quality after denoising
We apply existing noise removal techniques to pirate watch-only video.
![Page 50: Kaleido: You Can Watch It But Cannot Record It Bo - mobicom98_s… · Kaleido: You Can Watch It But Cannot Record It Tsinghua University, China ... advertising, tour guide ... Kaleido](https://reader033.fdocuments.net/reader033/viewer/2022060315/5f0bed617e708231d432e7b8/html5/thumbnails/50.jpg)
• It takes 0.12s in average to process one 1280*720 video frame, i.e., the process speed is about 8.3fps.
• Since our method increase the frame rate from 30fps to 120fps, the watch-only video quadruples the file size of the original one.
Overhead