Deep Generative Video Compression - Stephan Mandt · 2019. 10. 27. · Deep Generative Video...

1
Deep Generative Video Compression Jun Han *1 , Salvator Lombardo *1 , Christopher Schroers 1 and Stephan Mandt 2 1: Disney Research 2: UC Irvine *: shared first authorship Video Codecs & Motivation I Traditional Codecs: H.264/H265; VP9. I Pipelines 1. Motion v t from x t and ˆ x t -1 2. Predict ¯ x t and residual r t = x t - ¯ x t 3. Transform and quantize r t to ˆ y t 4. Inverse ˆ y t to residual ˆ r t 5. Entropy coding v t and ˆ y t 6. Reconstruct ˆ x t =¯ x t +ˆ r t I Limitations: 1. Simple motion estimation; simple transform 2. Blocky artifacts in low-bit rate regime Codecs Comparison H.265 (0.86 bpp) t=1 t=6 VP9 (0.57 bpp) t=1 t=6 Ours (0.06 bpp) t=1 t=6 bpp: bit per pixel; original: 8 × 3 = 24 bits per pixel. I Ours: much lower bit rate; no blocky artifact. Deep Image Compression (Balle, ICLR 2017) Quantization Encoder AE Binary AD Decoder Noise Round Training After training Input Image Reconstructed Image μ φ (x) e z e z z x e x μ ✓ ( e z ) p ✓ ( e z ) Figure: e z : adding noise (training) or rounding (after training). Prior p θ ( e z ): parametric form to fit data distribution for entropy coding. I Inference model: ˜ z ∼ q φ (z | x )= U ( ˆ z - 1 2 , ˆ z + 1 2 ) , encoder ˆ z = μ φ (x ). I Loss: L(φ; θ )= E ˜ z ∼q [log p θ (x | ˜ z )] | {z } distortion - β (0 - E ˜ z ∼q [log p θ (˜ z )]) | {z } cross entropy: bit rate , where β adjusts rate-distortion ratio. I Outperforms best traditional image codec. Proposed Baseline Model μ φ (x t ) z t Quantization ˜ z t Encoder AE Binary AD ˜ z t Decoder ˜ x t Noise Round Training After training p ✓ (˜ z t | ˜ z <t ) x t Input Video Reconstructed Video μ ✓ ( e z t ) Figure: Two choices of predictive models for entropy coding: p θ ( e z t | e z t -1 ) Kalman Filter; p θ ( e z t | e z <t ) LSTM. I Generative model: p (x 1:T , z 1:T )= Q T t =1 p θ (z t |z <t )p θ (x t |z t ). I Encode/decode frame x t using image encoder/decoder I Leverage predictive models to capture temporal redundancy Improved Video Compression Model x 1:T x t μ φ (x 1:T ) μ φ (x t ) f z t Quantization ˜ z t Encoders AE AE Binary AD AD ˜ z t Decoder ˜ x t Noise Round Training After training p ✓ (˜ z t | ˜ z <t ) ˜ f p ✓ ( ˜ f ) μ ✓ (˜ z t , ˜ f ) ˜ f Noise Round Input Video Reconstructed Video Figure: Global state f : per-segment, inferred from a segment T of video by LSTM after encoder μ φ ; local state z t : per-frame, inferred from x t after encoder μ φ . I Split latent states of a video segment into global state (coding once) and local states (predictive model for coding) I Loss: distortion + cross-entropy E e f , e z 1:T ∼q [log p θ (x 1:T | e f , e z 1:T )] + H [q φ ( e f |x 1:T ), p θ ( e f )] + H [q φ ( e z 1:T |x 1:T ), p θ ( e z 1:T )]. I Entropy Coding: arithmetic coding by learned prior models Choice of Probability Models I Generative Model: p θ (x 1:T , z 1:T , f )= p θ (f )p θ (z 1:T ) T Y t =1 p θ (x t |f , z 1:T ) I Encoder Model: q φ (z 1:T , f | x 1:T )= q φ (f | x 1:T ) T Y t =1 q φ (z t | x t ). ˜ f ∼ q φ (f | x 1:T )= U ( ˆ f - 1 2 , ˆ f + 1 2 ) ˜ z t ∼ q φ (z t | x t )= U ( ˆ z t - 1 2 , ˆ z t + 1 2 ) . where encoders ˆ f = μ φ (x 1:T ) and ˆ z t = μ φ (x t ). I Prior Model: p θ (f )= dim(f ) Y i p θ (f i ) *U (- 1 2 , 1 2 ); p θ (z 1:T )= T Y t dim(z ) Y i p θ (z i t | z i <t ) *U (- 1 2 , 1 2 ), Gaussian convoluted with uniform; closed-form evaluation. Verification Experiments Datasets: Sprites; BAIR; Kinetics. Latent Variable Distribution Visualization (a) p θ(f i ) (b) p θ(f j ) (c) p θ(z i 1 ) (d) p θ(z j 1 ) Figure: Empirical distributions of inference posteriors and learned prior model. Latent Variable Entropy Visualization (a) Sprites (b) BAIR (c) Kinetics Figure: Average bits of information stored in f and z 1:T Summary: global state stores much more information than local state; predictive model save bits; LSTM works better than Kalman filter. Comparison Experiments Quantitative Comparison (Rate-distortion curves) (a) Sprites (b) BAIR (c) Kinetics Qualitative Comparison Ours (0.29 bpp, 38.1 dB) Original Ours (0.39 bpp) VP9 (0.39 bpp) VP9 (0.44 bpp, 25.7 dB) 32.0 dB 29.3 dB t=1 t=5 t=10 30.1 dB 30.8 dB Figure: Compressed videos by our LSTMP-LG and VP9 in low-bit rate regime.

Transcript of Deep Generative Video Compression - Stephan Mandt · 2019. 10. 27. · Deep Generative Video...

Page 1: Deep Generative Video Compression - Stephan Mandt · 2019. 10. 27. · Deep Generative Video Compression Jun Han*1, Salvator Lombardo*1, Christopher Schroers1 and Stephan Mandt2 1:

Deep Generative Video CompressionJun Han*1 , Salvator Lombardo*1, Christopher Schroers1 and Stephan Mandt2

1: Disney Research 2: UC Irvine*: shared first authorship

Video Codecs & Motivation

I Traditional Codecs: H.264/H265; VP9.

I Pipelines1. Motion vt from xt and xt−12. Predict xt and residual rt = xt − xt3. Transform and quantize rt to yt

4. Inverse yt to residual rt5. Entropy coding vt and yt6. Reconstruct xt = xt + rt

I Limitations:1. Simple motion estimation; simple transform2. Blocky artifacts in low-bit rate regime

Codecs Comparison

H.265 (0.86 bpp)

t=1 t=6

VP9 (0.57 bpp)

t=1 t=6

Ours (0.06 bpp)

t=1 t=6

bpp: bit per pixel; original: 8× 3 = 24 bits per pixel.

I Ours: much lower bit rate; no blocky artifact.

Deep Image Compression (Balle, ICLR 2017)

QuantizationEncoder

AE

Binary

AD

Decoder

NoiseRound

Training

After training

Input Image

Reconstructed Image

µ�(x)<latexit sha1_base64="lIFjvl6C215Mets/kR/c+uYpMwY=">AAACWXicbVHLSgMxFM2MWuv4qnbpJtgKuikz3ehScCO4UbAP6JSSydy2oZkHyR21DvOTLgTxV1yYPha19kLI4Zx7kpuTIJVCo+t+WfbW9k5pt7zn7B8cHh1XTk7bOskUhxZPZKK6AdMgRQwtFCihmypgUSChE0zuZnrnBZQWSfyM0xT6ERvFYig4Q0MNKukFrftBIkM9jcyW+1FWDHIfx4CsuPRfRQgoZAj5atN7UVzVnU2+VSYdi8IcsUK9GdugUnMb7rzof+AtQY0s63FQ+fDDhGcRxMgl07rnuSn2c6ZQcAmF42caUsYnbAQ9A2MWge7n82QKemGYkA4TZVaMdM6uOnIW6dlwpjNiONbr2ozcpPUyHN70cxGnGULMFxcNM0kxobOYaSgUcJRTAxhXwsxK+ZgpxtF8hmNC8Naf/B+0mw3P4Kdm7fZhGUeZnJFzckk8ck1uyT15JC3CySf5sXaskvVtW3bZdhattrX0VMmfsqu/EcK3ig==</latexit><latexit sha1_base64="lIFjvl6C215Mets/kR/c+uYpMwY=">AAACWXicbVHLSgMxFM2MWuv4qnbpJtgKuikz3ehScCO4UbAP6JSSydy2oZkHyR21DvOTLgTxV1yYPha19kLI4Zx7kpuTIJVCo+t+WfbW9k5pt7zn7B8cHh1XTk7bOskUhxZPZKK6AdMgRQwtFCihmypgUSChE0zuZnrnBZQWSfyM0xT6ERvFYig4Q0MNKukFrftBIkM9jcyW+1FWDHIfx4CsuPRfRQgoZAj5atN7UVzVnU2+VSYdi8IcsUK9GdugUnMb7rzof+AtQY0s63FQ+fDDhGcRxMgl07rnuSn2c6ZQcAmF42caUsYnbAQ9A2MWge7n82QKemGYkA4TZVaMdM6uOnIW6dlwpjNiONbr2ozcpPUyHN70cxGnGULMFxcNM0kxobOYaSgUcJRTAxhXwsxK+ZgpxtF8hmNC8Naf/B+0mw3P4Kdm7fZhGUeZnJFzckk8ck1uyT15JC3CySf5sXaskvVtW3bZdhattrX0VMmfsqu/EcK3ig==</latexit><latexit sha1_base64="lIFjvl6C215Mets/kR/c+uYpMwY=">AAACWXicbVHLSgMxFM2MWuv4qnbpJtgKuikz3ehScCO4UbAP6JSSydy2oZkHyR21DvOTLgTxV1yYPha19kLI4Zx7kpuTIJVCo+t+WfbW9k5pt7zn7B8cHh1XTk7bOskUhxZPZKK6AdMgRQwtFCihmypgUSChE0zuZnrnBZQWSfyM0xT6ERvFYig4Q0MNKukFrftBIkM9jcyW+1FWDHIfx4CsuPRfRQgoZAj5atN7UVzVnU2+VSYdi8IcsUK9GdugUnMb7rzof+AtQY0s63FQ+fDDhGcRxMgl07rnuSn2c6ZQcAmF42caUsYnbAQ9A2MWge7n82QKemGYkA4TZVaMdM6uOnIW6dlwpjNiONbr2ozcpPUyHN70cxGnGULMFxcNM0kxobOYaSgUcJRTAxhXwsxK+ZgpxtF8hmNC8Naf/B+0mw3P4Kdm7fZhGUeZnJFzckk8ck1uyT15JC3CySf5sXaskvVtW3bZdhattrX0VMmfsqu/EcK3ig==</latexit><latexit sha1_base64="lIFjvl6C215Mets/kR/c+uYpMwY=">AAACWXicbVHLSgMxFM2MWuv4qnbpJtgKuikz3ehScCO4UbAP6JSSydy2oZkHyR21DvOTLgTxV1yYPha19kLI4Zx7kpuTIJVCo+t+WfbW9k5pt7zn7B8cHh1XTk7bOskUhxZPZKK6AdMgRQwtFCihmypgUSChE0zuZnrnBZQWSfyM0xT6ERvFYig4Q0MNKukFrftBIkM9jcyW+1FWDHIfx4CsuPRfRQgoZAj5atN7UVzVnU2+VSYdi8IcsUK9GdugUnMb7rzof+AtQY0s63FQ+fDDhGcRxMgl07rnuSn2c6ZQcAmF42caUsYnbAQ9A2MWge7n82QKemGYkA4TZVaMdM6uOnIW6dlwpjNiONbr2ozcpPUyHN70cxGnGULMFxcNM0kxobOYaSgUcJRTAxhXwsxK+ZgpxtF8hmNC8Naf/B+0mw3P4Kdm7fZhGUeZnJFzckk8ck1uyT15JC3CySf5sXaskvVtW3bZdhattrX0VMmfsqu/EcK3ig==</latexit>

ez<latexit sha1_base64="bYr0ntrjU9k+dP9/VT1Q4XCjYNo=">AAACeXicdVE9T8MwEHXCd/kqMMJgaIsKA0pggBGJBYkFJEorNVXlOFdq1fmQfQFKlP/Ab2Pjj7Cw4JQOpYWTLD+9d+98vvMTKTQ6zodlz80vLC4tr5RW19Y3Nstb2w86ThWHBo9lrFo+0yBFBA0UKKGVKGChL6HpD64KvfkESos4usdhAp2QPUaiJzhDQ3XLbzVa9fxYBnoYmivzwjTvZh72AVle955FAChkANlk0mueH1VLfzsnmaQvclNkgnopjNX/y1ZL3XLFOXFGQWeBOwYVMo7bbvndC2KehhAhl0zrtusk2MmYQsEl5CUv1ZAwPmCP0DYwYiHoTjaaXE5rhgloL1bmREhH7KQjY6EuujOZIcO+ntYK8i+tnWLvopOJKEkRIv7zUC+VFGNarIEGQgFHOTSAcSVMr5T3mWIczbKKIbjTX54FD6cnrsF3p5XLm/E4lskuOSB14pJzckmuyS1pEE4+rT2rZh1aX/a+XbePf1Jta+zZIb/CPvsGgDDDgA==</latexit><latexit sha1_base64="bYr0ntrjU9k+dP9/VT1Q4XCjYNo=">AAACeXicdVE9T8MwEHXCd/kqMMJgaIsKA0pggBGJBYkFJEorNVXlOFdq1fmQfQFKlP/Ab2Pjj7Cw4JQOpYWTLD+9d+98vvMTKTQ6zodlz80vLC4tr5RW19Y3Nstb2w86ThWHBo9lrFo+0yBFBA0UKKGVKGChL6HpD64KvfkESos4usdhAp2QPUaiJzhDQ3XLbzVa9fxYBnoYmivzwjTvZh72AVle955FAChkANlk0mueH1VLfzsnmaQvclNkgnopjNX/y1ZL3XLFOXFGQWeBOwYVMo7bbvndC2KehhAhl0zrtusk2MmYQsEl5CUv1ZAwPmCP0DYwYiHoTjaaXE5rhgloL1bmREhH7KQjY6EuujOZIcO+ntYK8i+tnWLvopOJKEkRIv7zUC+VFGNarIEGQgFHOTSAcSVMr5T3mWIczbKKIbjTX54FD6cnrsF3p5XLm/E4lskuOSB14pJzckmuyS1pEE4+rT2rZh1aX/a+XbePf1Jta+zZIb/CPvsGgDDDgA==</latexit><latexit sha1_base64="bYr0ntrjU9k+dP9/VT1Q4XCjYNo=">AAACeXicdVE9T8MwEHXCd/kqMMJgaIsKA0pggBGJBYkFJEorNVXlOFdq1fmQfQFKlP/Ab2Pjj7Cw4JQOpYWTLD+9d+98vvMTKTQ6zodlz80vLC4tr5RW19Y3Nstb2w86ThWHBo9lrFo+0yBFBA0UKKGVKGChL6HpD64KvfkESos4usdhAp2QPUaiJzhDQ3XLbzVa9fxYBnoYmivzwjTvZh72AVle955FAChkANlk0mueH1VLfzsnmaQvclNkgnopjNX/y1ZL3XLFOXFGQWeBOwYVMo7bbvndC2KehhAhl0zrtusk2MmYQsEl5CUv1ZAwPmCP0DYwYiHoTjaaXE5rhgloL1bmREhH7KQjY6EuujOZIcO+ntYK8i+tnWLvopOJKEkRIv7zUC+VFGNarIEGQgFHOTSAcSVMr5T3mWIczbKKIbjTX54FD6cnrsF3p5XLm/E4lskuOSB14pJzckmuyS1pEE4+rT2rZh1aX/a+XbePf1Jta+zZIb/CPvsGgDDDgA==</latexit><latexit sha1_base64="bYr0ntrjU9k+dP9/VT1Q4XCjYNo=">AAACeXicdVE9T8MwEHXCd/kqMMJgaIsKA0pggBGJBYkFJEorNVXlOFdq1fmQfQFKlP/Ab2Pjj7Cw4JQOpYWTLD+9d+98vvMTKTQ6zodlz80vLC4tr5RW19Y3Nstb2w86ThWHBo9lrFo+0yBFBA0UKKGVKGChL6HpD64KvfkESos4usdhAp2QPUaiJzhDQ3XLbzVa9fxYBnoYmivzwjTvZh72AVle955FAChkANlk0mueH1VLfzsnmaQvclNkgnopjNX/y1ZL3XLFOXFGQWeBOwYVMo7bbvndC2KehhAhl0zrtusk2MmYQsEl5CUv1ZAwPmCP0DYwYiHoTjaaXE5rhgloL1bmREhH7KQjY6EuujOZIcO+ntYK8i+tnWLvopOJKEkRIv7zUC+VFGNarIEGQgFHOTSAcSVMr5T3mWIczbKKIbjTX54FD6cnrsF3p5XLm/E4lskuOSB14pJzckmuyS1pEE4+rT2rZh1aX/a+XbePf1Jta+zZIb/CPvsGgDDDgA==</latexit>

ez<latexit sha1_base64="bYr0ntrjU9k+dP9/VT1Q4XCjYNo=">AAACeXicdVE9T8MwEHXCd/kqMMJgaIsKA0pggBGJBYkFJEorNVXlOFdq1fmQfQFKlP/Ab2Pjj7Cw4JQOpYWTLD+9d+98vvMTKTQ6zodlz80vLC4tr5RW19Y3Nstb2w86ThWHBo9lrFo+0yBFBA0UKKGVKGChL6HpD64KvfkESos4usdhAp2QPUaiJzhDQ3XLbzVa9fxYBnoYmivzwjTvZh72AVle955FAChkANlk0mueH1VLfzsnmaQvclNkgnopjNX/y1ZL3XLFOXFGQWeBOwYVMo7bbvndC2KehhAhl0zrtusk2MmYQsEl5CUv1ZAwPmCP0DYwYiHoTjaaXE5rhgloL1bmREhH7KQjY6EuujOZIcO+ntYK8i+tnWLvopOJKEkRIv7zUC+VFGNarIEGQgFHOTSAcSVMr5T3mWIczbKKIbjTX54FD6cnrsF3p5XLm/E4lskuOSB14pJzckmuyS1pEE4+rT2rZh1aX/a+XbePf1Jta+zZIb/CPvsGgDDDgA==</latexit><latexit sha1_base64="bYr0ntrjU9k+dP9/VT1Q4XCjYNo=">AAACeXicdVE9T8MwEHXCd/kqMMJgaIsKA0pggBGJBYkFJEorNVXlOFdq1fmQfQFKlP/Ab2Pjj7Cw4JQOpYWTLD+9d+98vvMTKTQ6zodlz80vLC4tr5RW19Y3Nstb2w86ThWHBo9lrFo+0yBFBA0UKKGVKGChL6HpD64KvfkESos4usdhAp2QPUaiJzhDQ3XLbzVa9fxYBnoYmivzwjTvZh72AVle955FAChkANlk0mueH1VLfzsnmaQvclNkgnopjNX/y1ZL3XLFOXFGQWeBOwYVMo7bbvndC2KehhAhl0zrtusk2MmYQsEl5CUv1ZAwPmCP0DYwYiHoTjaaXE5rhgloL1bmREhH7KQjY6EuujOZIcO+ntYK8i+tnWLvopOJKEkRIv7zUC+VFGNarIEGQgFHOTSAcSVMr5T3mWIczbKKIbjTX54FD6cnrsF3p5XLm/E4lskuOSB14pJzckmuyS1pEE4+rT2rZh1aX/a+XbePf1Jta+zZIb/CPvsGgDDDgA==</latexit><latexit sha1_base64="bYr0ntrjU9k+dP9/VT1Q4XCjYNo=">AAACeXicdVE9T8MwEHXCd/kqMMJgaIsKA0pggBGJBYkFJEorNVXlOFdq1fmQfQFKlP/Ab2Pjj7Cw4JQOpYWTLD+9d+98vvMTKTQ6zodlz80vLC4tr5RW19Y3Nstb2w86ThWHBo9lrFo+0yBFBA0UKKGVKGChL6HpD64KvfkESos4usdhAp2QPUaiJzhDQ3XLbzVa9fxYBnoYmivzwjTvZh72AVle955FAChkANlk0mueH1VLfzsnmaQvclNkgnopjNX/y1ZL3XLFOXFGQWeBOwYVMo7bbvndC2KehhAhl0zrtusk2MmYQsEl5CUv1ZAwPmCP0DYwYiHoTjaaXE5rhgloL1bmREhH7KQjY6EuujOZIcO+ntYK8i+tnWLvopOJKEkRIv7zUC+VFGNarIEGQgFHOTSAcSVMr5T3mWIczbKKIbjTX54FD6cnrsF3p5XLm/E4lskuOSB14pJzckmuyS1pEE4+rT2rZh1aX/a+XbePf1Jta+zZIb/CPvsGgDDDgA==</latexit><latexit sha1_base64="bYr0ntrjU9k+dP9/VT1Q4XCjYNo=">AAACeXicdVE9T8MwEHXCd/kqMMJgaIsKA0pggBGJBYkFJEorNVXlOFdq1fmQfQFKlP/Ab2Pjj7Cw4JQOpYWTLD+9d+98vvMTKTQ6zodlz80vLC4tr5RW19Y3Nstb2w86ThWHBo9lrFo+0yBFBA0UKKGVKGChL6HpD64KvfkESos4usdhAp2QPUaiJzhDQ3XLbzVa9fxYBnoYmivzwjTvZh72AVle955FAChkANlk0mueH1VLfzsnmaQvclNkgnopjNX/y1ZL3XLFOXFGQWeBOwYVMo7bbvndC2KehhAhl0zrtusk2MmYQsEl5CUv1ZAwPmCP0DYwYiHoTjaaXE5rhgloL1bmREhH7KQjY6EuujOZIcO+ntYK8i+tnWLvopOJKEkRIv7zUC+VFGNarIEGQgFHOTSAcSVMr5T3mWIczbKKIbjTX54FD6cnrsF3p5XLm/E4lskuOSB14pJzckmuyS1pEE4+rT2rZh1aX/a+XbePf1Jta+zZIb/CPvsGgDDDgA==</latexit>z

<latexit sha1_base64="mwDmbnuqGLnQ5qM/xswRTUtKmlg=">AAACi3icdVFNSwMxEM2uX3X9qnr0EuwKeim79aCIB0EEwYuCtYVuKdns1AazHySzal32z/iTvPlvTGuF1upAyOO9eZPJTJhJodHzPi17YXFpeaWy6qytb2xuVbd3HnSaKw5NnspUtUOmQYoEmihQQjtTwOJQQit8uhzprWdQWqTJPQ4z6MbsMRF9wRkaqld9P6BuEKYy0sPYXEUQ52WvCHAAyMrD4EVEgEJGUEwnvZXlkev87ZxmsoEoTZEp6vXH+G9h13FnGbdXrXl1bxx0HvgTUCOTuO1VP4Io5XkMCXLJtO74XobdgikUXELpBLmGjPEn9ggdAxMWg+4W41mW9MAwEe2nypwE6ZiddhQs1qPeTGbMcKB/ayPyL62TY/+0W4gkyxES/v1QP5cUUzpaDI2EAo5yaADjSpheKR8wxTia9TlmCP7vL8+Dh0bdN/iuUbu4mYyjQvbIPjkkPjkhF+Sa3JIm4VbFqlsn1qm9YR/bZ/b5d6ptTTy7ZCbsqy/mMcjI</latexit><latexit sha1_base64="mwDmbnuqGLnQ5qM/xswRTUtKmlg=">AAACi3icdVFNSwMxEM2uX3X9qnr0EuwKeim79aCIB0EEwYuCtYVuKdns1AazHySzal32z/iTvPlvTGuF1upAyOO9eZPJTJhJodHzPi17YXFpeaWy6qytb2xuVbd3HnSaKw5NnspUtUOmQYoEmihQQjtTwOJQQit8uhzprWdQWqTJPQ4z6MbsMRF9wRkaqld9P6BuEKYy0sPYXEUQ52WvCHAAyMrD4EVEgEJGUEwnvZXlkev87ZxmsoEoTZEp6vXH+G9h13FnGbdXrXl1bxx0HvgTUCOTuO1VP4Io5XkMCXLJtO74XobdgikUXELpBLmGjPEn9ggdAxMWg+4W41mW9MAwEe2nypwE6ZiddhQs1qPeTGbMcKB/ayPyL62TY/+0W4gkyxES/v1QP5cUUzpaDI2EAo5yaADjSpheKR8wxTia9TlmCP7vL8+Dh0bdN/iuUbu4mYyjQvbIPjkkPjkhF+Sa3JIm4VbFqlsn1qm9YR/bZ/b5d6ptTTy7ZCbsqy/mMcjI</latexit><latexit sha1_base64="mwDmbnuqGLnQ5qM/xswRTUtKmlg=">AAACi3icdVFNSwMxEM2uX3X9qnr0EuwKeim79aCIB0EEwYuCtYVuKdns1AazHySzal32z/iTvPlvTGuF1upAyOO9eZPJTJhJodHzPi17YXFpeaWy6qytb2xuVbd3HnSaKw5NnspUtUOmQYoEmihQQjtTwOJQQit8uhzprWdQWqTJPQ4z6MbsMRF9wRkaqld9P6BuEKYy0sPYXEUQ52WvCHAAyMrD4EVEgEJGUEwnvZXlkev87ZxmsoEoTZEp6vXH+G9h13FnGbdXrXl1bxx0HvgTUCOTuO1VP4Io5XkMCXLJtO74XobdgikUXELpBLmGjPEn9ggdAxMWg+4W41mW9MAwEe2nypwE6ZiddhQs1qPeTGbMcKB/ayPyL62TY/+0W4gkyxES/v1QP5cUUzpaDI2EAo5yaADjSpheKR8wxTia9TlmCP7vL8+Dh0bdN/iuUbu4mYyjQvbIPjkkPjkhF+Sa3JIm4VbFqlsn1qm9YR/bZ/b5d6ptTTy7ZCbsqy/mMcjI</latexit><latexit sha1_base64="mwDmbnuqGLnQ5qM/xswRTUtKmlg=">AAACi3icdVFNSwMxEM2uX3X9qnr0EuwKeim79aCIB0EEwYuCtYVuKdns1AazHySzal32z/iTvPlvTGuF1upAyOO9eZPJTJhJodHzPi17YXFpeaWy6qytb2xuVbd3HnSaKw5NnspUtUOmQYoEmihQQjtTwOJQQit8uhzprWdQWqTJPQ4z6MbsMRF9wRkaqld9P6BuEKYy0sPYXEUQ52WvCHAAyMrD4EVEgEJGUEwnvZXlkev87ZxmsoEoTZEp6vXH+G9h13FnGbdXrXl1bxx0HvgTUCOTuO1VP4Io5XkMCXLJtO74XobdgikUXELpBLmGjPEn9ggdAxMWg+4W41mW9MAwEe2nypwE6ZiddhQs1qPeTGbMcKB/ayPyL62TY/+0W4gkyxES/v1QP5cUUzpaDI2EAo5yaADjSpheKR8wxTia9TlmCP7vL8+Dh0bdN/iuUbu4mYyjQvbIPjkkPjkhF+Sa3JIm4VbFqlsn1qm9YR/bZ/b5d6ptTTy7ZCbsqy/mMcjI</latexit>

x

<latexit sha1_base64="YwiMfLOEjZvDEjJ9lEX3C9vIWpQ=">AAACynicdVE9T8MwEHXCd/kqMLJYtEiwoKQLjEgMIMEAEgWkpqoc50ot7CSyL0AbZeMXsjHyT3DaIvUDTrL89O7eu7MvTKUw6HlfjruwuLS8srpWWd/Y3Nqu7uw+mCTTHJo8kYl+CpkBKWJookAJT6kGpkIJj+HLRZl/fAVtRBLfYz+FtmLPsegKztBSner3Ia0HYSIj01f2ygOVFZ08wB4gK46CNxEBChlBPlk0KIrjeuVv5SST9kRhTSao91/hv8ZzvoMRlc54jyacdh+U7vXpfvVOteadeMOg88AfgxoZx22n+hlECc8UxMglM6bleym2c6ZRcAlFJcgMpIy/sGdoWRgzBaadD1dR0EPLRLSbaHtipEN2UpEzZcrZbKVi2DOzuZL8K9fKsHvWzkWcZggxHzXqZpJiQsu90kho4Cj7FjCuhZ2V8h7TjKPdfsV+gj/75Hnw0DjxLb5r1M6vx9+xSvbJATkiPjkl5+SK3JIm4c6lo5xX5829cbXbd/NRqeuMNXtkKtyPH8pj4ok=</latexit><latexit sha1_base64="YwiMfLOEjZvDEjJ9lEX3C9vIWpQ=">AAACynicdVE9T8MwEHXCd/kqMLJYtEiwoKQLjEgMIMEAEgWkpqoc50ot7CSyL0AbZeMXsjHyT3DaIvUDTrL89O7eu7MvTKUw6HlfjruwuLS8srpWWd/Y3Nqu7uw+mCTTHJo8kYl+CpkBKWJookAJT6kGpkIJj+HLRZl/fAVtRBLfYz+FtmLPsegKztBSner3Ia0HYSIj01f2ygOVFZ08wB4gK46CNxEBChlBPlk0KIrjeuVv5SST9kRhTSao91/hv8ZzvoMRlc54jyacdh+U7vXpfvVOteadeMOg88AfgxoZx22n+hlECc8UxMglM6bleym2c6ZRcAlFJcgMpIy/sGdoWRgzBaadD1dR0EPLRLSbaHtipEN2UpEzZcrZbKVi2DOzuZL8K9fKsHvWzkWcZggxHzXqZpJiQsu90kho4Cj7FjCuhZ2V8h7TjKPdfsV+gj/75Hnw0DjxLb5r1M6vx9+xSvbJATkiPjkl5+SK3JIm4c6lo5xX5829cbXbd/NRqeuMNXtkKtyPH8pj4ok=</latexit><latexit sha1_base64="YwiMfLOEjZvDEjJ9lEX3C9vIWpQ=">AAACynicdVE9T8MwEHXCd/kqMLJYtEiwoKQLjEgMIMEAEgWkpqoc50ot7CSyL0AbZeMXsjHyT3DaIvUDTrL89O7eu7MvTKUw6HlfjruwuLS8srpWWd/Y3Nqu7uw+mCTTHJo8kYl+CpkBKWJookAJT6kGpkIJj+HLRZl/fAVtRBLfYz+FtmLPsegKztBSner3Ia0HYSIj01f2ygOVFZ08wB4gK46CNxEBChlBPlk0KIrjeuVv5SST9kRhTSao91/hv8ZzvoMRlc54jyacdh+U7vXpfvVOteadeMOg88AfgxoZx22n+hlECc8UxMglM6bleym2c6ZRcAlFJcgMpIy/sGdoWRgzBaadD1dR0EPLRLSbaHtipEN2UpEzZcrZbKVi2DOzuZL8K9fKsHvWzkWcZggxHzXqZpJiQsu90kho4Cj7FjCuhZ2V8h7TjKPdfsV+gj/75Hnw0DjxLb5r1M6vx9+xSvbJATkiPjkl5+SK3JIm4c6lo5xX5829cbXbd/NRqeuMNXtkKtyPH8pj4ok=</latexit><latexit sha1_base64="YwiMfLOEjZvDEjJ9lEX3C9vIWpQ=">AAACynicdVE9T8MwEHXCd/kqMLJYtEiwoKQLjEgMIMEAEgWkpqoc50ot7CSyL0AbZeMXsjHyT3DaIvUDTrL89O7eu7MvTKUw6HlfjruwuLS8srpWWd/Y3Nqu7uw+mCTTHJo8kYl+CpkBKWJookAJT6kGpkIJj+HLRZl/fAVtRBLfYz+FtmLPsegKztBSner3Ia0HYSIj01f2ygOVFZ08wB4gK46CNxEBChlBPlk0KIrjeuVv5SST9kRhTSao91/hv8ZzvoMRlc54jyacdh+U7vXpfvVOteadeMOg88AfgxoZx22n+hlECc8UxMglM6bleym2c6ZRcAlFJcgMpIy/sGdoWRgzBaadD1dR0EPLRLSbaHtipEN2UpEzZcrZbKVi2DOzuZL8K9fKsHvWzkWcZggxHzXqZpJiQsu90kho4Cj7FjCuhZ2V8h7TjKPdfsV+gj/75Hnw0DjxLb5r1M6vx9+xSvbJATkiPjkl5+SK3JIm4c6lo5xX5829cbXbd/NRqeuMNXtkKtyPH8pj4ok=</latexit>

ex

<latexit sha1_base64="ovCLB4+3Dg5nLTzlQT8KDyB9Cvo=">AAAC1nicdVJNSwMxEM2u3/Wr6tFLsAp6kV0vehS8CF4q2lrolpLNTm0w+0Eyq7bLelDEq7/Nmz/C/2C2rVBbHQh5vJn3MpnET6TQ6Diflj0zOze/sLhUWl5ZXVsvb2zWdZwqDjUey1g1fKZBighqKFBCI1HAQl/CjX93VuRv7kFpEUfX2EugFbLbSHQEZ2iodvlrj+56fiwD3QvNlnlhmrczD7uALN/3HkQAKGQA2XhRP88Pdkt/K8eZpCtyYzJGPf4I/zWe8u0PqWTCe9jhb/d+4f6f96PxbpcrzqEzCDoN3BGokFFU2+UPL4h5GkKEXDKtm66TYCtjCgWXkJe8VEPC+B27haaBEQtBt7LBs+R0zzAB7cTKrAjpgB1XZCzURXOmMmTY1ZO5gvwr10yxc9LKRJSkCBEfHtRJJcWYFm9MA6GAo+wZwLgSplfKu0wxjuYnlMwQ3MkrT4P60aFr8OVR5fRiNI5Fsk12yD5xyTE5JeekSmqEW1dWz3q2XuyG/WS/2m/DUtsaabbIr7DfvwFsF+gQ</latexit><latexit sha1_base64="ovCLB4+3Dg5nLTzlQT8KDyB9Cvo=">AAAC1nicdVJNSwMxEM2u3/Wr6tFLsAp6kV0vehS8CF4q2lrolpLNTm0w+0Eyq7bLelDEq7/Nmz/C/2C2rVBbHQh5vJn3MpnET6TQ6Diflj0zOze/sLhUWl5ZXVsvb2zWdZwqDjUey1g1fKZBighqKFBCI1HAQl/CjX93VuRv7kFpEUfX2EugFbLbSHQEZ2iodvlrj+56fiwD3QvNlnlhmrczD7uALN/3HkQAKGQA2XhRP88Pdkt/K8eZpCtyYzJGPf4I/zWe8u0PqWTCe9jhb/d+4f6f96PxbpcrzqEzCDoN3BGokFFU2+UPL4h5GkKEXDKtm66TYCtjCgWXkJe8VEPC+B27haaBEQtBt7LBs+R0zzAB7cTKrAjpgB1XZCzURXOmMmTY1ZO5gvwr10yxc9LKRJSkCBEfHtRJJcWYFm9MA6GAo+wZwLgSplfKu0wxjuYnlMwQ3MkrT4P60aFr8OVR5fRiNI5Fsk12yD5xyTE5JeekSmqEW1dWz3q2XuyG/WS/2m/DUtsaabbIr7DfvwFsF+gQ</latexit><latexit sha1_base64="ovCLB4+3Dg5nLTzlQT8KDyB9Cvo=">AAAC1nicdVJNSwMxEM2u3/Wr6tFLsAp6kV0vehS8CF4q2lrolpLNTm0w+0Eyq7bLelDEq7/Nmz/C/2C2rVBbHQh5vJn3MpnET6TQ6Diflj0zOze/sLhUWl5ZXVsvb2zWdZwqDjUey1g1fKZBighqKFBCI1HAQl/CjX93VuRv7kFpEUfX2EugFbLbSHQEZ2iodvlrj+56fiwD3QvNlnlhmrczD7uALN/3HkQAKGQA2XhRP88Pdkt/K8eZpCtyYzJGPf4I/zWe8u0PqWTCe9jhb/d+4f6f96PxbpcrzqEzCDoN3BGokFFU2+UPL4h5GkKEXDKtm66TYCtjCgWXkJe8VEPC+B27haaBEQtBt7LBs+R0zzAB7cTKrAjpgB1XZCzURXOmMmTY1ZO5gvwr10yxc9LKRJSkCBEfHtRJJcWYFm9MA6GAo+wZwLgSplfKu0wxjuYnlMwQ3MkrT4P60aFr8OVR5fRiNI5Fsk12yD5xyTE5JeekSmqEW1dWz3q2XuyG/WS/2m/DUtsaabbIr7DfvwFsF+gQ</latexit><latexit sha1_base64="ovCLB4+3Dg5nLTzlQT8KDyB9Cvo=">AAAC1nicdVJNSwMxEM2u3/Wr6tFLsAp6kV0vehS8CF4q2lrolpLNTm0w+0Eyq7bLelDEq7/Nmz/C/2C2rVBbHQh5vJn3MpnET6TQ6Diflj0zOze/sLhUWl5ZXVsvb2zWdZwqDjUey1g1fKZBighqKFBCI1HAQl/CjX93VuRv7kFpEUfX2EugFbLbSHQEZ2iodvlrj+56fiwD3QvNlnlhmrczD7uALN/3HkQAKGQA2XhRP88Pdkt/K8eZpCtyYzJGPf4I/zWe8u0PqWTCe9jhb/d+4f6f96PxbpcrzqEzCDoN3BGokFFU2+UPL4h5GkKEXDKtm66TYCtjCgWXkJe8VEPC+B27haaBEQtBt7LBs+R0zzAB7cTKrAjpgB1XZCzURXOmMmTY1ZO5gvwr10yxc9LKRJSkCBEfHtRJJcWYFm9MA6GAo+wZwLgSplfKu0wxjuYnlMwQ3MkrT4P60aFr8OVR5fRiNI5Fsk12yD5xyTE5JeekSmqEW1dWz3q2XuyG/WS/2m/DUtsaabbIr7DfvwFsF+gQ</latexit>

µ✓(ez)<latexit sha1_base64="Od/GsoFYBoBntT9v3pC4+i3Ud34=">AAAC43ichVI7T8MwEHbCq5RXgZHFoiDBghIWGJFYkFiKRAGpqYrjXKmF85B9AUqUlYUBhFj5U2z8FSactkiU8jjJ8qfvu/t8PttPpNDoOG+WPTY+MTlVmi7PzM7NL1QWl050nCoOdR7LWJ35TIMUEdRRoISzRAELfQmn/uV+oZ9egdIijo6xm0AzZBeRaAvO0FCtyvua58cy0N3QbJkXpnkrG2KwA8jyfMO7FgGgkAEM6bd5vrlWXqf/2SQdUZh8oW4+C381HvG97VPJby0Opf7pfmPcW5Wqs+X0go4CdwCqZBC1VuXVC2KehhAhl0zrhusk2MyYQsEl5GUv1ZAwfskuoGFgxELQzaz3RjldN0xA27EyK0LaY79WZCzURXMmM2TY0d+1gvxJa6TY3m1mIkpShIj3D2qnkmJMiwengVDAUXYNYFwJ0yvlHaYYR/MtymYI7vcrj4KT7S3X4KPt6t7hYBwlskJWyQZxyQ7ZIwekRuqEW+fWnfVgPdpg39tP9nM/1bYGNctkKOyXD3GU7h0=</latexit><latexit sha1_base64="Od/GsoFYBoBntT9v3pC4+i3Ud34=">AAAC43ichVI7T8MwEHbCq5RXgZHFoiDBghIWGJFYkFiKRAGpqYrjXKmF85B9AUqUlYUBhFj5U2z8FSactkiU8jjJ8qfvu/t8PttPpNDoOG+WPTY+MTlVmi7PzM7NL1QWl050nCoOdR7LWJ35TIMUEdRRoISzRAELfQmn/uV+oZ9egdIijo6xm0AzZBeRaAvO0FCtyvua58cy0N3QbJkXpnkrG2KwA8jyfMO7FgGgkAEM6bd5vrlWXqf/2SQdUZh8oW4+C381HvG97VPJby0Opf7pfmPcW5Wqs+X0go4CdwCqZBC1VuXVC2KehhAhl0zrhusk2MyYQsEl5GUv1ZAwfskuoGFgxELQzaz3RjldN0xA27EyK0LaY79WZCzURXMmM2TY0d+1gvxJa6TY3m1mIkpShIj3D2qnkmJMiwengVDAUXYNYFwJ0yvlHaYYR/MtymYI7vcrj4KT7S3X4KPt6t7hYBwlskJWyQZxyQ7ZIwekRuqEW+fWnfVgPdpg39tP9nM/1bYGNctkKOyXD3GU7h0=</latexit><latexit sha1_base64="Od/GsoFYBoBntT9v3pC4+i3Ud34=">AAAC43ichVI7T8MwEHbCq5RXgZHFoiDBghIWGJFYkFiKRAGpqYrjXKmF85B9AUqUlYUBhFj5U2z8FSactkiU8jjJ8qfvu/t8PttPpNDoOG+WPTY+MTlVmi7PzM7NL1QWl050nCoOdR7LWJ35TIMUEdRRoISzRAELfQmn/uV+oZ9egdIijo6xm0AzZBeRaAvO0FCtyvua58cy0N3QbJkXpnkrG2KwA8jyfMO7FgGgkAEM6bd5vrlWXqf/2SQdUZh8oW4+C381HvG97VPJby0Opf7pfmPcW5Wqs+X0go4CdwCqZBC1VuXVC2KehhAhl0zrhusk2MyYQsEl5GUv1ZAwfskuoGFgxELQzaz3RjldN0xA27EyK0LaY79WZCzURXMmM2TY0d+1gvxJa6TY3m1mIkpShIj3D2qnkmJMiwengVDAUXYNYFwJ0yvlHaYYR/MtymYI7vcrj4KT7S3X4KPt6t7hYBwlskJWyQZxyQ7ZIwekRuqEW+fWnfVgPdpg39tP9nM/1bYGNctkKOyXD3GU7h0=</latexit><latexit sha1_base64="Od/GsoFYBoBntT9v3pC4+i3Ud34=">AAAC43ichVI7T8MwEHbCq5RXgZHFoiDBghIWGJFYkFiKRAGpqYrjXKmF85B9AUqUlYUBhFj5U2z8FSactkiU8jjJ8qfvu/t8PttPpNDoOG+WPTY+MTlVmi7PzM7NL1QWl050nCoOdR7LWJ35TIMUEdRRoISzRAELfQmn/uV+oZ9egdIijo6xm0AzZBeRaAvO0FCtyvua58cy0N3QbJkXpnkrG2KwA8jyfMO7FgGgkAEM6bd5vrlWXqf/2SQdUZh8oW4+C381HvG97VPJby0Opf7pfmPcW5Wqs+X0go4CdwCqZBC1VuXVC2KehhAhl0zrhusk2MyYQsEl5GUv1ZAwfskuoGFgxELQzaz3RjldN0xA27EyK0LaY79WZCzURXMmM2TY0d+1gvxJa6TY3m1mIkpShIj3D2qnkmJMiwengVDAUXYNYFwJ0yvlHaYYR/MtymYI7vcrj4KT7S3X4KPt6t7hYBwlskJWyQZxyQ7ZIwekRuqEW+fWnfVgPdpg39tP9nM/1bYGNctkKOyXD3GU7h0=</latexit>

p✓(ez)<latexit sha1_base64="v/NTEErJT22upXKMpRezp7ugg7w=">AAAC43ichVI7SwNBEN473/EVtbRZTALayF0aLQUbwUbBaCAJcW9vYhb3HuzOqfG41sZCEVv/lJ1/xcpNjJCH0YFlP76Zb2Z2Zr1YCo2O82HZU9Mzs3PzC7nFpeWV1fza+rmOEsWhwiMZqarHNEgRQgUFSqjGCljgSbjwrg+7/osbUFpE4Rl2YmgE7CoULcEZGqqZ/yzRYt2LpK87gbnSepBkzXSIwTYgy7LtQfI+2ynm/pfGbTEivPsR3gofUEgf0uG82Vjee0MV40lNTczzZ507U6eZLzi7Ts/oOHD7oED6dtLMv9f9iCcBhMgl07rmOjE2UqZQcAlZrp5oiBm/ZldQMzBkAehG2ttRRkuG8WkrUuaESHvsoCJlge42ZyIDhm096uuSv/lqCbb2G6kI4wQh5N+FWomkGNHuwqkvFHCUHQMYV8L0SnmbKcbRfIucGYI7+uRxcF7edQ0+LRcOjvvjmCebZItsE5fskQNyRE5IhXDr0nqwnqxnG+xH+8V+/Q61rb5mgwyZ/fYF0WbuHQ==</latexit><latexit sha1_base64="v/NTEErJT22upXKMpRezp7ugg7w=">AAAC43ichVI7SwNBEN473/EVtbRZTALayF0aLQUbwUbBaCAJcW9vYhb3HuzOqfG41sZCEVv/lJ1/xcpNjJCH0YFlP76Zb2Z2Zr1YCo2O82HZU9Mzs3PzC7nFpeWV1fza+rmOEsWhwiMZqarHNEgRQgUFSqjGCljgSbjwrg+7/osbUFpE4Rl2YmgE7CoULcEZGqqZ/yzRYt2LpK87gbnSepBkzXSIwTYgy7LtQfI+2ynm/pfGbTEivPsR3gofUEgf0uG82Vjee0MV40lNTczzZ507U6eZLzi7Ts/oOHD7oED6dtLMv9f9iCcBhMgl07rmOjE2UqZQcAlZrp5oiBm/ZldQMzBkAehG2ttRRkuG8WkrUuaESHvsoCJlge42ZyIDhm096uuSv/lqCbb2G6kI4wQh5N+FWomkGNHuwqkvFHCUHQMYV8L0SnmbKcbRfIucGYI7+uRxcF7edQ0+LRcOjvvjmCebZItsE5fskQNyRE5IhXDr0nqwnqxnG+xH+8V+/Q61rb5mgwyZ/fYF0WbuHQ==</latexit><latexit sha1_base64="v/NTEErJT22upXKMpRezp7ugg7w=">AAAC43ichVI7SwNBEN473/EVtbRZTALayF0aLQUbwUbBaCAJcW9vYhb3HuzOqfG41sZCEVv/lJ1/xcpNjJCH0YFlP76Zb2Z2Zr1YCo2O82HZU9Mzs3PzC7nFpeWV1fza+rmOEsWhwiMZqarHNEgRQgUFSqjGCljgSbjwrg+7/osbUFpE4Rl2YmgE7CoULcEZGqqZ/yzRYt2LpK87gbnSepBkzXSIwTYgy7LtQfI+2ynm/pfGbTEivPsR3gofUEgf0uG82Vjee0MV40lNTczzZ507U6eZLzi7Ts/oOHD7oED6dtLMv9f9iCcBhMgl07rmOjE2UqZQcAlZrp5oiBm/ZldQMzBkAehG2ttRRkuG8WkrUuaESHvsoCJlge42ZyIDhm096uuSv/lqCbb2G6kI4wQh5N+FWomkGNHuwqkvFHCUHQMYV8L0SnmbKcbRfIucGYI7+uRxcF7edQ0+LRcOjvvjmCebZItsE5fskQNyRE5IhXDr0nqwnqxnG+xH+8V+/Q61rb5mgwyZ/fYF0WbuHQ==</latexit><latexit sha1_base64="v/NTEErJT22upXKMpRezp7ugg7w=">AAAC43ichVI7SwNBEN473/EVtbRZTALayF0aLQUbwUbBaCAJcW9vYhb3HuzOqfG41sZCEVv/lJ1/xcpNjJCH0YFlP76Zb2Z2Zr1YCo2O82HZU9Mzs3PzC7nFpeWV1fza+rmOEsWhwiMZqarHNEgRQgUFSqjGCljgSbjwrg+7/osbUFpE4Rl2YmgE7CoULcEZGqqZ/yzRYt2LpK87gbnSepBkzXSIwTYgy7LtQfI+2ynm/pfGbTEivPsR3gofUEgf0uG82Vjee0MV40lNTczzZ507U6eZLzi7Ts/oOHD7oED6dtLMv9f9iCcBhMgl07rmOjE2UqZQcAlZrp5oiBm/ZldQMzBkAehG2ttRRkuG8WkrUuaESHvsoCJlge42ZyIDhm096uuSv/lqCbb2G6kI4wQh5N+FWomkGNHuwqkvFHCUHQMYV8L0SnmbKcbRfIucGYI7+uRxcF7edQ0+LRcOjvvjmCebZItsE5fskQNyRE5IhXDr0nqwnqxnG+xH+8V+/Q61rb5mgwyZ/fYF0WbuHQ==</latexit>

Figure: z : adding noise (training) or rounding (after training). Prior pθ(z): parametric form to fitdata distribution for entropy coding.

I Inference model: z ∼ qφ(z | x) = U(z − 1

2, z + 12

), encoder z = µφ(x).

I Loss: L(φ;θ) = Ez∼q[log pθ(x |z)]︸ ︷︷ ︸distortion

− β ( 0− Ez∼q[log pθ(z)])︸ ︷︷ ︸cross entropy: bit rate

,

where β adjusts rate-distortion ratio.

I Outperforms best traditional image codec.

Proposed Baseline Model

µ�(xt)<latexit sha1_base64="c/cNSDYktElGk5W1YWlZe5sy2FM=">AAACIHicbVDLSsNAFJ34rPUVdelmsAh1UxIR6rLoxmUF+4AmhMlk0g6dTMLMRCwhn+LGX3HjQhHd6dc4abPowwPDHM65l3vv8RNGpbKsH2NtfWNza7uyU93d2z84NI+OuzJOBSYdHLNY9H0kCaOcdBRVjPQTQVDkM9Lzx7eF33skQtKYP6hJQtwIDTkNKUZKS57ZdPyYBXIS6S9zojT3sgUlGdE8h/V57Sn31IVn1qyGNQVcJXZJaqBE2zO/nSDGaUS4wgxJObCtRLkZEopiRvKqk0qSIDxGQzLQlKOISDebHpjDc60EMIyFflzBqTrfkaFIFtvpygipkVz2CvE/b5Cq8NrNKE9SRTieDQpTBlUMi7RgQAXBik00QVhQvSvEIyQQVjrTqg7BXj55lXQvG7bVsO+vaq2bMo4KOAVnoA5s0AQtcAfaoAMweAav4B18GC/Gm/FpfM1K14yy5wQswPj9Axv9pWA=</latexit><latexit sha1_base64="c/cNSDYktElGk5W1YWlZe5sy2FM=">AAACIHicbVDLSsNAFJ34rPUVdelmsAh1UxIR6rLoxmUF+4AmhMlk0g6dTMLMRCwhn+LGX3HjQhHd6dc4abPowwPDHM65l3vv8RNGpbKsH2NtfWNza7uyU93d2z84NI+OuzJOBSYdHLNY9H0kCaOcdBRVjPQTQVDkM9Lzx7eF33skQtKYP6hJQtwIDTkNKUZKS57ZdPyYBXIS6S9zojT3sgUlGdE8h/V57Sn31IVn1qyGNQVcJXZJaqBE2zO/nSDGaUS4wgxJObCtRLkZEopiRvKqk0qSIDxGQzLQlKOISDebHpjDc60EMIyFflzBqTrfkaFIFtvpygipkVz2CvE/b5Cq8NrNKE9SRTieDQpTBlUMi7RgQAXBik00QVhQvSvEIyQQVjrTqg7BXj55lXQvG7bVsO+vaq2bMo4KOAVnoA5s0AQtcAfaoAMweAav4B18GC/Gm/FpfM1K14yy5wQswPj9Axv9pWA=</latexit><latexit sha1_base64="c/cNSDYktElGk5W1YWlZe5sy2FM=">AAACIHicbVDLSsNAFJ34rPUVdelmsAh1UxIR6rLoxmUF+4AmhMlk0g6dTMLMRCwhn+LGX3HjQhHd6dc4abPowwPDHM65l3vv8RNGpbKsH2NtfWNza7uyU93d2z84NI+OuzJOBSYdHLNY9H0kCaOcdBRVjPQTQVDkM9Lzx7eF33skQtKYP6hJQtwIDTkNKUZKS57ZdPyYBXIS6S9zojT3sgUlGdE8h/V57Sn31IVn1qyGNQVcJXZJaqBE2zO/nSDGaUS4wgxJObCtRLkZEopiRvKqk0qSIDxGQzLQlKOISDebHpjDc60EMIyFflzBqTrfkaFIFtvpygipkVz2CvE/b5Cq8NrNKE9SRTieDQpTBlUMi7RgQAXBik00QVhQvSvEIyQQVjrTqg7BXj55lXQvG7bVsO+vaq2bMo4KOAVnoA5s0AQtcAfaoAMweAav4B18GC/Gm/FpfM1K14yy5wQswPj9Axv9pWA=</latexit><latexit sha1_base64="c/cNSDYktElGk5W1YWlZe5sy2FM=">AAACIHicbVDLSsNAFJ34rPUVdelmsAh1UxIR6rLoxmUF+4AmhMlk0g6dTMLMRCwhn+LGX3HjQhHd6dc4abPowwPDHM65l3vv8RNGpbKsH2NtfWNza7uyU93d2z84NI+OuzJOBSYdHLNY9H0kCaOcdBRVjPQTQVDkM9Lzx7eF33skQtKYP6hJQtwIDTkNKUZKS57ZdPyYBXIS6S9zojT3sgUlGdE8h/V57Sn31IVn1qyGNQVcJXZJaqBE2zO/nSDGaUS4wgxJObCtRLkZEopiRvKqk0qSIDxGQzLQlKOISDebHpjDc60EMIyFflzBqTrfkaFIFtvpygipkVz2CvE/b5Cq8NrNKE9SRTieDQpTBlUMi7RgQAXBik00QVhQvSvEIyQQVjrTqg7BXj55lXQvG7bVsO+vaq2bMo4KOAVnoA5s0AQtcAfaoAMweAav4B18GC/Gm/FpfM1K14yy5wQswPj9Axv9pWA=</latexit>

zt<latexit sha1_base64="2+byp70tWvsxbofl6uQHE4ovRBw=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKdShf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2R7lCM=</latexit><latexit sha1_base64="2+byp70tWvsxbofl6uQHE4ovRBw=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKdShf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2R7lCM=</latexit><latexit sha1_base64="2+byp70tWvsxbofl6uQHE4ovRBw=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKdShf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2R7lCM=</latexit><latexit sha1_base64="2+byp70tWvsxbofl6uQHE4ovRBw=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKdShf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2R7lCM=</latexit>

Quantization

zt<latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit>

Encoder

AE

Binary

ADzt

<latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit>

Decoder

xt<latexit sha1_base64="X4Q1aFm5XrHWDo+IKYEVuO42eN8=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyKWEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wfylpfX</latexit><latexit sha1_base64="X4Q1aFm5XrHWDo+IKYEVuO42eN8=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyKWEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wfylpfX</latexit><latexit sha1_base64="X4Q1aFm5XrHWDo+IKYEVuO42eN8=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyKWEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wfylpfX</latexit><latexit sha1_base64="X4Q1aFm5XrHWDo+IKYEVuO42eN8=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyKWEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wfylpfX</latexit>

NoiseRound

Training

After training

p✓(zt | z<t)<latexit sha1_base64="LbQgD7kqKzy9eS/a3cS6ePEaYZw=">AAACPHicdVA9SwNBEN3z2/gVtbRZDEJswp0IWliINpYRTSLkjmNvb2IW9z7YnRPicT/Mxh9hZ2VjoYittXtJCjX6YNnHezPMzAtSKTTa9pM1NT0zOze/sFhZWl5ZXauub7R1kikOLZ7IRF0FTIMUMbRQoISrVAGLAgmd4Oa09Du3oLRI4kscpOBF7DoWPcEZGsmvXqR+7gaJDPUgMl/uYh+QFQWtuyhkCD/Mu6LwkbqRCOk/bn6Exa5frdkNewg6SZwxqZExmn710Q0TnkUQI5dM665jp+jlTKHgEoqKm2lIGb9h19A1NGYRaC8fHl/QHaOEtJco82KkQ/V7R84iXW5oKiOGff3bK8W/vG6GvUMvF3GaIcR8NKiXSYoJLZOkoVDAUQ4MYVwJsyvlfaYYR5N3xYTg/D55krT3Go7dcM73a8cn4zgWyBbZJnXikANyTM5Ik7QIJ/fkmbySN+vBerHerY9R6ZQ17tkkP2B9fgEoTbGk</latexit><latexit sha1_base64="LbQgD7kqKzy9eS/a3cS6ePEaYZw=">AAACPHicdVA9SwNBEN3z2/gVtbRZDEJswp0IWliINpYRTSLkjmNvb2IW9z7YnRPicT/Mxh9hZ2VjoYittXtJCjX6YNnHezPMzAtSKTTa9pM1NT0zOze/sFhZWl5ZXauub7R1kikOLZ7IRF0FTIMUMbRQoISrVAGLAgmd4Oa09Du3oLRI4kscpOBF7DoWPcEZGsmvXqR+7gaJDPUgMl/uYh+QFQWtuyhkCD/Mu6LwkbqRCOk/bn6Exa5frdkNewg6SZwxqZExmn710Q0TnkUQI5dM665jp+jlTKHgEoqKm2lIGb9h19A1NGYRaC8fHl/QHaOEtJco82KkQ/V7R84iXW5oKiOGff3bK8W/vG6GvUMvF3GaIcR8NKiXSYoJLZOkoVDAUQ4MYVwJsyvlfaYYR5N3xYTg/D55krT3Go7dcM73a8cn4zgWyBbZJnXikANyTM5Ik7QIJ/fkmbySN+vBerHerY9R6ZQ17tkkP2B9fgEoTbGk</latexit><latexit sha1_base64="LbQgD7kqKzy9eS/a3cS6ePEaYZw=">AAACPHicdVA9SwNBEN3z2/gVtbRZDEJswp0IWliINpYRTSLkjmNvb2IW9z7YnRPicT/Mxh9hZ2VjoYittXtJCjX6YNnHezPMzAtSKTTa9pM1NT0zOze/sFhZWl5ZXauub7R1kikOLZ7IRF0FTIMUMbRQoISrVAGLAgmd4Oa09Du3oLRI4kscpOBF7DoWPcEZGsmvXqR+7gaJDPUgMl/uYh+QFQWtuyhkCD/Mu6LwkbqRCOk/bn6Exa5frdkNewg6SZwxqZExmn710Q0TnkUQI5dM665jp+jlTKHgEoqKm2lIGb9h19A1NGYRaC8fHl/QHaOEtJco82KkQ/V7R84iXW5oKiOGff3bK8W/vG6GvUMvF3GaIcR8NKiXSYoJLZOkoVDAUQ4MYVwJsyvlfaYYR5N3xYTg/D55krT3Go7dcM73a8cn4zgWyBbZJnXikANyTM5Ik7QIJ/fkmbySN+vBerHerY9R6ZQ17tkkP2B9fgEoTbGk</latexit><latexit sha1_base64="LbQgD7kqKzy9eS/a3cS6ePEaYZw=">AAACPHicdVA9SwNBEN3z2/gVtbRZDEJswp0IWliINpYRTSLkjmNvb2IW9z7YnRPicT/Mxh9hZ2VjoYittXtJCjX6YNnHezPMzAtSKTTa9pM1NT0zOze/sFhZWl5ZXauub7R1kikOLZ7IRF0FTIMUMbRQoISrVAGLAgmd4Oa09Du3oLRI4kscpOBF7DoWPcEZGsmvXqR+7gaJDPUgMl/uYh+QFQWtuyhkCD/Mu6LwkbqRCOk/bn6Exa5frdkNewg6SZwxqZExmn710Q0TnkUQI5dM665jp+jlTKHgEoqKm2lIGb9h19A1NGYRaC8fHl/QHaOEtJco82KkQ/V7R84iXW5oKiOGff3bK8W/vG6GvUMvF3GaIcR8NKiXSYoJLZOkoVDAUQ4MYVwJsyvlfaYYR5N3xYTg/D55krT3Go7dcM73a8cn4zgWyBbZJnXikANyTM5Ik7QIJ/fkmbySN+vBerHerY9R6ZQ17tkkP2B9fgEoTbGk</latexit>

xt<latexit sha1_base64="GjNWDXVZ+XhHzG1cnk8MHnN/JK8=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKZahf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2FtlCE=</latexit><latexit sha1_base64="GjNWDXVZ+XhHzG1cnk8MHnN/JK8=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKZahf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2FtlCE=</latexit><latexit sha1_base64="GjNWDXVZ+XhHzG1cnk8MHnN/JK8=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKZahf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2FtlCE=</latexit><latexit sha1_base64="GjNWDXVZ+XhHzG1cnk8MHnN/JK8=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKZahf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2FtlCE=</latexit>

Input Video

Reconstructed Video

µ✓(ezt)<latexit sha1_base64="ovLLOo7qbxZJB25bQk76zn1xpwc=">AAAC5XichVJNT9wwEHVCC3QpkNJjL1YXJLigZC/0iMQFictWYj+kzSpynNldC+dD9qSwRLn3wgGEuPY/cet/4YCzmwPLljKS5af3Zp7HY4eZFBpd969lr3z4uLq2/qmx8Xlza9v5stPVaa44dHgqU9UPmQYpEuigQAn9TAGLQwm98OKk0nu/QGmRJuc4zWAYs3EiRoIzNFTgPO36YSojPY3NVvhxXgbFAoMTQFaW+/6liACFjGBBvy7LAA92G3v0PaNsIiqbF9RVWRe+ab3kez2nsreaXEj9r/uVcQ+cpnvozoIuA68GTVJHO3Ae/SjleQwJcsm0HnhuhsOCKRRcQtnwcw0Z4xdsDAMDExaDHhazVyrpnmEiOkqVWQnSGfuyomCxrpozmTHDiX6tVeS/tEGOox/DQiRZjpDw+UGjXFJMafXkNBIKOMqpAYwrYXqlfMIU42g+RsMMwXt95WXQbR16Bv9sNY/P6nGsk2/kO9knHjkix+SUtEmHcCu0flu31p09tm/se/thnmpbdc1XshD2n2fOa+8E</latexit><latexit sha1_base64="ovLLOo7qbxZJB25bQk76zn1xpwc=">AAAC5XichVJNT9wwEHVCC3QpkNJjL1YXJLigZC/0iMQFictWYj+kzSpynNldC+dD9qSwRLn3wgGEuPY/cet/4YCzmwPLljKS5af3Zp7HY4eZFBpd969lr3z4uLq2/qmx8Xlza9v5stPVaa44dHgqU9UPmQYpEuigQAn9TAGLQwm98OKk0nu/QGmRJuc4zWAYs3EiRoIzNFTgPO36YSojPY3NVvhxXgbFAoMTQFaW+/6liACFjGBBvy7LAA92G3v0PaNsIiqbF9RVWRe+ab3kez2nsreaXEj9r/uVcQ+cpnvozoIuA68GTVJHO3Ae/SjleQwJcsm0HnhuhsOCKRRcQtnwcw0Z4xdsDAMDExaDHhazVyrpnmEiOkqVWQnSGfuyomCxrpozmTHDiX6tVeS/tEGOox/DQiRZjpDw+UGjXFJMafXkNBIKOMqpAYwrYXqlfMIU42g+RsMMwXt95WXQbR16Bv9sNY/P6nGsk2/kO9knHjkix+SUtEmHcCu0flu31p09tm/se/thnmpbdc1XshD2n2fOa+8E</latexit><latexit sha1_base64="ovLLOo7qbxZJB25bQk76zn1xpwc=">AAAC5XichVJNT9wwEHVCC3QpkNJjL1YXJLigZC/0iMQFictWYj+kzSpynNldC+dD9qSwRLn3wgGEuPY/cet/4YCzmwPLljKS5af3Zp7HY4eZFBpd969lr3z4uLq2/qmx8Xlza9v5stPVaa44dHgqU9UPmQYpEuigQAn9TAGLQwm98OKk0nu/QGmRJuc4zWAYs3EiRoIzNFTgPO36YSojPY3NVvhxXgbFAoMTQFaW+/6liACFjGBBvy7LAA92G3v0PaNsIiqbF9RVWRe+ab3kez2nsreaXEj9r/uVcQ+cpnvozoIuA68GTVJHO3Ae/SjleQwJcsm0HnhuhsOCKRRcQtnwcw0Z4xdsDAMDExaDHhazVyrpnmEiOkqVWQnSGfuyomCxrpozmTHDiX6tVeS/tEGOox/DQiRZjpDw+UGjXFJMafXkNBIKOMqpAYwrYXqlfMIU42g+RsMMwXt95WXQbR16Bv9sNY/P6nGsk2/kO9knHjkix+SUtEmHcCu0flu31p09tm/se/thnmpbdc1XshD2n2fOa+8E</latexit><latexit sha1_base64="ck8pdC+ekZH4nUmSP+ZG7r8lEyk=">AAAB2XicbZDNSgMxFIXv1L86Vq1rN8EiuCozbnQpuHFZwbZCO5RM5k4bmskMyR2hDH0BF25EfC93vo3pz0JbDwQ+zknIvSculLQUBN9ebWd3b/+gfugfNfzjk9Nmo2fz0gjsilzl5jnmFpXU2CVJCp8LgzyLFfbj6f0i77+gsTLXTzQrMMr4WMtUCk7O6oyaraAdLMW2IVxDC9YaNb+GSS7KDDUJxa0dhEFBUcUNSaFw7g9LiwUXUz7GgUPNM7RRtRxzzi6dk7A0N+5oYkv394uKZ9bOstjdzDhN7Ga2MP/LBiWlt1EldVESarH6KC0Vo5wtdmaJNChIzRxwYaSblYkJN1yQa8Z3HYSbG29D77odOn4MoA7ncAFXEMIN3MEDdKALAhJ4hXdv4r15H6uuat66tDP4I+/zBzjGijg=</latexit><latexit sha1_base64="gCaWtcKmStfNzdASBHUtlbYkjRc=">AAAC2nichVI9T8MwEHXCd/kqrCwWbSVYUMICIxILI0gUkJoqcpxra+F8yL5AS5SdhQGE+GFs/BcGnLYDpRROsvz0nu/5fOcglUKj43xY9tz8wuLS8kpldW19Y7O6tXalk0xxaPJEJuomYBqkiKGJAiXcpApYFEi4Dm5PS/36DpQWSXyJgxTaEevGoiM4Q0P51c+6FyQy1IPIbLkXZYWfTzDYA2RFsefdixBQyBAm9Iei8HG/XmnQ/4zSnihtvlH9Ypw403rK92FEpbOKnDj6p3vfuPvVmnPgDINOA3cMamQc53713QsTnkUQI5dM65brpNjOmULBJRQVL9OQMn7LutAyMGYR6HY+nFJBG4YJaSdRZsVIh+z3jJxFuizOnIwY9vRPrSR/01oZdo7buYjTDCHmo4s6maSY0HLkNBQKOMqBAYwrYWqlvMcU42g+RsU0wf355GlwdXjgGnzhkGWyQ3bJHnHJETkhZ+ScNAm3AuvRerZe7K79ZL+O2mVb475tk4mw374AexLtrA==</latexit><latexit sha1_base64="gCaWtcKmStfNzdASBHUtlbYkjRc=">AAAC2nichVI9T8MwEHXCd/kqrCwWbSVYUMICIxILI0gUkJoqcpxra+F8yL5AS5SdhQGE+GFs/BcGnLYDpRROsvz0nu/5fOcglUKj43xY9tz8wuLS8kpldW19Y7O6tXalk0xxaPJEJuomYBqkiKGJAiXcpApYFEi4Dm5PS/36DpQWSXyJgxTaEevGoiM4Q0P51c+6FyQy1IPIbLkXZYWfTzDYA2RFsefdixBQyBAm9Iei8HG/XmnQ/4zSnihtvlH9Ypw403rK92FEpbOKnDj6p3vfuPvVmnPgDINOA3cMamQc53713QsTnkUQI5dM65brpNjOmULBJRQVL9OQMn7LutAyMGYR6HY+nFJBG4YJaSdRZsVIh+z3jJxFuizOnIwY9vRPrSR/01oZdo7buYjTDCHmo4s6maSY0HLkNBQKOMqBAYwrYWqlvMcU42g+RsU0wf355GlwdXjgGnzhkGWyQ3bJHnHJETkhZ+ScNAm3AuvRerZe7K79ZL+O2mVb475tk4mw374AexLtrA==</latexit><latexit sha1_base64="b7p/Nv50M4YPeK3je1RXJtAWjNA=">AAAC5XichVJNTxsxEPUuUNKUlgDHXiySSOkF7XKhR6ReKvUSpAaQstHK650kVrwfsmcLYbV3Lj2AEFf+U2/8lx7qTfZAEkJHsvz03szzeOwglUKj4zxb9sbm1rvt2vv6h52Pn3Ybe/vnOskUhx5PZKIuA6ZBihh6KFDCZaqARYGEi2DyrdQvfoHSIol/4jSFQcRGsRgKztBQfuNvywsSGeppZLbci7LCzxcYHAOyouh4VyIEFDKEBf2mKHz80qq36f+M0rEobV5Q10VVuNZ6xfdmTqXrmlxIfdP92rj7jaZz5MyCrgK3Ak1SRddv/PHChGcRxMgl07rvOikOcqZQcAlF3cs0pIxP2Aj6BsYsAj3IZ69U0LZhQjpMlFkx0hn7siJnkS6bM5kRw7Fe1kryNa2f4fDrIBdxmiHEfH7QMJMUE1o+OQ2FAo5yagDjSpheKR8zxTiaj1E3Q3CXr7wKzo+PXIPPnObpj2ocNfKZHJIOcckJOSXfSZf0CLcC69a6s+7tkf3bfrAf56m2VdUckIWwn/4BzcvvAg==</latexit><latexit sha1_base64="ovLLOo7qbxZJB25bQk76zn1xpwc=">AAAC5XichVJNT9wwEHVCC3QpkNJjL1YXJLigZC/0iMQFictWYj+kzSpynNldC+dD9qSwRLn3wgGEuPY/cet/4YCzmwPLljKS5af3Zp7HY4eZFBpd969lr3z4uLq2/qmx8Xlza9v5stPVaa44dHgqU9UPmQYpEuigQAn9TAGLQwm98OKk0nu/QGmRJuc4zWAYs3EiRoIzNFTgPO36YSojPY3NVvhxXgbFAoMTQFaW+/6liACFjGBBvy7LAA92G3v0PaNsIiqbF9RVWRe+ab3kez2nsreaXEj9r/uVcQ+cpnvozoIuA68GTVJHO3Ae/SjleQwJcsm0HnhuhsOCKRRcQtnwcw0Z4xdsDAMDExaDHhazVyrpnmEiOkqVWQnSGfuyomCxrpozmTHDiX6tVeS/tEGOox/DQiRZjpDw+UGjXFJMafXkNBIKOMqpAYwrYXqlfMIU42g+RsMMwXt95WXQbR16Bv9sNY/P6nGsk2/kO9knHjkix+SUtEmHcCu0flu31p09tm/se/thnmpbdc1XshD2n2fOa+8E</latexit><latexit sha1_base64="ovLLOo7qbxZJB25bQk76zn1xpwc=">AAAC5XichVJNT9wwEHVCC3QpkNJjL1YXJLigZC/0iMQFictWYj+kzSpynNldC+dD9qSwRLn3wgGEuPY/cet/4YCzmwPLljKS5af3Zp7HY4eZFBpd969lr3z4uLq2/qmx8Xlza9v5stPVaa44dHgqU9UPmQYpEuigQAn9TAGLQwm98OKk0nu/QGmRJuc4zWAYs3EiRoIzNFTgPO36YSojPY3NVvhxXgbFAoMTQFaW+/6liACFjGBBvy7LAA92G3v0PaNsIiqbF9RVWRe+ab3kez2nsreaXEj9r/uVcQ+cpnvozoIuA68GTVJHO3Ae/SjleQwJcsm0HnhuhsOCKRRcQtnwcw0Z4xdsDAMDExaDHhazVyrpnmEiOkqVWQnSGfuyomCxrpozmTHDiX6tVeS/tEGOox/DQiRZjpDw+UGjXFJMafXkNBIKOMqpAYwrYXqlfMIU42g+RsMMwXt95WXQbR16Bv9sNY/P6nGsk2/kO9knHjkix+SUtEmHcCu0flu31p09tm/se/thnmpbdc1XshD2n2fOa+8E</latexit><latexit sha1_base64="ovLLOo7qbxZJB25bQk76zn1xpwc=">AAAC5XichVJNT9wwEHVCC3QpkNJjL1YXJLigZC/0iMQFictWYj+kzSpynNldC+dD9qSwRLn3wgGEuPY/cet/4YCzmwPLljKS5af3Zp7HY4eZFBpd969lr3z4uLq2/qmx8Xlza9v5stPVaa44dHgqU9UPmQYpEuigQAn9TAGLQwm98OKk0nu/QGmRJuc4zWAYs3EiRoIzNFTgPO36YSojPY3NVvhxXgbFAoMTQFaW+/6liACFjGBBvy7LAA92G3v0PaNsIiqbF9RVWRe+ab3kez2nsreaXEj9r/uVcQ+cpnvozoIuA68GTVJHO3Ae/SjleQwJcsm0HnhuhsOCKRRcQtnwcw0Z4xdsDAMDExaDHhazVyrpnmEiOkqVWQnSGfuyomCxrpozmTHDiX6tVeS/tEGOox/DQiRZjpDw+UGjXFJMafXkNBIKOMqpAYwrYXqlfMIU42g+RsMMwXt95WXQbR16Bv9sNY/P6nGsk2/kO9knHjkix+SUtEmHcCu0flu31p09tm/se/thnmpbdc1XshD2n2fOa+8E</latexit><latexit sha1_base64="ovLLOo7qbxZJB25bQk76zn1xpwc=">AAAC5XichVJNT9wwEHVCC3QpkNJjL1YXJLigZC/0iMQFictWYj+kzSpynNldC+dD9qSwRLn3wgGEuPY/cet/4YCzmwPLljKS5af3Zp7HY4eZFBpd969lr3z4uLq2/qmx8Xlza9v5stPVaa44dHgqU9UPmQYpEuigQAn9TAGLQwm98OKk0nu/QGmRJuc4zWAYs3EiRoIzNFTgPO36YSojPY3NVvhxXgbFAoMTQFaW+/6liACFjGBBvy7LAA92G3v0PaNsIiqbF9RVWRe+ab3kez2nsreaXEj9r/uVcQ+cpnvozoIuA68GTVJHO3Ae/SjleQwJcsm0HnhuhsOCKRRcQtnwcw0Z4xdsDAMDExaDHhazVyrpnmEiOkqVWQnSGfuyomCxrpozmTHDiX6tVeS/tEGOox/DQiRZjpDw+UGjXFJMafXkNBIKOMqpAYwrYXqlfMIU42g+RsMMwXt95WXQbR16Bv9sNY/P6nGsk2/kO9knHjkix+SUtEmHcCu0flu31p09tm/se/thnmpbdc1XshD2n2fOa+8E</latexit><latexit sha1_base64="ovLLOo7qbxZJB25bQk76zn1xpwc=">AAAC5XichVJNT9wwEHVCC3QpkNJjL1YXJLigZC/0iMQFictWYj+kzSpynNldC+dD9qSwRLn3wgGEuPY/cet/4YCzmwPLljKS5af3Zp7HY4eZFBpd969lr3z4uLq2/qmx8Xlza9v5stPVaa44dHgqU9UPmQYpEuigQAn9TAGLQwm98OKk0nu/QGmRJuc4zWAYs3EiRoIzNFTgPO36YSojPY3NVvhxXgbFAoMTQFaW+/6liACFjGBBvy7LAA92G3v0PaNsIiqbF9RVWRe+ab3kez2nsreaXEj9r/uVcQ+cpnvozoIuA68GTVJHO3Ae/SjleQwJcsm0HnhuhsOCKRRcQtnwcw0Z4xdsDAMDExaDHhazVyrpnmEiOkqVWQnSGfuyomCxrpozmTHDiX6tVeS/tEGOox/DQiRZjpDw+UGjXFJMafXkNBIKOMqpAYwrYXqlfMIU42g+RsMMwXt95WXQbR16Bv9sNY/P6nGsk2/kO9knHjkix+SUtEmHcCu0flu31p09tm/se/thnmpbdc1XshD2n2fOa+8E</latexit><latexit sha1_base64="ovLLOo7qbxZJB25bQk76zn1xpwc=">AAAC5XichVJNT9wwEHVCC3QpkNJjL1YXJLigZC/0iMQFictWYj+kzSpynNldC+dD9qSwRLn3wgGEuPY/cet/4YCzmwPLljKS5af3Zp7HY4eZFBpd969lr3z4uLq2/qmx8Xlza9v5stPVaa44dHgqU9UPmQYpEuigQAn9TAGLQwm98OKk0nu/QGmRJuc4zWAYs3EiRoIzNFTgPO36YSojPY3NVvhxXgbFAoMTQFaW+/6liACFjGBBvy7LAA92G3v0PaNsIiqbF9RVWRe+ab3kez2nsreaXEj9r/uVcQ+cpnvozoIuA68GTVJHO3Ae/SjleQwJcsm0HnhuhsOCKRRcQtnwcw0Z4xdsDAMDExaDHhazVyrpnmEiOkqVWQnSGfuyomCxrpozmTHDiX6tVeS/tEGOox/DQiRZjpDw+UGjXFJMafXkNBIKOMqpAYwrYXqlfMIU42g+RsMMwXt95WXQbR16Bv9sNY/P6nGsk2/kO9knHjkix+SUtEmHcCu0flu31p09tm/se/thnmpbdc1XshD2n2fOa+8E</latexit>

Figure: Two choices of predictive models for entropy coding: pθ(z t | z t−1)Kalman Filter; pθ(z t | z<t) LSTM.

I Generative model: p(x1:T , z1:T ) =∏T

t=1 pθ(z t|z<t)pθ(x t|z t).

I Encode/decode frame x t using image encoder/decoder

I Leverage predictive models to capture temporal redundancy

Improved Video Compression Model

x1:T<latexit sha1_base64="YqQCXMo5A7SqXDzJKmdtZ2M1Ar8=">AAAB/XicbVDNS8MwHE39nPOrfty8BIfgabQiKJ6GXjxO2BdspaRpuoWlSUlScZbiv+LFgyJe/T+8+d+Ybj3o5oOQx3u/H3l5QcKo0o7zbS0tr6yurVc2qptb2zu79t5+R4lUYtLGggnZC5AijHLS1lQz0kskQXHASDcY3xR+955IRQVv6UlCvBgNOY0oRtpIvn04CAQL1SQ2V/aQ+5l71cp9u+bUnSngInFLUgMlmr79NQgFTmPCNWZIqb7rJNrLkNQUM5JXB6kiCcJjNCR9QzmKifKyafocnhglhJGQ5nANp+rvjQzFqghoJmOkR2reK8T/vH6qo0svozxJNeF49lCUMqgFLKqAIZUEazYxBGFJTVaIR0girE1hVVOCO//lRdI5q7tO3b07rzWuyzoq4Agcg1PgggvQALegCdoAg0fwDF7Bm/VkvVjv1sdsdMkqdw7AH1ifP/x2lYw=</latexit><latexit sha1_base64="YqQCXMo5A7SqXDzJKmdtZ2M1Ar8=">AAAB/XicbVDNS8MwHE39nPOrfty8BIfgabQiKJ6GXjxO2BdspaRpuoWlSUlScZbiv+LFgyJe/T+8+d+Ybj3o5oOQx3u/H3l5QcKo0o7zbS0tr6yurVc2qptb2zu79t5+R4lUYtLGggnZC5AijHLS1lQz0kskQXHASDcY3xR+955IRQVv6UlCvBgNOY0oRtpIvn04CAQL1SQ2V/aQ+5l71cp9u+bUnSngInFLUgMlmr79NQgFTmPCNWZIqb7rJNrLkNQUM5JXB6kiCcJjNCR9QzmKifKyafocnhglhJGQ5nANp+rvjQzFqghoJmOkR2reK8T/vH6qo0svozxJNeF49lCUMqgFLKqAIZUEazYxBGFJTVaIR0girE1hVVOCO//lRdI5q7tO3b07rzWuyzoq4Agcg1PgggvQALegCdoAg0fwDF7Bm/VkvVjv1sdsdMkqdw7AH1ifP/x2lYw=</latexit><latexit sha1_base64="YqQCXMo5A7SqXDzJKmdtZ2M1Ar8=">AAAB/XicbVDNS8MwHE39nPOrfty8BIfgabQiKJ6GXjxO2BdspaRpuoWlSUlScZbiv+LFgyJe/T+8+d+Ybj3o5oOQx3u/H3l5QcKo0o7zbS0tr6yurVc2qptb2zu79t5+R4lUYtLGggnZC5AijHLS1lQz0kskQXHASDcY3xR+955IRQVv6UlCvBgNOY0oRtpIvn04CAQL1SQ2V/aQ+5l71cp9u+bUnSngInFLUgMlmr79NQgFTmPCNWZIqb7rJNrLkNQUM5JXB6kiCcJjNCR9QzmKifKyafocnhglhJGQ5nANp+rvjQzFqghoJmOkR2reK8T/vH6qo0svozxJNeF49lCUMqgFLKqAIZUEazYxBGFJTVaIR0girE1hVVOCO//lRdI5q7tO3b07rzWuyzoq4Agcg1PgggvQALegCdoAg0fwDF7Bm/VkvVjv1sdsdMkqdw7AH1ifP/x2lYw=</latexit><latexit sha1_base64="YqQCXMo5A7SqXDzJKmdtZ2M1Ar8=">AAAB/XicbVDNS8MwHE39nPOrfty8BIfgabQiKJ6GXjxO2BdspaRpuoWlSUlScZbiv+LFgyJe/T+8+d+Ybj3o5oOQx3u/H3l5QcKo0o7zbS0tr6yurVc2qptb2zu79t5+R4lUYtLGggnZC5AijHLS1lQz0kskQXHASDcY3xR+955IRQVv6UlCvBgNOY0oRtpIvn04CAQL1SQ2V/aQ+5l71cp9u+bUnSngInFLUgMlmr79NQgFTmPCNWZIqb7rJNrLkNQUM5JXB6kiCcJjNCR9QzmKifKyafocnhglhJGQ5nANp+rvjQzFqghoJmOkR2reK8T/vH6qo0svozxJNeF49lCUMqgFLKqAIZUEazYxBGFJTVaIR0girE1hVVOCO//lRdI5q7tO3b07rzWuyzoq4Agcg1PgggvQALegCdoAg0fwDF7Bm/VkvVjv1sdsdMkqdw7AH1ifP/x2lYw=</latexit>

xt<latexit sha1_base64="GjNWDXVZ+XhHzG1cnk8MHnN/JK8=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKZahf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2FtlCE=</latexit><latexit sha1_base64="GjNWDXVZ+XhHzG1cnk8MHnN/JK8=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKZahf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2FtlCE=</latexit><latexit sha1_base64="GjNWDXVZ+XhHzG1cnk8MHnN/JK8=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKZahf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2FtlCE=</latexit><latexit sha1_base64="GjNWDXVZ+XhHzG1cnk8MHnN/JK8=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKZahf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2FtlCE=</latexit>

µ�(x1:T )<latexit sha1_base64="VrvtK3D1qymnqaWGdn2ZxrYwYfI=">AAACJHicbVDLSsNAFJ3UV62vqEs3g0Wom5KIoOim6MZlhb6gCWEymbZDJ5MwMxFLyMe48VfcuPCBCzd+i5M2C9t6YZjDOedy7z1+zKhUlvVtlFZW19Y3ypuVre2d3T1z/6Ajo0Rg0sYRi0TPR5IwyklbUcVILxYEhT4jXX98m+vdByIkjXhLTWLihmjI6YBipDTlmdeOH7FATkL9pU6YZF46x8QjmmWw9pd71B77qpWdembVqlvTgsvALkAVFNX0zA8niHASEq4wQ1L2bStWboqEopiRrOIkksQIj9GQ9DXkKCTSTadHZvBEMwEcREI/ruCU/duRolDmG2pniNRILmo5+Z/WT9Tg0k0pjxNFOJ4NGiQMqgjmicGACoIVm2iAsKB6V4hHSCCsdK4VHYK9ePIy6JzVbatu359XGzdFHGVwBI5BDdjgAjTAHWiCNsDgCbyAN/BuPBuvxqfxNbOWjKLnEMyV8fML98Gmyw==</latexit><latexit sha1_base64="VrvtK3D1qymnqaWGdn2ZxrYwYfI=">AAACJHicbVDLSsNAFJ3UV62vqEs3g0Wom5KIoOim6MZlhb6gCWEymbZDJ5MwMxFLyMe48VfcuPCBCzd+i5M2C9t6YZjDOedy7z1+zKhUlvVtlFZW19Y3ypuVre2d3T1z/6Ajo0Rg0sYRi0TPR5IwyklbUcVILxYEhT4jXX98m+vdByIkjXhLTWLihmjI6YBipDTlmdeOH7FATkL9pU6YZF46x8QjmmWw9pd71B77qpWdembVqlvTgsvALkAVFNX0zA8niHASEq4wQ1L2bStWboqEopiRrOIkksQIj9GQ9DXkKCTSTadHZvBEMwEcREI/ruCU/duRolDmG2pniNRILmo5+Z/WT9Tg0k0pjxNFOJ4NGiQMqgjmicGACoIVm2iAsKB6V4hHSCCsdK4VHYK9ePIy6JzVbatu359XGzdFHGVwBI5BDdjgAjTAHWiCNsDgCbyAN/BuPBuvxqfxNbOWjKLnEMyV8fML98Gmyw==</latexit><latexit sha1_base64="VrvtK3D1qymnqaWGdn2ZxrYwYfI=">AAACJHicbVDLSsNAFJ3UV62vqEs3g0Wom5KIoOim6MZlhb6gCWEymbZDJ5MwMxFLyMe48VfcuPCBCzd+i5M2C9t6YZjDOedy7z1+zKhUlvVtlFZW19Y3ypuVre2d3T1z/6Ajo0Rg0sYRi0TPR5IwyklbUcVILxYEhT4jXX98m+vdByIkjXhLTWLihmjI6YBipDTlmdeOH7FATkL9pU6YZF46x8QjmmWw9pd71B77qpWdembVqlvTgsvALkAVFNX0zA8niHASEq4wQ1L2bStWboqEopiRrOIkksQIj9GQ9DXkKCTSTadHZvBEMwEcREI/ruCU/duRolDmG2pniNRILmo5+Z/WT9Tg0k0pjxNFOJ4NGiQMqgjmicGACoIVm2iAsKB6V4hHSCCsdK4VHYK9ePIy6JzVbatu359XGzdFHGVwBI5BDdjgAjTAHWiCNsDgCbyAN/BuPBuvxqfxNbOWjKLnEMyV8fML98Gmyw==</latexit><latexit sha1_base64="VrvtK3D1qymnqaWGdn2ZxrYwYfI=">AAACJHicbVDLSsNAFJ3UV62vqEs3g0Wom5KIoOim6MZlhb6gCWEymbZDJ5MwMxFLyMe48VfcuPCBCzd+i5M2C9t6YZjDOedy7z1+zKhUlvVtlFZW19Y3ypuVre2d3T1z/6Ajo0Rg0sYRi0TPR5IwyklbUcVILxYEhT4jXX98m+vdByIkjXhLTWLihmjI6YBipDTlmdeOH7FATkL9pU6YZF46x8QjmmWw9pd71B77qpWdembVqlvTgsvALkAVFNX0zA8niHASEq4wQ1L2bStWboqEopiRrOIkksQIj9GQ9DXkKCTSTadHZvBEMwEcREI/ruCU/duRolDmG2pniNRILmo5+Z/WT9Tg0k0pjxNFOJ4NGiQMqgjmicGACoIVm2iAsKB6V4hHSCCsdK4VHYK9ePIy6JzVbatu359XGzdFHGVwBI5BDdjgAjTAHWiCNsDgCbyAN/BuPBuvxqfxNbOWjKLnEMyV8fML98Gmyw==</latexit>

µ�(xt)<latexit sha1_base64="c/cNSDYktElGk5W1YWlZe5sy2FM=">AAACIHicbVDLSsNAFJ34rPUVdelmsAh1UxIR6rLoxmUF+4AmhMlk0g6dTMLMRCwhn+LGX3HjQhHd6dc4abPowwPDHM65l3vv8RNGpbKsH2NtfWNza7uyU93d2z84NI+OuzJOBSYdHLNY9H0kCaOcdBRVjPQTQVDkM9Lzx7eF33skQtKYP6hJQtwIDTkNKUZKS57ZdPyYBXIS6S9zojT3sgUlGdE8h/V57Sn31IVn1qyGNQVcJXZJaqBE2zO/nSDGaUS4wgxJObCtRLkZEopiRvKqk0qSIDxGQzLQlKOISDebHpjDc60EMIyFflzBqTrfkaFIFtvpygipkVz2CvE/b5Cq8NrNKE9SRTieDQpTBlUMi7RgQAXBik00QVhQvSvEIyQQVjrTqg7BXj55lXQvG7bVsO+vaq2bMo4KOAVnoA5s0AQtcAfaoAMweAav4B18GC/Gm/FpfM1K14yy5wQswPj9Axv9pWA=</latexit><latexit sha1_base64="c/cNSDYktElGk5W1YWlZe5sy2FM=">AAACIHicbVDLSsNAFJ34rPUVdelmsAh1UxIR6rLoxmUF+4AmhMlk0g6dTMLMRCwhn+LGX3HjQhHd6dc4abPowwPDHM65l3vv8RNGpbKsH2NtfWNza7uyU93d2z84NI+OuzJOBSYdHLNY9H0kCaOcdBRVjPQTQVDkM9Lzx7eF33skQtKYP6hJQtwIDTkNKUZKS57ZdPyYBXIS6S9zojT3sgUlGdE8h/V57Sn31IVn1qyGNQVcJXZJaqBE2zO/nSDGaUS4wgxJObCtRLkZEopiRvKqk0qSIDxGQzLQlKOISDebHpjDc60EMIyFflzBqTrfkaFIFtvpygipkVz2CvE/b5Cq8NrNKE9SRTieDQpTBlUMi7RgQAXBik00QVhQvSvEIyQQVjrTqg7BXj55lXQvG7bVsO+vaq2bMo4KOAVnoA5s0AQtcAfaoAMweAav4B18GC/Gm/FpfM1K14yy5wQswPj9Axv9pWA=</latexit><latexit sha1_base64="c/cNSDYktElGk5W1YWlZe5sy2FM=">AAACIHicbVDLSsNAFJ34rPUVdelmsAh1UxIR6rLoxmUF+4AmhMlk0g6dTMLMRCwhn+LGX3HjQhHd6dc4abPowwPDHM65l3vv8RNGpbKsH2NtfWNza7uyU93d2z84NI+OuzJOBSYdHLNY9H0kCaOcdBRVjPQTQVDkM9Lzx7eF33skQtKYP6hJQtwIDTkNKUZKS57ZdPyYBXIS6S9zojT3sgUlGdE8h/V57Sn31IVn1qyGNQVcJXZJaqBE2zO/nSDGaUS4wgxJObCtRLkZEopiRvKqk0qSIDxGQzLQlKOISDebHpjDc60EMIyFflzBqTrfkaFIFtvpygipkVz2CvE/b5Cq8NrNKE9SRTieDQpTBlUMi7RgQAXBik00QVhQvSvEIyQQVjrTqg7BXj55lXQvG7bVsO+vaq2bMo4KOAVnoA5s0AQtcAfaoAMweAav4B18GC/Gm/FpfM1K14yy5wQswPj9Axv9pWA=</latexit><latexit sha1_base64="c/cNSDYktElGk5W1YWlZe5sy2FM=">AAACIHicbVDLSsNAFJ34rPUVdelmsAh1UxIR6rLoxmUF+4AmhMlk0g6dTMLMRCwhn+LGX3HjQhHd6dc4abPowwPDHM65l3vv8RNGpbKsH2NtfWNza7uyU93d2z84NI+OuzJOBSYdHLNY9H0kCaOcdBRVjPQTQVDkM9Lzx7eF33skQtKYP6hJQtwIDTkNKUZKS57ZdPyYBXIS6S9zojT3sgUlGdE8h/V57Sn31IVn1qyGNQVcJXZJaqBE2zO/nSDGaUS4wgxJObCtRLkZEopiRvKqk0qSIDxGQzLQlKOISDebHpjDc60EMIyFflzBqTrfkaFIFtvpygipkVz2CvE/b5Cq8NrNKE9SRTieDQpTBlUMi7RgQAXBik00QVhQvSvEIyQQVjrTqg7BXj55lXQvG7bVsO+vaq2bMo4KOAVnoA5s0AQtcAfaoAMweAav4B18GC/Gm/FpfM1K14yy5wQswPj9Axv9pWA=</latexit>

f<latexit sha1_base64="KT3gym11XAjKBtmQlxpgoE5y3+0=">AAAB9XicbVDLSgMxFL1TX7W+qi7dBIvgqsyIUJdFNy4r2Ae0Y8lkMm1oJhmSjFKG/ocbF4q49V/c+Tdm2llo64GQwzn3kpMTJJxp47rfTmltfWNzq7xd2dnd2z+oHh51tEwVoW0iuVS9AGvKmaBtwwynvURRHAecdoPJTe53H6nSTIp7M02oH+ORYBEj2FjpYRBIHuppbK8smg2rNbfuzoFWiVeQGhRoDatfg1CSNKbCEI617ntuYvwMK8MIp7PKINU0wWSCR7RvqcAx1X42Tz1DZ1YJUSSVPcKgufp7I8OxzqPZyRibsV72cvE/r5+a6MrPmEhSQwVZPBSlHBmJ8gpQyBQlhk8twUQxmxWRMVaYGFtUxZbgLX95lXQu6p5b9+4ua83roo4ynMApnIMHDWjCLbSgDQQUPMMrvDlPzovz7nwsRktOsXMMf+B8/gA38pL3</latexit><latexit sha1_base64="KT3gym11XAjKBtmQlxpgoE5y3+0=">AAAB9XicbVDLSgMxFL1TX7W+qi7dBIvgqsyIUJdFNy4r2Ae0Y8lkMm1oJhmSjFKG/ocbF4q49V/c+Tdm2llo64GQwzn3kpMTJJxp47rfTmltfWNzq7xd2dnd2z+oHh51tEwVoW0iuVS9AGvKmaBtwwynvURRHAecdoPJTe53H6nSTIp7M02oH+ORYBEj2FjpYRBIHuppbK8smg2rNbfuzoFWiVeQGhRoDatfg1CSNKbCEI617ntuYvwMK8MIp7PKINU0wWSCR7RvqcAx1X42Tz1DZ1YJUSSVPcKgufp7I8OxzqPZyRibsV72cvE/r5+a6MrPmEhSQwVZPBSlHBmJ8gpQyBQlhk8twUQxmxWRMVaYGFtUxZbgLX95lXQu6p5b9+4ua83roo4ynMApnIMHDWjCLbSgDQQUPMMrvDlPzovz7nwsRktOsXMMf+B8/gA38pL3</latexit><latexit sha1_base64="KT3gym11XAjKBtmQlxpgoE5y3+0=">AAAB9XicbVDLSgMxFL1TX7W+qi7dBIvgqsyIUJdFNy4r2Ae0Y8lkMm1oJhmSjFKG/ocbF4q49V/c+Tdm2llo64GQwzn3kpMTJJxp47rfTmltfWNzq7xd2dnd2z+oHh51tEwVoW0iuVS9AGvKmaBtwwynvURRHAecdoPJTe53H6nSTIp7M02oH+ORYBEj2FjpYRBIHuppbK8smg2rNbfuzoFWiVeQGhRoDatfg1CSNKbCEI617ntuYvwMK8MIp7PKINU0wWSCR7RvqcAx1X42Tz1DZ1YJUSSVPcKgufp7I8OxzqPZyRibsV72cvE/r5+a6MrPmEhSQwVZPBSlHBmJ8gpQyBQlhk8twUQxmxWRMVaYGFtUxZbgLX95lXQu6p5b9+4ua83roo4ynMApnIMHDWjCLbSgDQQUPMMrvDlPzovz7nwsRktOsXMMf+B8/gA38pL3</latexit><latexit sha1_base64="KT3gym11XAjKBtmQlxpgoE5y3+0=">AAAB9XicbVDLSgMxFL1TX7W+qi7dBIvgqsyIUJdFNy4r2Ae0Y8lkMm1oJhmSjFKG/ocbF4q49V/c+Tdm2llo64GQwzn3kpMTJJxp47rfTmltfWNzq7xd2dnd2z+oHh51tEwVoW0iuVS9AGvKmaBtwwynvURRHAecdoPJTe53H6nSTIp7M02oH+ORYBEj2FjpYRBIHuppbK8smg2rNbfuzoFWiVeQGhRoDatfg1CSNKbCEI617ntuYvwMK8MIp7PKINU0wWSCR7RvqcAx1X42Tz1DZ1YJUSSVPcKgufp7I8OxzqPZyRibsV72cvE/r5+a6MrPmEhSQwVZPBSlHBmJ8gpQyBQlhk8twUQxmxWRMVaYGFtUxZbgLX95lXQu6p5b9+4ua83roo4ynMApnIMHDWjCLbSgDQQUPMMrvDlPzovz7nwsRktOsXMMf+B8/gA38pL3</latexit>

zt<latexit sha1_base64="2+byp70tWvsxbofl6uQHE4ovRBw=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKdShf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2R7lCM=</latexit><latexit sha1_base64="2+byp70tWvsxbofl6uQHE4ovRBw=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKdShf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2R7lCM=</latexit><latexit sha1_base64="2+byp70tWvsxbofl6uQHE4ovRBw=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKdShf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2R7lCM=</latexit><latexit sha1_base64="2+byp70tWvsxbofl6uQHE4ovRBw=">AAAB+XicbVDLSgMxFL3js9bXqEs3wSK4KjMi6LLoxmUF+4B2GDKZtA3NJEOSKdShf+LGhSJu/RN3/o2ZdhbaeiDkcM695OREKWfaeN63s7a+sbm1Xdmp7u7tHxy6R8dtLTNFaItILlU3wppyJmjLMMNpN1UUJxGnnWh8V/idCVWaSfFopikNEjwUbMAINlYKXbcfSR7raWKv/GkWmtCteXVvDrRK/JLUoEQzdL/6sSRZQoUhHGvd873UBDlWhhFOZ9V+pmmKyRgPac9SgROqg3yefIbOrRKjgVT2CIPm6u+NHCe6CGcnE2xGetkrxP+8XmYGN0HORJoZKsjioUHGkZGoqAHFTFFi+NQSTBSzWREZYYWJsWVVbQn+8pdXSfuy7nt1/+Gq1rgt66jAKZzBBfhwDQ24hya0gMAEnuEV3pzceXHenY/F6JpT7pzAHzifP2R7lCM=</latexit>

Quantization

zt<latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit>

Encoders

AE

AE

Binary

AD

AD

zt<latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit><latexit sha1_base64="Yt2K9k0MRgUKaCEUNNmLvHQQcUM=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyLUEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wf1ppfZ</latexit>

Decoder

xt<latexit sha1_base64="X4Q1aFm5XrHWDo+IKYEVuO42eN8=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyKWEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wfylpfX</latexit><latexit sha1_base64="X4Q1aFm5XrHWDo+IKYEVuO42eN8=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyKWEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wfylpfX</latexit><latexit sha1_base64="X4Q1aFm5XrHWDo+IKYEVuO42eN8=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyKWEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wfylpfX</latexit><latexit sha1_base64="X4Q1aFm5XrHWDo+IKYEVuO42eN8=">AAACAXicbVBNS8NAEN3Ur1q/ol4EL8EieCqJCHosevFYwbZCE8Jms2mXbjZhdyKWEC/+FS8eFPHqv/Dmv3HT5qCtD5Z9vDfDzLwg5UyBbX8btaXlldW1+npjY3Nre8fc3eupJJOEdknCE3kXYEU5E7QLDDi9SyXFccBpPxhflX7/nkrFEnELk5R6MR4KFjGCQUu+eeAC4yHN3SDhoZrE+ssfisIH32zaLXsKa5E4FWmiCh3f/HLDhGQxFUA4Vmrg2Cl4OZbACKdFw80UTTEZ4yEdaCpwTJWXTy8orGOthFaUSP0EWFP1d0eOY1VupytjDCM175Xif94gg+jCy5lIM6CCzAZFGbcgsco4rJBJSoBPNMFEMr2rRUZYYgI6tIYOwZk/eZH0TluO3XJuzprtyyqOOjpER+gEOegctdE16qAuIugRPaNX9GY8GS/Gu/ExK60ZVc8++gPj8wfylpfX</latexit>

NoiseRound

Training

After training

p✓(zt | z<t)<latexit sha1_base64="LbQgD7kqKzy9eS/a3cS6ePEaYZw=">AAACPHicdVA9SwNBEN3z2/gVtbRZDEJswp0IWliINpYRTSLkjmNvb2IW9z7YnRPicT/Mxh9hZ2VjoYittXtJCjX6YNnHezPMzAtSKTTa9pM1NT0zOze/sFhZWl5ZXauub7R1kikOLZ7IRF0FTIMUMbRQoISrVAGLAgmd4Oa09Du3oLRI4kscpOBF7DoWPcEZGsmvXqR+7gaJDPUgMl/uYh+QFQWtuyhkCD/Mu6LwkbqRCOk/bn6Exa5frdkNewg6SZwxqZExmn710Q0TnkUQI5dM665jp+jlTKHgEoqKm2lIGb9h19A1NGYRaC8fHl/QHaOEtJco82KkQ/V7R84iXW5oKiOGff3bK8W/vG6GvUMvF3GaIcR8NKiXSYoJLZOkoVDAUQ4MYVwJsyvlfaYYR5N3xYTg/D55krT3Go7dcM73a8cn4zgWyBbZJnXikANyTM5Ik7QIJ/fkmbySN+vBerHerY9R6ZQ17tkkP2B9fgEoTbGk</latexit><latexit sha1_base64="LbQgD7kqKzy9eS/a3cS6ePEaYZw=">AAACPHicdVA9SwNBEN3z2/gVtbRZDEJswp0IWliINpYRTSLkjmNvb2IW9z7YnRPicT/Mxh9hZ2VjoYittXtJCjX6YNnHezPMzAtSKTTa9pM1NT0zOze/sFhZWl5ZXauub7R1kikOLZ7IRF0FTIMUMbRQoISrVAGLAgmd4Oa09Du3oLRI4kscpOBF7DoWPcEZGsmvXqR+7gaJDPUgMl/uYh+QFQWtuyhkCD/Mu6LwkbqRCOk/bn6Exa5frdkNewg6SZwxqZExmn710Q0TnkUQI5dM665jp+jlTKHgEoqKm2lIGb9h19A1NGYRaC8fHl/QHaOEtJco82KkQ/V7R84iXW5oKiOGff3bK8W/vG6GvUMvF3GaIcR8NKiXSYoJLZOkoVDAUQ4MYVwJsyvlfaYYR5N3xYTg/D55krT3Go7dcM73a8cn4zgWyBbZJnXikANyTM5Ik7QIJ/fkmbySN+vBerHerY9R6ZQ17tkkP2B9fgEoTbGk</latexit><latexit sha1_base64="LbQgD7kqKzy9eS/a3cS6ePEaYZw=">AAACPHicdVA9SwNBEN3z2/gVtbRZDEJswp0IWliINpYRTSLkjmNvb2IW9z7YnRPicT/Mxh9hZ2VjoYittXtJCjX6YNnHezPMzAtSKTTa9pM1NT0zOze/sFhZWl5ZXauub7R1kikOLZ7IRF0FTIMUMbRQoISrVAGLAgmd4Oa09Du3oLRI4kscpOBF7DoWPcEZGsmvXqR+7gaJDPUgMl/uYh+QFQWtuyhkCD/Mu6LwkbqRCOk/bn6Exa5frdkNewg6SZwxqZExmn710Q0TnkUQI5dM665jp+jlTKHgEoqKm2lIGb9h19A1NGYRaC8fHl/QHaOEtJco82KkQ/V7R84iXW5oKiOGff3bK8W/vG6GvUMvF3GaIcR8NKiXSYoJLZOkoVDAUQ4MYVwJsyvlfaYYR5N3xYTg/D55krT3Go7dcM73a8cn4zgWyBbZJnXikANyTM5Ik7QIJ/fkmbySN+vBerHerY9R6ZQ17tkkP2B9fgEoTbGk</latexit><latexit sha1_base64="LbQgD7kqKzy9eS/a3cS6ePEaYZw=">AAACPHicdVA9SwNBEN3z2/gVtbRZDEJswp0IWliINpYRTSLkjmNvb2IW9z7YnRPicT/Mxh9hZ2VjoYittXtJCjX6YNnHezPMzAtSKTTa9pM1NT0zOze/sFhZWl5ZXauub7R1kikOLZ7IRF0FTIMUMbRQoISrVAGLAgmd4Oa09Du3oLRI4kscpOBF7DoWPcEZGsmvXqR+7gaJDPUgMl/uYh+QFQWtuyhkCD/Mu6LwkbqRCOk/bn6Exa5frdkNewg6SZwxqZExmn710Q0TnkUQI5dM665jp+jlTKHgEoqKm2lIGb9h19A1NGYRaC8fHl/QHaOEtJco82KkQ/V7R84iXW5oKiOGff3bK8W/vG6GvUMvF3GaIcR8NKiXSYoJLZOkoVDAUQ4MYVwJsyvlfaYYR5N3xYTg/D55krT3Go7dcM73a8cn4zgWyBbZJnXikANyTM5Ik7QIJ/fkmbySN+vBerHerY9R6ZQ17tkkP2B9fgEoTbGk</latexit>

f<latexit sha1_base64="aobgVshmD4k+WfMer3PzPpROslE=">AAAB/3icbVDLSsNAFJ3UV62vqODGzWARXJVEBF0W3bisYB/QlDKZ3LRDJ5MwMxFKzMJfceNCEbf+hjv/xkmbhbYeGOZwzr3MmeMnnCntON9WZWV1bX2julnb2t7Z3bP3DzoqTiWFNo15LHs+UcCZgLZmmkMvkUAin0PXn9wUfvcBpGKxuNfTBAYRGQkWMkq0kYb2kacZDyDz/JgHahqZKwvzfGjXnYYzA14mbknqqERraH95QUzTCISmnCjVd51EDzIiNaMc8pqXKkgInZAR9A0VJAI1yGb5c3xqlACHsTRHaDxTf29kJFJFNjMZET1Wi14h/uf1Ux1eDTImklSDoPOHwpRjHeOiDBwwCVTzqSGESmayYjomklBtKquZEtzFLy+TznnDdRru3UW9eV3WUUXH6ASdIRddoia6RS3URhQ9omf0it6sJ+vFerc+5qMVq9w5RH9gff4AOcKW3g==</latexit><latexit sha1_base64="aobgVshmD4k+WfMer3PzPpROslE=">AAAB/3icbVDLSsNAFJ3UV62vqODGzWARXJVEBF0W3bisYB/QlDKZ3LRDJ5MwMxFKzMJfceNCEbf+hjv/xkmbhbYeGOZwzr3MmeMnnCntON9WZWV1bX2julnb2t7Z3bP3DzoqTiWFNo15LHs+UcCZgLZmmkMvkUAin0PXn9wUfvcBpGKxuNfTBAYRGQkWMkq0kYb2kacZDyDz/JgHahqZKwvzfGjXnYYzA14mbknqqERraH95QUzTCISmnCjVd51EDzIiNaMc8pqXKkgInZAR9A0VJAI1yGb5c3xqlACHsTRHaDxTf29kJFJFNjMZET1Wi14h/uf1Ux1eDTImklSDoPOHwpRjHeOiDBwwCVTzqSGESmayYjomklBtKquZEtzFLy+TznnDdRru3UW9eV3WUUXH6ASdIRddoia6RS3URhQ9omf0it6sJ+vFerc+5qMVq9w5RH9gff4AOcKW3g==</latexit><latexit sha1_base64="aobgVshmD4k+WfMer3PzPpROslE=">AAAB/3icbVDLSsNAFJ3UV62vqODGzWARXJVEBF0W3bisYB/QlDKZ3LRDJ5MwMxFKzMJfceNCEbf+hjv/xkmbhbYeGOZwzr3MmeMnnCntON9WZWV1bX2julnb2t7Z3bP3DzoqTiWFNo15LHs+UcCZgLZmmkMvkUAin0PXn9wUfvcBpGKxuNfTBAYRGQkWMkq0kYb2kacZDyDz/JgHahqZKwvzfGjXnYYzA14mbknqqERraH95QUzTCISmnCjVd51EDzIiNaMc8pqXKkgInZAR9A0VJAI1yGb5c3xqlACHsTRHaDxTf29kJFJFNjMZET1Wi14h/uf1Ux1eDTImklSDoPOHwpRjHeOiDBwwCVTzqSGESmayYjomklBtKquZEtzFLy+TznnDdRru3UW9eV3WUUXH6ASdIRddoia6RS3URhQ9omf0it6sJ+vFerc+5qMVq9w5RH9gff4AOcKW3g==</latexit><latexit sha1_base64="aobgVshmD4k+WfMer3PzPpROslE=">AAAB/3icbVDLSsNAFJ3UV62vqODGzWARXJVEBF0W3bisYB/QlDKZ3LRDJ5MwMxFKzMJfceNCEbf+hjv/xkmbhbYeGOZwzr3MmeMnnCntON9WZWV1bX2julnb2t7Z3bP3DzoqTiWFNo15LHs+UcCZgLZmmkMvkUAin0PXn9wUfvcBpGKxuNfTBAYRGQkWMkq0kYb2kacZDyDz/JgHahqZKwvzfGjXnYYzA14mbknqqERraH95QUzTCISmnCjVd51EDzIiNaMc8pqXKkgInZAR9A0VJAI1yGb5c3xqlACHsTRHaDxTf29kJFJFNjMZET1Wi14h/uf1Ux1eDTImklSDoPOHwpRjHeOiDBwwCVTzqSGESmayYjomklBtKquZEtzFLy+TznnDdRru3UW9eV3WUUXH6ASdIRddoia6RS3URhQ9omf0it6sJ+vFerc+5qMVq9w5RH9gff4AOcKW3g==</latexit>

p✓(f)<latexit sha1_base64="XnrC0n+r9Qq+oX8IWEEEUcLDRzw=">AAACGXicbVDJSgNBEO2JW4xb1KOXxiDES5gRQY9BLx4jmAUyIfT01CRNeha6a4QwzG948Ve8eFDEo578GzvLwSQ+aPrxXhVV9bxECo22/WMV1tY3NreK26Wd3b39g/LhUUvHqeLQ5LGMVcdjGqSIoIkCJXQSBSz0JLS90e3Ebz+C0iKOHnCcQC9kg0gEgjM0Ur9sJ/3M9WLp63FovszFISDLc1p1UUgfFswgz8/75Ypds6egq8SZkwqZo9Evf7l+zNMQIuSSad117AR7GVMouIS85KYaEsZHbABdQyMWgu5l08tyemYUnwaxMi9COlX/dmQs1JPlTGXIcKiXvYn4n9dNMbjuZSJKUoSIzwYFqaQY00lM1BcKOMqxIYwrYXalfMgU42jCLJkQnOWTV0nroubYNef+slK/mcdRJCfklFSJQ65IndyRBmkSTp7IC3kj79az9Wp9WJ+z0oI17zkmC7C+fwHqWaIX</latexit><latexit sha1_base64="XnrC0n+r9Qq+oX8IWEEEUcLDRzw=">AAACGXicbVDJSgNBEO2JW4xb1KOXxiDES5gRQY9BLx4jmAUyIfT01CRNeha6a4QwzG948Ve8eFDEo578GzvLwSQ+aPrxXhVV9bxECo22/WMV1tY3NreK26Wd3b39g/LhUUvHqeLQ5LGMVcdjGqSIoIkCJXQSBSz0JLS90e3Ebz+C0iKOHnCcQC9kg0gEgjM0Ur9sJ/3M9WLp63FovszFISDLc1p1UUgfFswgz8/75Ypds6egq8SZkwqZo9Evf7l+zNMQIuSSad117AR7GVMouIS85KYaEsZHbABdQyMWgu5l08tyemYUnwaxMi9COlX/dmQs1JPlTGXIcKiXvYn4n9dNMbjuZSJKUoSIzwYFqaQY00lM1BcKOMqxIYwrYXalfMgU42jCLJkQnOWTV0nroubYNef+slK/mcdRJCfklFSJQ65IndyRBmkSTp7IC3kj79az9Wp9WJ+z0oI17zkmC7C+fwHqWaIX</latexit><latexit sha1_base64="XnrC0n+r9Qq+oX8IWEEEUcLDRzw=">AAACGXicbVDJSgNBEO2JW4xb1KOXxiDES5gRQY9BLx4jmAUyIfT01CRNeha6a4QwzG948Ve8eFDEo578GzvLwSQ+aPrxXhVV9bxECo22/WMV1tY3NreK26Wd3b39g/LhUUvHqeLQ5LGMVcdjGqSIoIkCJXQSBSz0JLS90e3Ebz+C0iKOHnCcQC9kg0gEgjM0Ur9sJ/3M9WLp63FovszFISDLc1p1UUgfFswgz8/75Ypds6egq8SZkwqZo9Evf7l+zNMQIuSSad117AR7GVMouIS85KYaEsZHbABdQyMWgu5l08tyemYUnwaxMi9COlX/dmQs1JPlTGXIcKiXvYn4n9dNMbjuZSJKUoSIzwYFqaQY00lM1BcKOMqxIYwrYXalfMgU42jCLJkQnOWTV0nroubYNef+slK/mcdRJCfklFSJQ65IndyRBmkSTp7IC3kj79az9Wp9WJ+z0oI17zkmC7C+fwHqWaIX</latexit><latexit sha1_base64="XnrC0n+r9Qq+oX8IWEEEUcLDRzw=">AAACGXicbVDJSgNBEO2JW4xb1KOXxiDES5gRQY9BLx4jmAUyIfT01CRNeha6a4QwzG948Ve8eFDEo578GzvLwSQ+aPrxXhVV9bxECo22/WMV1tY3NreK26Wd3b39g/LhUUvHqeLQ5LGMVcdjGqSIoIkCJXQSBSz0JLS90e3Ebz+C0iKOHnCcQC9kg0gEgjM0Ur9sJ/3M9WLp63FovszFISDLc1p1UUgfFswgz8/75Ypds6egq8SZkwqZo9Evf7l+zNMQIuSSad117AR7GVMouIS85KYaEsZHbABdQyMWgu5l08tyemYUnwaxMi9COlX/dmQs1JPlTGXIcKiXvYn4n9dNMbjuZSJKUoSIzwYFqaQY00lM1BcKOMqxIYwrYXalfMgU42jCLJkQnOWTV0nroubYNef+slK/mcdRJCfklFSJQ65IndyRBmkSTp7IC3kj79az9Wp9WJ+z0oI17zkmC7C+fwHqWaIX</latexit>

µ✓(zt, f)<latexit sha1_base64="PklnUvnlzdizqgVAOXgX0Db4cMI=">AAACQnicbVDLSgNBEJyN7/iKevQyGAQFCbsi6FH04lHBGCUbltnZXjNk9sFMrxCX+TYvfoE3P8CLB0W8enDyOBi1oOmiqpvpqTCXQqPrPjuVqemZ2bn5heri0vLKam1t/UpnheLQ5JnM1HXINEiRQhMFSrjOFbAklNAKe6cDv3UHSossvcR+Dp2E3aYiFpyhlYLajR9mMtL9xLbSTwoTlBMKdgGZMXTHRyEjmDDvjQlwj/7jxMbsBrW623CHoH+JNyZ1MsZ5UHvyo4wXCaTIJdO67bk5dkqmUHAJpuoXGnLGe+wW2pamLAHdKYcRGLptlYjGmbKVIh2qPzdKlujBcXYyYdjVv72B+J/XLjA+6pQizQuElI8eigtJMaODPGkkFHCUfUsYV8LeSnmXKcbRpl61IXi/v/yXXO03PLfhXRzUj0/GccyTTbJFdohHDskxOSPnpEk4eSAv5I28O4/Oq/PhfI5GK854Z4NMwPn6Bge3tJQ=</latexit><latexit sha1_base64="PklnUvnlzdizqgVAOXgX0Db4cMI=">AAACQnicbVDLSgNBEJyN7/iKevQyGAQFCbsi6FH04lHBGCUbltnZXjNk9sFMrxCX+TYvfoE3P8CLB0W8enDyOBi1oOmiqpvpqTCXQqPrPjuVqemZ2bn5heri0vLKam1t/UpnheLQ5JnM1HXINEiRQhMFSrjOFbAklNAKe6cDv3UHSossvcR+Dp2E3aYiFpyhlYLajR9mMtL9xLbSTwoTlBMKdgGZMXTHRyEjmDDvjQlwj/7jxMbsBrW623CHoH+JNyZ1MsZ5UHvyo4wXCaTIJdO67bk5dkqmUHAJpuoXGnLGe+wW2pamLAHdKYcRGLptlYjGmbKVIh2qPzdKlujBcXYyYdjVv72B+J/XLjA+6pQizQuElI8eigtJMaODPGkkFHCUfUsYV8LeSnmXKcbRpl61IXi/v/yXXO03PLfhXRzUj0/GccyTTbJFdohHDskxOSPnpEk4eSAv5I28O4/Oq/PhfI5GK854Z4NMwPn6Bge3tJQ=</latexit><latexit sha1_base64="PklnUvnlzdizqgVAOXgX0Db4cMI=">AAACQnicbVDLSgNBEJyN7/iKevQyGAQFCbsi6FH04lHBGCUbltnZXjNk9sFMrxCX+TYvfoE3P8CLB0W8enDyOBi1oOmiqpvpqTCXQqPrPjuVqemZ2bn5heri0vLKam1t/UpnheLQ5JnM1HXINEiRQhMFSrjOFbAklNAKe6cDv3UHSossvcR+Dp2E3aYiFpyhlYLajR9mMtL9xLbSTwoTlBMKdgGZMXTHRyEjmDDvjQlwj/7jxMbsBrW623CHoH+JNyZ1MsZ5UHvyo4wXCaTIJdO67bk5dkqmUHAJpuoXGnLGe+wW2pamLAHdKYcRGLptlYjGmbKVIh2qPzdKlujBcXYyYdjVv72B+J/XLjA+6pQizQuElI8eigtJMaODPGkkFHCUfUsYV8LeSnmXKcbRpl61IXi/v/yXXO03PLfhXRzUj0/GccyTTbJFdohHDskxOSPnpEk4eSAv5I28O4/Oq/PhfI5GK854Z4NMwPn6Bge3tJQ=</latexit><latexit sha1_base64="PklnUvnlzdizqgVAOXgX0Db4cMI=">AAACQnicbVDLSgNBEJyN7/iKevQyGAQFCbsi6FH04lHBGCUbltnZXjNk9sFMrxCX+TYvfoE3P8CLB0W8enDyOBi1oOmiqpvpqTCXQqPrPjuVqemZ2bn5heri0vLKam1t/UpnheLQ5JnM1HXINEiRQhMFSrjOFbAklNAKe6cDv3UHSossvcR+Dp2E3aYiFpyhlYLajR9mMtL9xLbSTwoTlBMKdgGZMXTHRyEjmDDvjQlwj/7jxMbsBrW623CHoH+JNyZ1MsZ5UHvyo4wXCaTIJdO67bk5dkqmUHAJpuoXGnLGe+wW2pamLAHdKYcRGLptlYjGmbKVIh2qPzdKlujBcXYyYdjVv72B+J/XLjA+6pQizQuElI8eigtJMaODPGkkFHCUfUsYV8LeSnmXKcbRpl61IXi/v/yXXO03PLfhXRzUj0/GccyTTbJFdohHDskxOSPnpEk4eSAv5I28O4/Oq/PhfI5GK854Z4NMwPn6Bge3tJQ=</latexit>f

<latexit sha1_base64="aobgVshmD4k+WfMer3PzPpROslE=">AAAB/3icbVDLSsNAFJ3UV62vqODGzWARXJVEBF0W3bisYB/QlDKZ3LRDJ5MwMxFKzMJfceNCEbf+hjv/xkmbhbYeGOZwzr3MmeMnnCntON9WZWV1bX2julnb2t7Z3bP3DzoqTiWFNo15LHs+UcCZgLZmmkMvkUAin0PXn9wUfvcBpGKxuNfTBAYRGQkWMkq0kYb2kacZDyDz/JgHahqZKwvzfGjXnYYzA14mbknqqERraH95QUzTCISmnCjVd51EDzIiNaMc8pqXKkgInZAR9A0VJAI1yGb5c3xqlACHsTRHaDxTf29kJFJFNjMZET1Wi14h/uf1Ux1eDTImklSDoPOHwpRjHeOiDBwwCVTzqSGESmayYjomklBtKquZEtzFLy+TznnDdRru3UW9eV3WUUXH6ASdIRddoia6RS3URhQ9omf0it6sJ+vFerc+5qMVq9w5RH9gff4AOcKW3g==</latexit><latexit sha1_base64="aobgVshmD4k+WfMer3PzPpROslE=">AAAB/3icbVDLSsNAFJ3UV62vqODGzWARXJVEBF0W3bisYB/QlDKZ3LRDJ5MwMxFKzMJfceNCEbf+hjv/xkmbhbYeGOZwzr3MmeMnnCntON9WZWV1bX2julnb2t7Z3bP3DzoqTiWFNo15LHs+UcCZgLZmmkMvkUAin0PXn9wUfvcBpGKxuNfTBAYRGQkWMkq0kYb2kacZDyDz/JgHahqZKwvzfGjXnYYzA14mbknqqERraH95QUzTCISmnCjVd51EDzIiNaMc8pqXKkgInZAR9A0VJAI1yGb5c3xqlACHsTRHaDxTf29kJFJFNjMZET1Wi14h/uf1Ux1eDTImklSDoPOHwpRjHeOiDBwwCVTzqSGESmayYjomklBtKquZEtzFLy+TznnDdRru3UW9eV3WUUXH6ASdIRddoia6RS3URhQ9omf0it6sJ+vFerc+5qMVq9w5RH9gff4AOcKW3g==</latexit><latexit sha1_base64="aobgVshmD4k+WfMer3PzPpROslE=">AAAB/3icbVDLSsNAFJ3UV62vqODGzWARXJVEBF0W3bisYB/QlDKZ3LRDJ5MwMxFKzMJfceNCEbf+hjv/xkmbhbYeGOZwzr3MmeMnnCntON9WZWV1bX2julnb2t7Z3bP3DzoqTiWFNo15LHs+UcCZgLZmmkMvkUAin0PXn9wUfvcBpGKxuNfTBAYRGQkWMkq0kYb2kacZDyDz/JgHahqZKwvzfGjXnYYzA14mbknqqERraH95QUzTCISmnCjVd51EDzIiNaMc8pqXKkgInZAR9A0VJAI1yGb5c3xqlACHsTRHaDxTf29kJFJFNjMZET1Wi14h/uf1Ux1eDTImklSDoPOHwpRjHeOiDBwwCVTzqSGESmayYjomklBtKquZEtzFLy+TznnDdRru3UW9eV3WUUXH6ASdIRddoia6RS3URhQ9omf0it6sJ+vFerc+5qMVq9w5RH9gff4AOcKW3g==</latexit><latexit sha1_base64="aobgVshmD4k+WfMer3PzPpROslE=">AAAB/3icbVDLSsNAFJ3UV62vqODGzWARXJVEBF0W3bisYB/QlDKZ3LRDJ5MwMxFKzMJfceNCEbf+hjv/xkmbhbYeGOZwzr3MmeMnnCntON9WZWV1bX2julnb2t7Z3bP3DzoqTiWFNo15LHs+UcCZgLZmmkMvkUAin0PXn9wUfvcBpGKxuNfTBAYRGQkWMkq0kYb2kacZDyDz/JgHahqZKwvzfGjXnYYzA14mbknqqERraH95QUzTCISmnCjVd51EDzIiNaMc8pqXKkgInZAR9A0VJAI1yGb5c3xqlACHsTRHaDxTf29kJFJFNjMZET1Wi14h/uf1Ux1eDTImklSDoPOHwpRjHeOiDBwwCVTzqSGESmayYjomklBtKquZEtzFLy+TznnDdRru3UW9eV3WUUXH6ASdIRddoia6RS3URhQ9omf0it6sJ+vFerc+5qMVq9w5RH9gff4AOcKW3g==</latexit>

NoiseRound

Input Video

Reconstructed Video

Figure: Global state f : per-segment, inferred from a segment T of video by LSTMafter encoder µφ; local state zt: per-frame, inferred from x t after encoder µφ.

I Split latent states of a video segment into global state (codingonce) and local states (predictive model for coding)

I Loss: distortion + cross-entropy

Ef ,z1:T∼q[log pθ(x1:T |f , z1:T )] + H [qφ(f |x1:T ), pθ(f )]

+ H [qφ(z1:T |x1:T ), pθ(z1:T )].

I Entropy Coding: arithmetic coding by learned prior models

Choice of Probability Models

I Generative Model:

pθ(x1:T , z1:T , f ) = pθ(f )pθ(z1:T )T∏t=1

pθ(x t|f , z1:T )

I Encoder Model:

qφ(z1:T , f | x1:T ) = qφ(f | x1:T )T∏t=1

qφ(z t | x t).

f ∼ qφ(f | x1:T ) = U(f − 1

2, f +

1

2

)z t ∼ qφ(z t | x t) = U

(z t −

1

2, z t +

1

2

).

where encoders f = µφ(x1:T ) and z t = µφ(x t).I Prior Model:

pθ(f ) =

dim(f )∏i

pθ(f i) ∗ U(−1

2,

1

2);

pθ(z1:T ) =T∏t

dim(z)∏i

pθ(z it | z i<t) ∗ U(−1

2,

1

2),

Gaussian convoluted with uniform; closed-form evaluation.

Verification Experiments

Datasets: Sprites; BAIR; Kinetics.

Latent Variable Distribution Visualization

4 2 0 2 4Observation

0.00

0.05

0.10

0.15

0.20

Pro

babi

lity

4 2 0 2 4Observation

0.00

0.05

0.10

0.15

0.20

0.25

Pro

babi

lity

4 2 0 2 4Observation

0.00

0.05

0.10

0.15

0.20

0.25

0.30

0.35

Pro

babi

lity

4 2 0 2 4Observation

0.0

0.1

0.2

0.3

0.4

0.5

0.6

Pro

babi

lity

Inference PosteriorPrior Distribution

(a) pθ(f i) (b) pθ(f j) (c) pθ(z i1) (d) pθ(z j1)

Figure: Empirical distributions of inference posteriors and learned prior model.

Latent Variable Entropy Visualization

(a) Sprites (b) BAIR (c) Kinetics

f z1 z2 z3 z4 z5 z6 z7 z81.5

2.0

2.5

3.0

3.5

4.0

Log 1

0 E

ntro

py [b

its]

LSTMP-LKFP-LGLSTMP-LG

f z1 z2 z3 z4 z5 z6 z7 z8 z9 z102.8

3.0

3.2

3.4

3.6

3.8

4.0

Log 1

0 E

ntro

py [b

its]

f z1 z2 z3 z4 z5 z6 z7 z8 z9 z102.8

3.0

3.2

3.4

3.6

3.8

4.0

Log 1

0 E

ntro

py [b

its]

Figure: Average bits of information stored in f and z1:T

Summary: global state stores much more information than local state;predictive model save bits; LSTM works better than Kalman filter.

Comparison Experiments

Quantitative Comparison (Rate-distortion curves)

(a) Sprites (b) BAIR (c) Kinetics

0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4bit rate [bits/pixel]

15

20

25

30

35

40

45

50

Ave

rage

Fra

me

PS

NR

-RG

B [d

B]

0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4bit rate [bits/pixel]

15

20

25

30

35

40

45

50

Ave

rage

Fra

me

PS

NR

-RG

B [d

B]

0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4bit rate [bits/pixel]

15

20

25

30

35

40

45

50

Ave

rage

Fra

me

PS

NR

-RG

B [d

B]

H.264H.265VP9KFP-LGLSTMP-LGLSTMP-L

Qualitative Comparison

Ours (0.29 bpp, 38.1 dB) Original Ours (0.39 bpp)VP9 (0.39 bpp)

VP9 (0.44 bpp, 25.7 dB) 32.0 dB 29.3 dB

t=1 t=5 t=10 30.1 dB 30.8 dB

Figure: Compressed videos by our LSTMP-LG and VP9 in low-bit rate regime.

Generative Models

Generative Models

GENERATIVE GRAMMATIKTHEORIE.ppt

GENERATIVE GRAMMATIKTHEORIE.ppt

Improving Inference for Neural Image Compression · 2020. 9. 26. · Improving Inference for Neural Image Compression Yibo Yang, Robert Bamler, Stephan Mandt Department of Computer

Improving Inference for Neural Image Compression · 2020. 9. 26. · Improving Inference for Neural Image Compression Yibo Yang, Robert Bamler, Stephan Mandt Department of Computer

Conceptual framework for generative design - Generative Art

Conceptual framework for generative design - Generative Art

Generative Structural Analysis Page 1 Generative ...bndtechsource.ucoz.com/V5_Online_Docs/Ana_Sim/estug2.pdf · Generative Structural Analysis Preface ... extension to Generative

Generative Structural Analysis Page 1 Generative ...bndtechsource.ucoz.com/V5_Online_Docs/Ana_Sim/estug2.pdf · Generative Structural Analysis Preface ... extension to Generative

Generative Adversarial Networks (part 2)deeplearning.cs.cmu.edu/document/slides/bstriner_gans_part_2.pdf · Unrolled Generative Adversarial Networks Unrolled Generative Adversarial

Generative Adversarial Networks (part 2)deeplearning.cs.cmu.edu/document/slides/bstriner_gans_part_2.pdf · Unrolled Generative Adversarial Networks Unrolled Generative Adversarial

Enric Colabella Generative Art Philosophy · 2021. 2. 11. · 14h Generative Art Conference GA2011 Generative Art Philosophy – Ars Artium Prof. Enrica Colabella Diap, Generative

Enric Colabella Generative Art Philosophy · 2021. 2. 11. · 14h Generative Art Conference GA2011 Generative Art Philosophy – Ars Artium Prof. Enrica Colabella Diap, Generative

Generative Art

Generative Art

Generative junji

Generative junji

Generative Algorithm

Generative Algorithm

Generative Multi-Agent Behavioral Cloning - Stephan Zheng€¦ · cloning, where the optimal agent policy is probabilistic and multi-modal in nature, and must reason over the behavior

Generative Multi-Agent Behavioral Cloning - Stephan Zheng€¦ · cloning, where the optimal agent policy is probabilistic and multi-modal in nature, and must reason over the behavior

Generative Phonology

Generative Phonology

Generative Compression - arxiv.org · Generative Compression Shibani Santurkar David Buddeny Nir Shavit ... Our NCode model architecture was largely motivated by the work of [20],

Generative Compression - arxiv.org · Generative Compression Shibani Santurkar David Buddeny Nir Shavit ... Our NCode model architecture was largely motivated by the work of [20],

Getting Started Generative Design - BIM@SGbimsg.org/.../2-Generative-design-classroom-session... · Getting Started –Generative Design Agenda • (10 mins) Introduction to Generative

Getting Started Generative Design - [email protected]/.../2-Generative-design-classroom-session... · Getting Started –Generative Design Agenda • (10 mins) Introduction to Generative

Generative Function

Generative Function

Generative Morphology

Generative Morphology

Deep Generative Video Compression · 2) A new neural codec for video compression. We employ the above paradigm towards building an end-to-end trainable codec. To the best of our knowledge,

Deep Generative Video Compression · 2) A new neural codec for video compression. We employ the above paradigm towards building an end-to-end trainable codec. To the best of our knowledge,

Deep Generative Models for Distribution-Preserving Lossy Compression · 2018-10-27 · Deep Generative Models for Distribution-Preserving Lossy Compression Michael Tschannen ETH Zürich

Deep Generative Models for Distribution-Preserving Lossy Compression · 2018-10-27 · Deep Generative Models for Distribution-Preserving Lossy Compression Michael Tschannen ETH Zürich

Language as a Latent Variable: Discrete Generative Models for Sentence Compression (EMNLP 2016)

Language as a Latent Variable: Discrete Generative Models for Sentence Compression (EMNLP 2016)

Generative Typografie

Generative Typografie