Reading: I. Goodfellow et al., Generative adversarial...

26
Generative Adversarial Networks Reading: I. Goodfellow et al., Generative adversarial networks, NIPS 2014

Transcript of Reading: I. Goodfellow et al., Generative adversarial...

Page 1: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Generative Adversarial Networks

Reading: I. Goodfellow et al., Generative adversarial networks, NIPS 2014

Page 2: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Adversarial Networks

Generative Model Real world Discriminative

Model

real or fake?

From https://www.cs.colorado.edu/~mozer/Teaching/syllabi/DeepLearningFall2017/lectures/gan.pptx

Page 3: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Training Procedure: Basic Idea

•  G tries to fool D

•  D tries not to be fooled

•  Models are trained simultaneously –  As G gets better, D has a more

challenging task –  As D gets better, G has a more

challenging task

•  Ultimately, we don’t care about the D –  Its role is to force G to work harder

Discriminative

Model

real or fake?

Generative Model

noise (Z)

Real world

From https://www.cs.colorado.edu/~mozer/Teaching/syllabi/DeepLearningFall2017/lectures/gan.pptx

Page 4: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative
Page 5: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

GAN Training Algorithm

Page 6: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

From Goodfellow et al., 2014

Page 7: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

http://www.iangoodfellow.com/slides/2018-06-22-gan_tutorial.pdf

Page 8: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

http://www.iangoodfellow.com/slides/2018-06-22-gan_tutorial.pdf

Page 9: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Kerras et al, PROGRESSIVE GROWING OF GANS FOR IMPROVED QUALITY, STABILITY, AND VARIATION

Gradually adds layers to both generator and discriminator

Page 10: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative
Page 11: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Vector arithmetic

Page 12: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative
Page 13: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Cycle GANs (Zhu et al., 2017; arXiv:1703:10593v2 [cs.CV])

Given two image collections, algorithm learns to translate an image from one collection to the other

From https://www.cs.colorado.edu/~mozer/Teaching/syllabi/DeepLearningFall2017/lectures/gan.pptx

Page 14: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Photos to paintings

From https://www.cs.colorado.edu/~mozer/Teaching/syllabi/DeepLearningFall2017/lectures/gan.pptx

Page 15: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

From https://www.cs.colorado.edu/~mozer/Teaching/syllabi/DeepLearningFall2017/lectures/gan.pptx

Page 16: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Image-to-Image Translation with Conditional Adversarial Nets Isola et al., 2017

Page 17: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

https://phillipi.github.io/pix2pix/ https://arxiv.org/pdf/1808.06601.pdf

Page 18: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Image-to-Image Translation Image-to-Image Translation with Conditional Adversarial Networks

Phillip Isola Jun-Yan Zhu Tinghui Zhou Alexei A. Efros

Page 19: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative
Page 20: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative
Page 21: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative
Page 22: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative
Page 23: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative
Page 24: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

Generative Adversarial Text to Image Synthesis Reed et al.

Page 25: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative
Page 26: Reading: I. Goodfellow et al., Generative adversarial ...web.cecs.pdx.edu/~mm/MachineLearningFall2018/GANs.pdfGenerative Adversarial Networks Reading: I. Goodfellow et al., Generative

https://github.com/reedscot/icml2016


Lecture 9: Unsupervised, Generative & Adversarial Networks · Lecture 9: Unsupervised, Generative & Adversarial Networks ... GENERATIVE & ADVERSARIAL NETWORKS - 20 o Autoencoders

Lecture 9: Unsupervised, Generative & Adversarial Networks · Lecture 9: Unsupervised, Generative & Adversarial Networks ... GENERATIVE & ADVERSARIAL NETWORKS - 20 o Autoencoders

COMP9444 Neural Networks and Deep Learning 9b. Generative Adversarial … · 2020. 7. 25. · COMP9444 20T2 Generative Adversarial Networks 13 Generative Adversarial Networks GAN

COMP9444 Neural Networks and Deep Learning 9b. Generative Adversarial … · 2020. 7. 25. · COMP9444 20T2 Generative Adversarial Networks 13 Generative Adversarial Networks GAN

Generative Adversarial Networksbhiksha/courses/deeplearning/Spring.2018/... · 2018. 3. 29. · Generative Adversarial Networks Generative adversarial networks (GANs) are relatively

Generative Adversarial Networksbhiksha/courses/deeplearning/Spring.2018/... · 2018. 3. 29. · Generative Adversarial Networks Generative adversarial networks (GANs) are relatively

Generative Adversarial Networks (GANs)

Generative Adversarial Networks (GANs)

Taxonomy of generative models - TUMTaxonomy of generative models Prof. Leal-Taixé and Prof. Niessner Figure from Ian Goodfellow, Tutorial on Generative Adversarial /networks, 2017

Taxonomy of generative models - TUMTaxonomy of generative models Prof. Leal-Taixé and Prof. Niessner Figure from Ian Goodfellow, Tutorial on Generative Adversarial /networks, 2017

Generative Adversarial Networks (GANs) Adversarial Networks (GANs) Hossein Azizpour Most of the slides are courtesy of Dr. Ian Goodfellow (Research Scientist at OpenAI) and from his

Generative Adversarial Networks (GANs) Adversarial Networks (GANs) Hossein Azizpour Most of the slides are courtesy of Dr. Ian Goodfellow (Research Scientist at OpenAI) and from his

EmotiGAN: Emoji Art using Generative Adversarial Networkscs229.stanford.edu/proj2017/final-reports/5244346.pdfA. Generative Adversarial Networks A Generative Adversarial Network[4]

EmotiGAN: Emoji Art using Generative Adversarial Networkscs229.stanford.edu/proj2017/final-reports/5244346.pdfA. Generative Adversarial Networks A Generative Adversarial Network[4]

Generative Adversarial Transformers

Generative Adversarial Transformers

Generative Adversarial Networks (GANs) · where D is our discriminator, G is our generator, and and are their corresponding parameters. [ 2 ] E. A. Goodfellow, Ian, Generative Adversarial

Generative Adversarial Networks (GANs) · where D is our discriminator, G is our generator, and and are their corresponding parameters. [ 2 ] E. A. Goodfellow, Ian, Generative Adversarial

Generative Adversarial Perturbations - arXiv

Generative Adversarial Perturbations - arXiv

SDM-NET: Deep Generative Network for Structured ...static.tongtianta.site/paper_pdf/81ad7ddc-e19f-11e9-a69e...Generative Adversarial Networks (GANs) [Goodfellow et al. 2014] can be

SDM-NET: Deep Generative Network for Structured ...static.tongtianta.site/paper_pdf/81ad7ddc-e19f-11e9-a69e...Generative Adversarial Networks (GANs) [Goodfellow et al. 2014] can be

Generative Adversarial Networks (part 2)deeplearning.cs.cmu.edu/document/slides/bstriner_gans_part_2.pdf · Unrolled Generative Adversarial Networks Unrolled Generative Adversarial

Generative Adversarial Networks (part 2)deeplearning.cs.cmu.edu/document/slides/bstriner_gans_part_2.pdf · Unrolled Generative Adversarial Networks Unrolled Generative Adversarial

Generative Adversarial Networks - Ian Goodfellow...Deep Learning Workshop, ICML 2015 --- Ian Goodfellow In today’s talk… • “Generative Adversarial Networks” Goodfellow et

Generative Adversarial Networks - Ian Goodfellow...Deep Learning Workshop, ICML 2015 --- Ian Goodfellow In today’s talk… • “Generative Adversarial Networks” Goodfellow et

Triple Generative Adversarial Netspapers.nips.cc/paper/6997-triple-generative-adversarial-nets.pdf · the labels. To address the problems, we present triple generative adversarial

Triple Generative Adversarial Netspapers.nips.cc/paper/6997-triple-generative-adversarial-nets.pdf · the labels. To address the problems, we present triple generative adversarial

Generative Adversarial Nets - cosy.sbg.ac.atheld/teaching/wiss_arbeiten/slides_19-2… · paper "Generative Adversarial Networks" from Ian Goodfellow et al. (2014) [2]. Schuiki Johannes,

Generative Adversarial Nets - cosy.sbg.ac.atheld/teaching/wiss_arbeiten/slides_19-2… · paper "Generative Adversarial Networks" from Ian Goodfellow et al. (2014) [2]. Schuiki Johannes,

Lec: Generative Adversarial Networks

Lec: Generative Adversarial Networks

MetricGAN: Generative Adversarial Networks based Black-box ...proceedings.mlr.press/v97/fu19b/fu19b.pdf · Generative adversarial networks (GANs) (Goodfellow et al., 2014) has shown

MetricGAN: Generative Adversarial Networks based Black-box ...proceedings.mlr.press/v97/fu19b/fu19b.pdf · Generative adversarial networks (GANs) (Goodfellow et al., 2014) has shown

Adversarial Distillation of Bayesian Neural Network Posteriorsproceedings.mlr.press/v80/wang18i/wang18i.pdf · 2.3. Generative Adversarial Networks Generative Adversarial Networks

Adversarial Distillation of Bayesian Neural Network Posteriorsproceedings.mlr.press/v80/wang18i/wang18i.pdf · 2.3. Generative Adversarial Networks Generative Adversarial Networks

Collaborative Sampling in Generative Adversarial … › pdf › 1902.00813.pdfGenerative Adversarial Networks Generative Adversarial Networks (GANs) (Goodfellow et al. 2014) consist

Collaborative Sampling in Generative Adversarial … › pdf › 1902.00813.pdfGenerative Adversarial Networks Generative Adversarial Networks (GANs) (Goodfellow et al. 2014) consist

GENERATIVE ADVERSARIAL NETWORKS FOR SINGLE …...Generative Adversarial Networks (GANs - Goodfellow et al., 2014) were recently proposed. This paper is focused on providing a reliable

GENERATIVE ADVERSARIAL NETWORKS FOR SINGLE …...Generative Adversarial Networks (GANs - Goodfellow et al., 2014) were recently proposed. This paper is focused on providing a reliable