Top Banner
46

Introduction of VAE

Jan 21, 2018

Download

Data & Analytics

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Introduction of VAE
Page 2: Introduction of VAE
Page 3: Introduction of VAE
Page 4: Introduction of VAE
Page 5: Introduction of VAE

https://blog.openai.com/generative-models/

Feynmanʼs message!

One of our core aspirations at OpenAI is to develop

algorithms and techniques that endow computers with an understanding of our world.

Page 6: Introduction of VAE
Page 7: Introduction of VAE
Page 8: Introduction of VAE

Ref: http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture13.pdf

Page 9: Introduction of VAE

Ref: http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture13.pdf

Page 10: Introduction of VAE
Page 11: Introduction of VAE

ExampleofOutput

Page 12: Introduction of VAE
Page 13: Introduction of VAE
Page 14: Introduction of VAE
Page 15: Introduction of VAE
Page 16: Introduction of VAE
Page 17: Introduction of VAE
Page 18: Introduction of VAE
Page 19: Introduction of VAE

ü

ü

ü

Page 20: Introduction of VAE
Page 21: Introduction of VAE
Page 22: Introduction of VAE
Page 23: Introduction of VAE
Page 24: Introduction of VAE

?

Page 25: Introduction of VAE

=1

Decomposecombine

Page 26: Introduction of VAE
Page 27: Introduction of VAE
Page 28: Introduction of VAE
Page 29: Introduction of VAE
Page 30: Introduction of VAE

clearly indicateparameters

Problem is not maximizing ,

Page 31: Introduction of VAE
Page 32: Introduction of VAE
Page 33: Introduction of VAE
Page 34: Introduction of VAE

var = exponential.exp(ln_var) mean_square = mean * mean loss = (mean_square + var - ln_var - 1) * 0.5

Page 35: Introduction of VAE

mu, ln_var = self.encode(x) batchsize = len(mu.data) rec_loss = 0 # reconstruction errorfor l in six.moves.range(k):

z = F.gaussian(mu, ln_var)z.name = "z”rec_loss += F.bernoulli_nll(x, self.decode(z, sigmoid=False)) / (k * batchsize)

Page 36: Introduction of VAE
Page 37: Introduction of VAE
Page 38: Introduction of VAE
Page 39: Introduction of VAE
Page 40: Introduction of VAE
Page 41: Introduction of VAE
Page 42: Introduction of VAE
Page 43: Introduction of VAE
Page 44: Introduction of VAE
Page 45: Introduction of VAE
Page 46: Introduction of VAE