Skip to content

Generative adversarial networks (GAN) applied to sequential data via recurrent neural networks (RNN).

Notifications You must be signed in to change notification settings

ofirnachum/sequence_gan

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

sequence_gan

Tensorflow implementation of generative adversarial networks (GAN) applied to sequential data via recurrent neural networks (RNN).

See simple_demo.py for a demonstration of the model on toy data.

The basic idea of a generator and discriminator alternatively optimizing their own objectives is maintained. Because of discrete sequential data, a standard backpropogation from discriminator to generator is not possible. Rather, we employ the REINFORCE algorithm, to encourage the generator to choose the correct discrete output at each point in the sequence.

The REINFORCE algorithm is prone to issues with credit assignment. To alleviate this, the model provides 'supervised training' (as opposed to the 'unsupervised training' via the discriminator). During supervised training, the generator is trained to predict the correct tokens based on a groundtruth sequence, optimizing cross entropy loss.

About

Generative adversarial networks (GAN) applied to sequential data via recurrent neural networks (RNN).

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages