2
$\begingroup$

I'm trying to build an encoder-decoder network in Keras to generate a sentence of a particular style. As my problem is unsupervised i.e. I don't have the ground truths for the generated sentences, I use a classifier to help during training. I pass the decoder's output into the classifier to tell me what style the decoded sentence is.

The decoder outputs a softmax distribution which I was intending to feed straight into the classifier but I realised that it has an embedding layer, which in Keras, accepts only integer sequences not softmax / one-hot. Does anybody know a way to remedy this?

Thanks

Improve this question
$\endgroup$

1 Answer 1

Reset to default
0
$\begingroup$

You are describing a variation of Generative adversarial networks (GANs). The Generator, the part of the model that creates new examples, needs to output complete sentences. The Discriminator, the classifier, takes those complete sentences as input.

In particular, you are describing a DiscoGAN which discovers cross-domain relations given unpaired data. DiscoGANs have been applied to the style of images.

Improve this answer
$\endgroup$
3
  • $\begingroup$ You're right, this is similar to GANs. From my knowledge, the difference is that the GAN discriminator checks for 'real' vs. 'generated' whereas I am trying to help decoder produce sentences of the desired styles hence what I am using is a classifier that checks if the output is 'style A' or 'style B'. $\endgroup$
    – Physbox
    Jul 25, 2018 at 21:29
  • $\begingroup$ DiscoGAN classifiers can learn different styles. I have edited my answer. $\endgroup$
    – Brian Spiering
    Jul 25, 2018 at 23:04
  • $\begingroup$ Thanks for sharing. How would I implement this in Keras though? As described in my question, what I am actually concerned with is the embedding layer which only takes a sequence of integers. Should I convert the softmax output from the decoder into integers? If so, won't this discrete step prevent training via backprop? $\endgroup$
    – Physbox
    Jul 26, 2018 at 0:05

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.