Data Science

Questions tagged [generative-models]

Ask Question

For questions about models designed for generating new data (or generating samples from a probability distribution).

106 questions
Newest
Active
Bountied
Unanswered
Filter by
Sorted by
Tagged with
0
votes
0answers
16 views

accessing individual layers from a saved model

I am in the process of writing a model where I have the layers of the model in the "def _init_( )" section of a class I want to save and load the model in the class' variables where i ahve ...
3
votes
0answers
44 views

Help interpreting GAN output, and how to fix it?

After a few tries, I had trained a GAN to produce semi-sensible output. In this model, it almost instantly found a solution and got stuck there. The loss for both the discriminator and generator were ...
1
vote
0answers
7 views

Checkerboard artefacts vs distinct objects in GANs

I found a very good solution for getting rid of checkerboard artefacts in GANs: https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix/issues/190 Instead of using Transposed Convolution, use bilinear ...
0
votes
0answers
9 views

Magenta MusicVAE/GrooVAE conditioning

I want to try different methods of conditioning the decoding process of the Variational Autoencoder Models of the Google Magenta project for my own research project. As far as I can tell, MusicVAE has ...
1
vote
0answers
15 views

Fine tuning Conditional GANs for low data scenarios

I was wondering what the process was for fine tuning a conditional GAN. For example, say I wanted to generate pictures of an object X given a certain condition such as a sentence describing it, which ...
0
votes
0answers
6 views

what are Latent model and Latent Varibles?

what are latent models and why they use Expectation maximization instead of gradient descent to optmize the parameters ? How to interpret and understand whether a hidden varible is present in model or ...
0
votes
0answers
32 views

MNIST GAN generator loss increasing

I'm trying to train a simple vanilla GAN on MNIST with Tensorflow. I used this github page as a reference and in my process to try and get my GAN to work I've made my code more and more similar to ...
0
votes
0answers
8 views

During modeling binarized handwritten digit images using a BMM and EM algorithm, why must, during initialization, the value of means sum to 1?

This is my first question on StackExchange. So please pardon any mistakes that I might've made. I'm reading about Multivariate Bernoulli Mixture Models and the EM algorithm from Pattern Recognition ...
0
votes
1answer
47 views

How to make custom callback in keras to generate sample image in VAE training?

I'm training a simple VAE model on 64*64 images and I would like to see the images generated after every epoch or every couple batches to see the progress. when I train the model I wait until the ...
0
votes
1answer
207 views

Is it possible to train stylegan2 with a custom dataset using a graphics card that only has 6GB of VRAM (GeForce GTX 1660)?

I'm attempting to train stylegan2 using a custom dataset, but no matter what settings I use I see the same error: ...
0
votes
0answers
8 views

generative models visualizations

Can someone recommend me a paper or blog where they show nice visualizations of reconstructed data in a generative model, which is not trained with pictures. Visualization of reconstructed images is ...
0
votes
0answers
9 views

WGAN training tradeoffs

Currently training a WGAN with weight clipping and having reread the architecture and pitfalls mentioned in code, I am running it with 2 layers in critic and generator, no batch norm in generator and ...
0
votes
0answers
18 views

Order of importance of hyperparameters

I'm trying to make a generative model and for a given input shape there is a fixed corresponding output shape. Because of the way convolutional and transposed convolutional layers determine output ...
0
votes
0answers
10 views

Using DCGAN on a (very small) dataset of art

I am developing a DCGAN using the this tutorial in PyCharm. As my usage of this tutorial suggests, I am quite new to DCGANs as I've previously only had a few experiences with machine learning ...
0
votes
0answers
18 views

Keras: Implementing paired Data Augmentation into Pix2Pix cGAN confusion

but learning GANs. Following a Jason Lee Brown tutorial (the code is his)... I am trying to add in Keras' ImageDataGenerator to the pix2pix algorithm. I can ...
0
votes
0answers
20 views

Reward Function for NLP

I would like to design an reward function , I am training two models from the first model that classify set of texts(paragraphs and keywords) and I also got some hidden states. The second model is ...
0
votes
0answers
14 views

Limits of generative models

If I was to train a pixel rnn, by concatenating images with noise vectors, I should be able to get new images from that distribution by starting on the prediction with a new noise vector. Would it be ...
1
vote
0answers
30 views

Why -logD trick in GANs training work?

When training the generator, we want to minimize log(1 - D(G(z))) (this has a form of log (1-x)). Using graph calculator we plot and see that the slope of this function is very small at first, thus ...
0
votes
0answers
4 views

How do Deep Auto-regressive models (like language generation models) take in 0-k previous tokens as input?

I'm new to deep auto-regressive architectures, and I am trying to build one for sequence generation. I've read a lot of papers about the theory behind these models, but I don't quite understand how a ...
0
votes
0answers
18 views

Is the hyperbolic tangent function a solution to the weight clipping problem of WGAN?

Instead of clipping to the range [-c,c] why not smoothly map into the range [-c,c] by using c*tanh(w) ? This would guarantee the Lipschizt constant is no greater than c. The problem I am talking ...
1
vote
0answers
22 views

How can I know my GAN does converge?

I am training my GAN, and by looking at the loss curves of the generator and discriminator, I think I am going on the right way because from this blog, my curves look reasonable: A stable GAN will ...
1
vote
1answer
457 views

Inception Score (IS) and Fréchet Inception Distance (FID), which one is better for GAN evaluation?

IS uses two criteria in measuring the performance of GAN: The quality of the generated images, and their diversity based on the entropy of the distribution of synthetic data. On the other hand, FID ...
1
vote
0answers
18 views

Instance segmentation and scene reconstruction

I've been recently interested in various segmentation tasks especially instance segmentation. Having been experimenting with various different datasets I stumbled upon using the method for indoor ...
6
votes
3answers
789 views

Is it possible to use a generative model to “share” private data?

Let's say we have some data set, with lots of instances $X$ and a target $y$. If it is of some importance, you may assume that it is a "real life" data set : medium sized, with important correlations, ...
1
vote
0answers
31 views

Reinforcement learning in bidirectional RNN

I have been self-learning deep generative neural network for a while. I am okay with the basics but I really need some guidance and jump start. I have recently came across this paper ā€œBidirectional ...
0
votes
0answers
7 views

Virtual Generation of Synthetic Ancient and Dirty English Documents

I have a collection of dirty background image, below is the sample: I have also a collection of an actual image of a dirty document with text on it, just like below: My problem with my actual image ...
1
vote
0answers
29 views

Keras Encoder - Decoder Model

Im training a model of 400 samples . The dataset contains 400 images of faces as input (X) and also 400 faces with glasses as output (Y) . im training the model by code below : ...
1
vote
1answer
50 views

GAN: Discriminator converges, generator learns almost nothing

In my GAN, the discriminator loss goes down steadily, while the generator loss oscillates / does not converge. I suspect this is due to the vanishing gradient problem. Theory: as the discriminator ...
1
vote
0answers
59 views

CycleGAN: Generator losses don't decrease, discriminators get perfect

So IĀ“m training a CycleGAN for image-to-image transfer. The problem is: while the discriminator losses decrease, and are very small now, the generator losses don't decrease at all. The generator ...
2
votes
1answer
37 views

Create an RNN on text sources with different lengths

I want to create an RNN to generate a new text based on many examples of existing texts of a certain format in the training data. The type of texts in the training data consists of 3 segments, like so:...
2
votes
0answers
30 views

Generative Model for learning Periodic solutions 3-body/N-body problems

I am tasked with finding research where a GAN or any other generative model is used to generate new shapes of 3-bodies moving under the influence of each others' gravitational pull, in a periodic ...
3
votes
1answer
28 views

How to supress previous results in a generative network?

Think of a generative network generating animal names. It's been trained on a set of animal names so this shouldn't be too hard. But say I want to generate 10 animal names. First I run the network ...
2
votes
1answer
29 views

Why joint probability in generative models?

I have been reading about generative models for past few days and there's one question that's bugging me. Many sources(Wiki, Google dev article) mention that generative models try to model the joint ...
5
votes
5answers
100 views

Could GANs be used to augment data?

I want to use GAN for data augmentation but I am confuse what are the pros. and cons. of data augmentation using GAN or why we use data augmentation using GAN compared to other data augmentation ...
0
votes
1answer
59 views

Are there some research papers about text-to-set generation?

I have googled but find no results. Text-to-(word)set generation or sequence-to-(token)set generation. For example, input a text and then output the tags for this text: ...
2
votes
0answers
20 views

Are Denoising Variational Autoencoders deterministic?

I have a pretty good understanding of regular autoencoders and, to a certain extent, of variational autoencoders, where the latent representation is forced to follow specific probabilistic ...
1
vote
1answer
106 views

Discriminator of a Conditional GAN with continuous labels

OK, let's say we have well-labeled images with non-discrete labels such as brightness or size or something and we want to generate images based on it. If it were done with a discrete label it could ...
1
vote
1answer
82 views

How does joint probability generate new data in generative model

Learning about different Machine Learning concepts, I came across Generative and Discriminative model. To infer from what I have studied, generative model is based on P(x,y)(Joint probability ...
2
votes
1answer
82 views

Time Series Generation - Multi Dimensional Time Series Data

Disclaimer: Mathematicians please don't be mad at me for the use of some of the terminologies in this post. I am an Engineer. :-) Background: So I am currently working on a problem where I have to ...
0
votes
0answers
5 views

Help regarding generative modeling

I have data in form of n dimensional points. I have to train generative model where i pick a class through multinoulli distribution. Then each dimension of actual point is generated by some ...
0
votes
0answers
20 views

Learning discrete probability distribution that is parametrized by a set of real-valued parameters

Assume I have a discrete probability distribution defined over binary variables. This probability distribution is parametrized by a set of real-valued parameters, which all are contained in a segment, ...
0
votes
0answers
24 views

How to solve a supervised learning problem with a generative model?

Is there a framework to do supervised task in generative model fashion? i.e. modelling p(x,y) rather than p(y|x) as in discriminative models. When I look at generative models, they all revolve ...
2
votes
1answer
59 views

Why are discriminative models denoted as $P\left(Y|X\right)$?

In general, we can speak we know deterministic and probabilistic models. Discriminative ones are deterministic, while generative one is probabilistic. But I have been reading about the difference ...
0
votes
1answer
66 views

What is a latent space vector?

I do not understand this about GANs. Apparently the Generator is supposed to receive a latent space vector as its input. Yet I couldn't find an example of how I can implement it in Pytorch. This is a ...
1
vote
0answers
15 views

Image Quality Assessment Algorithms

I am working on super resolution projects using Generative Adversarial Networks. I need to validate the generated image whether they are close to original one. I already worked with SSIM and PSNR. is ...
0
votes
1answer
22 views

Why does the generator produce output in a different scale than the training sample?

I am currently trying to train a GAN (based on proGAN) to produce images in a Vaporwave-style which is quite distinct. The results so far have been underwhelming, which I suspect might be due to a ...
2
votes
0answers
19 views

Rescaling simulations by machine learning

I am working in the field of astrophysics. A problem that I consistently find in my projects is that I am always limited by the size of the sky simulations available for a specific observable that I ...
1
vote
1answer
12 views

Is it faster and better to train a GAN on just one digit as opposed to the whole mnist dataset?

When going through an introductory GAN tutorial to generate mnist like handwritten digits I wondered whether the systematic variance in the training data due to the different digits makes the model ...
0
votes
0answers
20 views

How Cycle GAN translates between very different objects?

I'm trying to understand how the popular CycleGAN responds if the objects to be translated between are very different (horse and map or house and apples). All of the examples appear to be translating ...

1
2 3