Questions tagged [gan]

GAN refers to Generative Adversarial Networks. Such networks is made of two networks that compete against each other. The first one generates new samples and the second one discriminates between generated samples and true samples.

Filter by
Sorted by
Tagged with
1
vote
1answer
16 views

Understanding math notation in infoGAN paper

I'm reading this paper about mutual information in infoGAN infoGAN_paper_link and already have the code to run it. I pretty much found code for it which is fine and dandy except for the fact that I ...
0
votes
0answers
13 views

How to use mean IoU for RGB mask (keras implementation)?

I am training pix2pix GAN for converting SAR satellite images to segmentation mask. But I am not aware about how to use the mean IoU to evaluate my model. My output is of ...
1
vote
0answers
19 views

SAGAN - what is the correct architecture?

Hi, in the original paper the following scheme of the self-attention appears: https://arxiv.org/pdf/1805.08318.pdf In a later overview: https://arxiv.org/pdf/1906.01529.pdf this scheme appears: ...
1
vote
1answer
26 views

Is a multi-layer perceptron exactly the same as a simple fully connected neural network?

I've been learning a little about StyleGans lately and somebody told me that a Multi-Layer Perceptron, MLP, is used in parts of the architecture for transforming noise. When I saw this person's code, ...
-1
votes
0answers
53 views

Style Loss in Neural Style Transfer

This is a paragraph from This Book that explains style loss function for Neural Style Transfer. The thing that I dont understand is that from where did they got this: I understood that the Sigma ...
0
votes
1answer
29 views

Question About Discriminator of CycleGan

The Discriminator of CycleGan outputs not just a single value to say that the image is real or fake.... But It outputs a grid of numbers (like 8X8 or 7x7), where each number says whether one patch of ...
0
votes
0answers
19 views

DCGAN: why does my generator has less loss then my discriminator?

I have constructed a DCGAN (deep convolutional generative adversarial network) inspired by this github repository. It is written in a more low level Tensorflow code that I tried transforming into ...
1
vote
0answers
17 views

How does the GAN based prediction in K. Zhang et al. (2018) improve performance?

In Stock Market Prediction Based on Generative Adversarial Network by K. Zhang et. al, the authors feed financial data (X0...Xt) into an LSTM to predict Xt+1. Then, they evaluate whether the series (...
1
vote
0answers
17 views

Generative adversarial network error in training process

I'm trying to make GAN which will generate art from random noise. I rely on this article https://towardsdatascience.com/generating-modern-arts-using-generative-adversarial-network-gan-on-spell-...
0
votes
0answers
12 views

DCGAN: how do we construct the proposed CNN of the original DCGAN paper?

I am reading the original paper on the Deep Convolutional GAN (link: DCGAN paper) and on the fourth page the authors make a proposition on how to model the generator and discriminator as CNNs. However ...
0
votes
0answers
9 views

Weigthing discrimnator and generator loss in GAN networks?

Training of good generator model in vanilla GAN (Generative adversarial networks) https://papers.nips.cc/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf is achieved via minimax game, where <...
2
votes
1answer
25 views

Channels in CNN/GAN

I found this article about art generation which uses GAN architecture to generate art. Let's move to part where we define our generator model. ...
1
vote
0answers
22 views

Using StyleGAN for generative design of aircraft

I haven't worked on a machine learning project in a year and now that I am in university I am trying again :) Anyway, the end goal is to create a GAN that can design aircraft. I was inspired by the ...
0
votes
1answer
14 views

Get data from intermediate layers in a Pytorch model

I was trying to implement SRGAN in PyTorch and I have to write a Content loss function that required me to fetch activations from intermediate layers for both the Generated Image & Original Image. ...
0
votes
1answer
160 views

How to Connect Convolutional layer to Fully Connected layer in Pytorch while Implementing SRGAN

I was implementing the SRGAN in PyTorch but while implementing the discriminator I was confused about how to add a fully connected layer of 1024 units after the final convolutional layer My input ...
0
votes
1answer
129 views

Improving the pix2pix Architecture for Sketch to Image Translation on a Dataset of Sketches of People to Photos of People

For a university project I need to create a neural network which translates sketches of people into images. In order to implement such a neural network, I decided to implement a pix2pix GAN ...
1
vote
0answers
59 views

pix2pix GAN with Rectangular Image Dataset

I am currently working on a project (for university) which translates sketches of faces to images of this person. For implementing this, I decided to use a pix2pix GAN architecture. However, I have ...
0
votes
0answers
8 views

Regress to the mean problem

I was reading Video-to-Video Synthesis (link) paper, in related works for future video prediction it is mentioned that existing methods fail because of regress-to-the-mean problem. What exactly is the ...
1
vote
1answer
33 views

Using GANs to generate synthetic tabular data to improve supervised learning

One topic I see some people trying is using GANs to generate synthetic tabular data for supervised learning. Also as a way to oversample the minority class in a binary classification. For me creating ...
0
votes
1answer
27 views

How are pictures pre processed before being used as ML data

So I was watching this YouTube video So basically the professor used ML to generate random faces in order to create data for a Kaggle challenge. When I looked into the data file, I was expecting to ...
0
votes
2answers
50 views

When to use GAN over conventional sampling methods?

Let's say I have a dataset from a diabetes hospital which has 30000 Type 2 diabetes and 300 Type 1 diabetes patients. So this dataset has millions and millions of other data points like lab ...
-1
votes
1answer
27 views

How much GPUs are needed for Image ehancement? [closed]

I'm looking for a GPU to train my model. Most of the papers that I have followed used 2 or more gtx 1050ti card or higher. (MIRNet, EnlightenGAN) I need to that how much GPU power will it take to ...
0
votes
1answer
28 views

Image regression problem

I've tried a number of experiments with machine learning. From trying to use GANs to upscale images to playing with auto-encoders. There is one problem that haunts me and always ends up ruining my ...
1
vote
0answers
63 views

Understanding image size changes in DCGAN

I have been studying and trying to implement Generative Adversarial Networks using PyTorch. More precisely I tried to replicate the DCGAN PyTorch Tutorial tutorial using some custom dataset. My code ...
2
votes
1answer
15 views

Why a GAN trained on same data and same parameters may produce different results?

I am trying to train a Generative Adversarial Network and ran the training a few times with same dataset and same parameters but it seems tp produce different results. Why this may happen?
1
vote
0answers
54 views

Is it possible to use Inception Model in GANs (DCGAN) using PyTorch(or any other library)?

MAIN ISSUE: Is it possible to use Inception Model (e.g. v3) for DCGAN using PyTorch(any other library)? I've tried to find info how it could be implemented but nothing has been found. It was explained ...
1
vote
1answer
646 views

Should Discriminator Loss increase or decrease?

This question is purely based on the theoretical aspect of GANs. So, when training a GAN how should the discriminator loss look like? Should the loss of discriminator increase (as the generator is ...
0
votes
1answer
1k views

Tensorflow gradient returns nan or Inf [closed]

I am trying to implement a WGAN-GP model using tensorflow and keras (for credit card fraud data from kaggle). I mostly followed the sample code that is provided in keras website and several other ...
3
votes
2answers
103 views

How is the Gaussian noise given to this BLSTM based GAN?

In a conditional GAN, we give a random noise along with a label to the generator as input. In this paper, I don't understand why in one section of the paper, they say they are giving the random noise ...
0
votes
1answer
56 views

what is meant by minimizing and maximizing in GANs?

It is a subtle change that involves the generator maximizing the log of the discriminator probabilities for generated images instead of minimizing the log of the inverted discriminator probabilities ...
0
votes
1answer
15 views

Generate series of values using Keras GAN architecture

I'm trying to generate something like that: Which is a random sample from my real data function (that i'm trying to mimic). ...
0
votes
0answers
17 views

For calculating gradient penalty, why we need to consider data point that lies on the straight lines between actual and generator data pairs?

I am trying to understand the gradient penalty which was introduced in the following famous paper: Improved Training of Wasserstein GANs Introduced in section 4, equation 3 For calculating gradient ...
3
votes
1answer
69 views

Help interpreting GAN output, and how to fix it?

After a few tries, I had trained a GAN to produce semi-sensible output. In this model, it almost instantly found a solution and got stuck there. The loss for both the discriminator and generator were ...
1
vote
0answers
14 views

Checkerboard artefacts vs distinct objects in GANs

I found a very good solution for getting rid of checkerboard artefacts in GANs: https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix/issues/190 Instead of using Transposed Convolution, use bilinear ...
1
vote
0answers
46 views

Fine tuning Conditional GANs for low data scenarios

I was wondering what the process was for fine tuning a conditional GAN. For example, say I wanted to generate pictures of an object X given a certain condition such as a sentence describing it, which ...
3
votes
1answer
29 views

Generative Adversarial Text to Image Synthesis

Can anyone explain the meaning of this line: "Deep networks have been shown to learn representations in which interpolations between embedding pairs tend to be near the data manifold". ...
0
votes
0answers
109 views

Training Flags on Keras Layers

I'm pretty new the Tensorflow and Keras and I've started to build a simple GAN to analyze and then synthesize some time-series data. I would like to ask for some feedback to confirm my suspicions ...
0
votes
0answers
74 views

Best way to add border to rectangular images to train on StyleGAN2

TLDR: What is a best way to add borders to rectangular images with widely variable aspect ratios (from 0.5 to 2.0) to later use them as training data in StyleGAN2 with data resolution of 1024x1024 and ...
1
vote
2answers
154 views

Using a part of a trained model in a custom loss function -Tensorflow

I want to write a custom loss function that uses the intermediate result of a trained discriminator. the loss function compares images. the loss function is for recovering the latent vector of an ...
1
vote
2answers
20 views

How discriminator loss generated?

The images generated by generator has no labels, then how do Discriminator loss is generated on the basis of classification of generator generated images.
0
votes
0answers
10 views

How would one modify CycleGAN in order to map a distribution to itself?

CycleGAN can map between two different distributions $X$ and $Y$ with cycle consistency. This is done with generator functions $F: X \mapsto Y$ and $G: Y \mapsto X$, such that $||G(F(x)) - x||_1 \...
0
votes
1answer
123 views

Is my loss function right? WGAN

I am new to GANs, but I was able to train a DCGAN decently. I decided to try a WGAN (not the improved one). I seem to get outputs, but my loss doesn't seem to converge for the generator. I am using ...
2
votes
2answers
29 views

Recommendations for learning DCGANs?

I mean stuff that doesn't use Python, Keras or TensorFlow. I have been looking for an in-depth explanation on how to implement a DCGAN from the ground up so I can have a complete understanding of the ...
0
votes
0answers
15 views

Using DCGAN on a (very small) dataset of art

I am developing a DCGAN using the this tutorial in PyCharm. As my usage of this tutorial suggests, I am quite new to DCGANs as I've previously only had a few experiences with machine learning ...
0
votes
0answers
32 views

BatchNormalization for GANs

I am currently implementing a GAN and I tried to find some "best practices" in several tutorials. One of the suggestions was to use BatchNormalization. I am familiar with the concept and know how it ...
1
vote
0answers
54 views

CycleGAN vs. AutoEncoder for transforming sketches into images

I'm playing around with the use of deep learning on images and done quite works : colorizing black and white images for example, or maybe fixing old damaged photos. Today I want to tackle a new ...
2
votes
1answer
48 views

GAN Loss Function Notation Clarification

In the Generative Adversarial Network loss function, what do these mean?: $E_{x~p_{data}(x)}$ and $E_{z~p_{z}(z)}$ and how are they used in this context?
1
vote
0answers
124 views

Why -logD trick in GANs training work?

When training the generator, we want to minimize log(1 - D(G(z))) (this has a form of log (1-x)). Using graph calculator we plot and see that the slope of this function is very small at first, thus ...
5
votes
1answer
307 views

How can my Pytorch based GAN output pure B&W with no grayscale?

My goal is to create simple geometric line drawings in pure black and white. I do not need gray tones. Something like this (example of training image): But using that GAN it produces gray tone images....
1
vote
0answers
64 views

Database augmentation using Sobel filter (aka gradient)

I'm working in PyTorch and to improve a ProGAN training I'm augmenting a database by calculating, for each image, the horizontal and vertical gradient via the Sobel operator. Do you have any reading ...