Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [generative-models]

For questions about models designed for generating new data (or generating samples from a probability distribution).

Filter by
Sorted by
Tagged with
0 votes
0 answers
13 views

does DALL-E api use Microsoft account info while generating responses?

I have read some work regarding occupational gender bias in AI image generation and it seemed. According to my research, tools like DALL-E generated more images of men when trying out for images with ...
x89's user avatar
  • 191
0 votes
0 answers
12 views

Why does the TensorFlow docs use a different GAN generator loss?

As per the original paper that introduced GANs, the generator loss is given as: $$ L_{G} = L _{BCE}(\mathbf{\vec 0}, \mathbf{D}(\mathbf{G}(\mathbf{\vec z}))) = \log(1 - \mathbf{D}(\mathbf{G}(\mathbf{\...
Sagnik Taraphdar's user avatar
0 votes
0 answers
24 views

Diffusion Models: Conditioning on Time vs. Noise Level

I am new to SE-Data Science, therefore I hope this is the right place to ask this rather theoretical question. In diffusion models we usually have a time variable which determines the noise schedule (...
Lockhart 's user avatar
1 vote
0 answers
10 views

Training VAE in Latent Diffusion Models

When working with Latent Diffusion Models (LDMs), is it common practice to only train the U-Net component while leaving the VAE untrained? Additionally, does this approach apply when fine-tuning an ...
NakataKoo's user avatar
0 votes
0 answers
9 views

cGAN: Discriminator loss going to zero while Generator's going always up but the result is very good

I have a Conditional Generative Adversarial Network for Quantum State Tomography. The metrics I am monitoring during the training process are the losses and the Fidelity (the degree of similarity ...
Dimitri's user avatar
  • 23
-1 votes
0 answers
17 views

In what format should the correspondence data be provided for training the neural network model?

I have correspondence between users and technical support. I want to train an int float/multilingual-e5-large model based on technical support responses. Tell me, please. How can I do this? What ...
7wafer7's user avatar
1 vote
0 answers
13 views

About GANs specialization

I'm working in a binary classification problem. In general terms, I'm focused on using neural networks to classify datasets that are not huge and in order to address that problem I'm comparing ...
leapofFaith's user avatar
0 votes
0 answers
8 views

Generation time in stable cascade vs stable diffusion

According to the docs, Stable Cascade is meant to be faster than SD due to its architecture. However, when trying out using Python on my local machine, the results seem to be opposite. I am using a ...
x89's user avatar
  • 191
1 vote
1 answer
31 views

How to ensure that the output of my generative model is uniform?

Generative models transform noise to data. However, is there a way to ensure the output of my generative model follows a specific distribution, say uniform? More concretely, applying a scalar function ...
Butters's user avatar
  • 21
1 vote
0 answers
19 views

How to derive at the expectation equation given in the paper "Video Diffusion Models"?

In the paper Video Diffusion Models, Section 3.1 mentions the following equation: $$ E_q[x^b|,z_t,x^a] = E_q[x^b|z_t] + (\frac{{\sigma}_t^2}{{\alpha}_t})\nabla_{z_t^b}\log q(x^a|z_t)$$, where $x^a, x^...
p1p13 's user avatar
  • 21
0 votes
0 answers
15 views

training data of stable cascade vs stable diffusion

So according to this: https://waxy.org/2022/08/exploring-12-million-of-the-images-used-to-train-stable-diffusions-image-generator/ Stable Diffusion was trained on data from CommonCrawler. I believe ...
x89's user avatar
  • 191
0 votes
0 answers
5 views

stabilityai/stable-cascade vs runwayml/stable-diffusion-v1-5

What are the major differences in these text-to-image AI models: stabilityai/stable-cascade runwayml/stable-diffusion-v1-5 in terms of architecture and performance?
x89's user avatar
  • 191
1 vote
0 answers
16 views

Best way to achieve High throughput with ChatGPT (and LLMs in general) APIs

I was wondering what the best way is to perform API calls to ChatGPT, and in general, with LLMs API providers, to achieve the highest throughput in a batch inference context. Suppose you have 1000 ...
Raffaele 's user avatar
0 votes
0 answers
22 views

Image Generation Models

I am looking for a list of different image generation models and how I can test them? For example: DALL-E (accessible via ChatGPT4) Stable Diffusion (open source) CLIP? - but idk how to access/test it....
x89's user avatar
  • 191
0 votes
0 answers
9 views

Generation of spectrum from features

In the field of chemical analysis, prediction of features, properties, is often done from spectra base on simple neuralnetwork and some AI models. But conversely, what methods are implemented to ...
tomtels's user avatar
  • 13
0 votes
0 answers
76 views

How can I apply a technique from "ZHOU, Pei, et al. Self-Discover: Large Language Models Self-Compose Reasoning Structures. 2024" to my toy project?

I want to practice a technique from "ZHOU, Pei, et al. Self-Discover: Large Language Models Self-Compose Reasoning Structures. arXiv preprint arXiv:2402.03620, 2024." The article call it &...
Jaewoo Kim's user avatar
0 votes
1 answer
33 views

Prompt Ops Alternatives

What are the main alternatives for prompt ops nowadays? By prompt ops, I mean a comprehensive solution for tracking prompt engineering experiments and also registering prompts in different stages, ...
Raffaele 's user avatar
0 votes
0 answers
17 views

Fine-tuned Stable Diffusion not converging with custom encoder

I'm currently fine-tuning a stable diffusion model for the task of dataset augmentation. I am training the model on 80k images from hte CelebA-attributes dataset, replacing the text encoder with ...
Tomas Premoli Muniagurria's user avatar
4 votes
1 answer
103 views

LLMs for text generation

We know that AI is rapidly growing. do we have any large language models (LLMs) to process images, pdf documents directly (fine-tune approach) for text generation tasks?
Tovlk's user avatar
  • 43
1 vote
0 answers
118 views

Generating quality synthetic tabular data - is it possible when one's dataset is extremely small?

I've got a dataset consisting of only 17 samples and 6 continuous features (all values in the dataset contain decimals, although 2 features exhibit categorical-ish behaviour). I'm looking at the ...
user23493275's user avatar
0 votes
0 answers
26 views

Details about Pre-existing knowledge database in RAG for LLMs

In RAG, As part of retriever model- we are retrieving the relevant information from external knowledge source (i.e. vector database) and this database is always updating with new updates. In ...
Tovlk's user avatar
  • 43
1 vote
1 answer
22 views

Extraction of name from phonetic transcription

I have a use case where I want to extract the name from the phonetic transcription. For example if the phonetic transcription is - “m a j n e j m ɪ z s ʌ m i ɹ z o w ʃ i”, the output should be the ...
Sameer Joshi's user avatar
0 votes
0 answers
7 views

Strategies for Encoding Large Datasets in Symbolic Music Generation for BERT-type Model

I am creating a BERT-type model for symbolic music generation. An observation of my database is a musical piece. Actually, is a "viewpoint" of the piece: ...
Kikolo's user avatar
  • 101
0 votes
0 answers
72 views

How to improve performance of a Retrieval Augmented Generative (RAG) model?

I had implemented a Retrieval Augmented generation (RAG) model on the Healthcare CSV file. The model has to give answers to natural language queries based on the data provided. After implementing the ...
user159579's user avatar
0 votes
0 answers
13 views

Use OpenNN for score matching

I‘m new to this topic and need some guidance. I would like to implement score matching (like sliced-score matching: https://arxiv.org/abs/1905.07088) in C++. OpenNN (https://www.opennn.net/) seems to ...
0xbadf00d's user avatar
  • 101
0 votes
1 answer
89 views

How the retriever model (Query encoder) is end-to-end trained in Retrieval Augmented Generation (RAG)?

RAG architecture from the original paper Since loss is calculated at the output layer of the generator, how the gradients are back propagated to the retriever model? Because the input to the Generator ...
Ritwik's user avatar
  • 141
0 votes
0 answers
35 views

GAN/DC-GAN isn't converging

I've been trying to train a vanilla GAN(for MNIST) for a few days, and nothing works. I've tried a lot of different layers, hyperparameters, and more, but every time the discriminator's loss decreases(...
Complex's user avatar
0 votes
0 answers
6 views

Transformation in Normalizing flow

I'm implementing a Flow based model. The affine transformation for decode (z->x) step is: x_{i} = f(x_{i-1}) = x_{i-1}*exp(s) + t, and for encode step is: x_{i-1} = f_1(x_{i}) = (x_{i} - t)/ exp(s)....
nhs2828's user avatar
0 votes
1 answer
115 views

Purely extractive Language Model

Given an email thread, I am trying to extract the body of the most recent email. I used to do that with rules. Now I am testing Large Language Models (LLM) to see if I they provide a less ad hoc ...
mirix's user avatar
  • 103
0 votes
0 answers
10 views

Assessing performance of a generative model (images) using Jensen-Shannon Divergence

Background I am currently working on comparing two high-dimensional image datasets (MNIST) of shape $\sim(50000, 256)$ to evaluate the performance of a generative model, and have attempted to use ...
Andrea's user avatar
  • 101
1 vote
1 answer
75 views

Unsupervised Machine Translation System Using Variational Autoencoder Models

I want to work on an unsupervised machine translation system using a variational autoencoder. I did a literature review but didn't find any related work, and most of the work is based on denoising ...
kartikeya saraswat's user avatar
0 votes
0 answers
23 views

Improving Normalizing Flows Accuracy

What are some techniques one might use to improve the accuracy of normalizing flows? I am training a flow in a high-dimensional space but it seems like there's always at least one or two dimensions in ...
vermillion flycatcher's user avatar
0 votes
0 answers
21 views

In the GAN objective function, why do we first do we first find the D(x) that maximizes the objective function and then maximise wrt the generator?

The GAN objective function is optimised like this: argmin(argmax(L(G,D))) where the argmax finds the D (Discriminator) that maximises L(G,D). Why is it not the other way around, i.e. argmax(argmin(L(G,...
thebasqueinterdisciplinarian's user avatar
1 vote
1 answer
978 views

issue loading the ckpt file PytorchStreamReader failed reading zip archive: failed finding central directory

I am trying to load the ckpt file and getting error PytorchStreamReader failed reading zip archive: failed finding central directory Here is the code ...
Shruti's user avatar
  • 35
2 votes
3 answers
1k views

torch cuda not able to identify gpu on aws g4dn.xlarge

I have created an EC2 instance with GPU g4dn.xlarge and launched it. I want to run some ...
Shruti's user avatar
  • 35
1 vote
1 answer
117 views

Why is T5 often used in text-to-data for text prompt encoders?

In the text-to-data(music, image, audio, etc.) generative AI field, one method of encoding text prompts is to use pre-trained language models. Such an approach was used in research on Moûsai [1] and ...
NakataKoo's user avatar
0 votes
0 answers
11 views

Generating synthetic labeled data (sampling from p(x,y))

I'm working on a toy problem. Consider a dataset that consists of 1-D vectors (waveforms) that contain noise, except for one prominent spike. Denote the waveform by $\vec{x}$, and let the coordinate ...
djr's user avatar
  • 1
1 vote
0 answers
17 views

Avoid overfitting to noise by a noise penalty approach instead of early stopping?

I came across this article on deep learning for computational MRI and found an interesting sentence "However, early stopping has to be performed to not overfit to the noisy measurements." ...
Shihao ZENG's user avatar
0 votes
1 answer
55 views

What Deep Learning model to use in this spectroscopy task?

I have a task to be solved. There are energy measurements over the square area 40x40. One measurement consists of values : x, y and the energy. The all area is almost whole covered with data (a few ...
Szymon Roziewski's user avatar
-1 votes
1 answer
36 views

Build a topic model without data?

I need to come up with a topic model, without any labelled dataset, the model should also be multilingual, thinking of using LLM's as they are accurate and awesome but if Im to build one on my own how ...
emily 's user avatar
  • 35
0 votes
0 answers
93 views

Is it a good idea to use attention in VAEs for image generation?

There are research papers and codebases on GitHub that deal with VAEs for image generation on popular datasets like CelebA, etc. While surfing through Google Scholar I found self-attention and other ...
Sir Arthur7's user avatar
0 votes
0 answers
21 views

How to train a VQ Gan Based on Pretrained Language and Image Encoder?

I have trained the dual encoder model (separate language and vision encoders) using the ideas here. However, this looks like an image look up model rather than an image generation model. What would ...
Della's user avatar
  • 335
0 votes
0 answers
14 views

Any ideas on how to generate code based NLU Data

I am working on a Generative AI project. I wish to explore stuff possible using "Code inputs". ...
Siddharth's user avatar
0 votes
0 answers
50 views

How to train a custom sentence completion model using tensorflow?

What I have A small corpus of English sentences (about 60,000). The Task Sentence completion model. Basically, something like Input: "Paris is the" Output: "Paris is the capital of ...
Della's user avatar
  • 335
0 votes
0 answers
702 views

How to Use Generative AI for Time Series Forecasting?

What I have A time series dataset of time stamps (hourly resolution), some covariates (like store foot-traffic) and items sold. What to forecast Number of items sold for next 24 hours, i.e. 24 ...
Della's user avatar
  • 335
2 votes
2 answers
149 views

Edit friendly DDPM noise space

I was reading this paper, "An Edit Friendly DDPM Noise Space: Inversion and Manipulations". In page no. 4, they have mentioned that in DDPM, noise maps of consecutive steps are highly ...
shivani's user avatar
  • 140
0 votes
0 answers
30 views

How does the use of 1x1 convolutional layers represent permutation in the GLOW model?

I am currently reading the GLOW paper (found here) and I can not understand how the authors claim that the use of 1x1 convolutional layers is equivalent to permutation holds true. I understand how a ...
Faraz M.'s user avatar
0 votes
0 answers
27 views

Help with running topology GAN (TopoGAN)

Link: https://github.com/TopoXLab/TopoGAN-ECCV2020 Sorry if this is the wrong place to ask, but I've been looking for help on how to work this out for a long time as I don't have much experience in ...
fds-mqdwqmqkdwl's user avatar
0 votes
0 answers
23 views

CGAN - Odd Distribution gap, failure of convergence?

I am trying to train on some 1 dimensional data (675 samples, its very expensive to get more) and trying to match the distribution seen here: There are labels from 1-3 as to associated with the noise....
Shiro's user avatar
  • 1
0 votes
0 answers
25 views

Seeking Solutions for Generating Text Descriptions from Diagrams, Infographics, Charts, etc

I am currently on a quest to find an efficient way to generate meaningful text descriptions (or alt text) from visual representations such as diagrams, infographics, charts, plots and the like. ...
Yann Stoneman's user avatar