Skip to main content

Questions tagged [diffusion]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
37 views

How does ChatGPT-4o work on text + image data?

What known state of art techniques might ChatGPT-4o, Claude 3 or other similar systems be using to understand both text and image data? I noticed that ChatGPT-4o can recognize text in an image well. ...
user163246's user avatar
0 votes
0 answers
31 views

diffusion model: can't overfit on single batch

I am training the diffusion model from diffusion policy, specifically their vision notebook, on a custom dataset. As always, I try to make a sanity check of the pipeline, by overfitting on a single ...
Felix Hegg's user avatar
1 vote
1 answer
52 views

Diffusion Models: Conditioning on Time vs. Noise Level

I am new to SE-Data Science, therefore I hope this is the right place to ask this rather theoretical question. In diffusion models we usually have a time variable which determines the noise schedule (...
Lockhart 's user avatar
0 votes
0 answers
13 views

Generation time in stable cascade vs stable diffusion

According to the docs, Stable Cascade is meant to be faster than SD due to its architecture. However, when trying out using Python on my local machine, the results seem to be opposite. I am using a ...
x89's user avatar
  • 191
1 vote
0 answers
19 views

How to derive at the expectation equation given in the paper "Video Diffusion Models"?

In the paper Video Diffusion Models, Section 3.1 mentions the following equation: $$ E_q[x^b|,z_t,x^a] = E_q[x^b|z_t] + (\frac{{\sigma}_t^2}{{\alpha}_t})\nabla_{z_t^b}\log q(x^a|z_t)$$, where $x^a, x^...
p1p13 's user avatar
  • 21
0 votes
0 answers
16 views

training data of stable cascade vs stable diffusion

So according to this: https://waxy.org/2022/08/exploring-12-million-of-the-images-used-to-train-stable-diffusions-image-generator/ Stable Diffusion was trained on data from CommonCrawler. I believe ...
x89's user avatar
  • 191
0 votes
0 answers
4 views

Intuition and technical explanation behind "3D-aware Feature Attention" in Sync Dreamer? (Multiview Generating Diffusion Model)

I am looking to understand the whole block on how the Sync Dreamer paper has constructed the "3D aware feature attention" which is outlined on page 5. To enforce consistency among multiple ...
ChaoS Adm's user avatar
  • 141
0 votes
0 answers
18 views

Fine-tuned Stable Diffusion not converging with custom encoder

I'm currently fine-tuning a stable diffusion model for the task of dataset augmentation. I am training the model on 80k images from hte CelebA-attributes dataset, replacing the text encoder with ...
Tomas Premoli Muniagurria's user avatar
0 votes
0 answers
36 views

Why Latent Space in Stable Diffusion has shape 64x64x3?

I am wondering why the dimensionality of Latent Space in Stable Diffusion is 64x64x3. Since ...
Renat Abdrakhmanov's user avatar
2 votes
2 answers
154 views

Edit friendly DDPM noise space

I was reading this paper, "An Edit Friendly DDPM Noise Space: Inversion and Manipulations". In page no. 4, they have mentioned that in DDPM, noise maps of consecutive steps are highly ...
shivani's user avatar
  • 140
1 vote
0 answers
253 views

Common sense fixes to a buggy diffusion model that won’t overfit one sample?

hope this question is in the right place. I’m working with a toy diffusion model to generate points e.g learning a Swiss roll which to me is a basic use case that I wanted to start with. My model is ...
pxvxrx's user avatar
  • 11