# Questions tagged [diffusion]

The tag has no usage guidance.

11 questions
Filter by
Sorted by
Tagged with
1 vote
32 views

### How does ChatGPT-4o work on text + image data?

What known state of art techniques might ChatGPT-4o, Claude 3 or other similar systems be using to understand both text and image data? I noticed that ChatGPT-4o can recognize text in an image well. ...
21 views

### diffusion model: can't overfit on single batch

I am training the diffusion model from diffusion policy, specifically their vision notebook, on a custom dataset. As always, I try to make a sanity check of the pipeline, by overfitting on a single ...
1 vote
43 views

### Diffusion Models: Conditioning on Time vs. Noise Level

I am new to SE-Data Science, therefore I hope this is the right place to ask this rather theoretical question. In diffusion models we usually have a time variable which determines the noise schedule (...
• 123
11 views

### Generation time in stable cascade vs stable diffusion

According to the docs, Stable Cascade is meant to be faster than SD due to its architecture. However, when trying out using Python on my local machine, the results seem to be opposite. I am using a ...
• 191
1 vote
19 views

### How to derive at the expectation equation given in the paper "Video Diffusion Models"?

In the paper Video Diffusion Models, Section 3.1 mentions the following equation: $$E_q[x^b|,z_t,x^a] = E_q[x^b|z_t] + (\frac{{\sigma}_t^2}{{\alpha}_t})\nabla_{z_t^b}\log q(x^a|z_t)$$, where \$x^a, x^...
• 21
15 views

### training data of stable cascade vs stable diffusion

So according to this: https://waxy.org/2022/08/exploring-12-million-of-the-images-used-to-train-stable-diffusions-image-generator/ Stable Diffusion was trained on data from CommonCrawler. I believe ...
• 191
4 views

### Intuition and technical explanation behind "3D-aware Feature Attention" in Sync Dreamer? (Multiview Generating Diffusion Model)

I am looking to understand the whole block on how the Sync Dreamer paper has constructed the "3D aware feature attention" which is outlined on page 5. To enforce consistency among multiple ...
• 141
18 views

### Fine-tuned Stable Diffusion not converging with custom encoder

I'm currently fine-tuning a stable diffusion model for the task of dataset augmentation. I am training the model on 80k images from hte CelebA-attributes dataset, replacing the text encoder with ...
34 views

### Why Latent Space in Stable Diffusion has shape 64x64x3?

I am wondering why the dimensionality of Latent Space in Stable Diffusion is 64x64x3. Since ...
152 views

### Edit friendly DDPM noise space

I was reading this paper, "An Edit Friendly DDPM Noise Space: Inversion and Manipulations". In page no. 4, they have mentioned that in DDPM, noise maps of consecutive steps are highly ...
• 140
1 vote