Questions tagged [gaussian]

Gaussian refers to the Gaussian (or Normal) distribution. This is a continuous probability density function and is widely used in statistics.

28 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
2answers
80 views

What are the reasons for drawing initial neural network weights from the Gaussian distribution?

Are there theoretical or empirical reasons for drawing initial weights of a multilayer perceptron from a Gaussian rather than from, say, a Cauchy distribution?
3
votes
1answer
58 views

GMM in speech recoginition using HMM-GMM

I am trying to solve/understand ASR using HMM-GMM. At the abstract level i do understand what's happening but I did not understand how GMM fits into it. My data has 5K hours of speech from single ...
2
votes
1answer
92 views

Co-joining multi-peak histograms

I am analysing a bunch of data files which represent responsiveness of cells to addition of a drug. If a drug is not added, cell responds normally, if it is added, it shows abnormal patterns: , . We ...
2
votes
0answers
175 views

Wasserstein distance between Gaussian and the empirical distribution

Wasserstein distance between two gaussians has a closed form solution. Does the same hold for the distance between a Gaussian with a fixed variance(say 1) and the empirical data distribution? ...
1
vote
1answer
23 views

How to improve my f1 score in stories analyze

I got an assignment to build a model that identify the gender of the text writer. The assignment score will determine by my model f1_score, to get the maximum points, T need it will be at least 0.7. I'...
1
vote
0answers
69 views

Extracting component means and convariances from mixture model

I am currently trying to write a simple multivariate gaussian mixture model using tensorflow probability. Specifically, I have some 2-dimensional input and 2-dimensional output data and am looking to ...
1
vote
0answers
15 views

Multivariate noise variance in Gaussian process prediction

In GP regression, we predict using $\mu^* = ... (K(X,X)+\sigma^2I)^{-1}...$ This is fine when the noise $\sigma$ is a scalar, but I am confused about what happens when $\sigma$ is Multivariate/...
1
vote
0answers
25 views

Sampling for the encoder part of the VAE

my question regards the code utilized to implement the sampling function in the encoder part of VAE. Supposing that we chose a latent dimension of 2. Before the latent representation, we have 4 ...
1
vote
0answers
31 views

Multivariate Gaussian distribution - Covariance vs linear dependence

From prof. Andrew Ng's Multivariate Gaussian distribution lecture, covariance measures linear dependency between features, in which case we might use Multivariate Gaussian distribution with covariance ...
1
vote
1answer
244 views

Relationship between Sigmoid and Gaussing Distribution

I was reading this article where I came across the following statement in the context of "Why do we use sigmoid activation function in Neural Nets?": The assumption of a dependent variable to follow ...
1
vote
0answers
79 views

How can detect and highlight outliers by using gaussian function and normalize the data elegantly?

I tried to normalize the data by using Gaussian function 2 times on both positive and negative numbers of each parameter of this dataset. The dataset includes missing data as well. The problem is I ...
1
vote
0answers
61 views

How is the standard deviation of VAE's obtained?

I am trying to build a Variational Autoencoder. I was looking at various codes online and found most of them in some way or another copy Francois Chollet (Google researchers) code. Now my main ...
1
vote
0answers
98 views

Deepmind conditional neural process: evaluation

Going through the Deepmind jupyter notebook conditional neural processes, the plots at the bottom of the notebook show that the ground truth and the predicted distribution only overlap around the "...
1
vote
0answers
24 views

How to use Adaptive Rejection Sampling to Update Alpha in iGMM

I am wondering how can I use ARS (adaptive rejection sampling) in dirichlet process mixture model (infinite Gaussian mixture model) as described by Rasmussen (https://www.seas.harvard.edu/courses/...
1
vote
0answers
24 views

Parameter of Conditional Gaussian Distribution

I'd like to understand how to determine the parameter of conditional gaussian distribution. Following is the network architecture of VUNET which learns the conditional gaussian distribution $q(z|x, \...
1
vote
0answers
57 views

Why are observation probabilities modelled as Gaussian distributions in HMM?

HMM is a statistical model with unobserved (i.e. hidden) states used for recognition algorithms (speech, handwriting, gesture, ...). What distinguishes DHMM form CHMM is the transition probability ...
1
vote
0answers
37 views

Training Gaussian Restricted Boltzmann Machines with Noisy Rectified (nrelu or ssu) linear hidden units

I'm not sure how to implement this architecture. I'm following this thesis (pages 17-19) or this paper but I'm not sure how to train it. I want to use this to extract features from raw audio. I know I ...
1
vote
0answers
151 views

Gaussian Process Regression: does feature normalization affect final log-likelihood of model?

I'm trying to learn a Gaussian Process Regressor in SKLearn. I tried it both with and without feature (and output) normalization, and even though results seem similar-ish, the reported log marginal ...
1
vote
0answers
81 views

results from "Google Vizier: A Service for Black-Box Optimization"

In Google Vizier: A Service for Black-Box Optimization it is show what kind of optimizers google uses internally. Figure 6 shows some benchmark results compared to Random Search. Am I right in ...
1
vote
0answers
988 views

ValueError ill-defined empirical covariance when running a Gaussian Mixture Model

I am getting the following error when running a Gaussian Mixture Model: ...
0
votes
0answers
13 views

Checking if an image has an noise in it or not using psnr signal value

I basically want to check if an original image has noise in it or not. To do this, I came up with an approach where the original image is filtered first like using Gaussian filter. And then I ...
0
votes
0answers
15 views

Fitting input data into Gaussian distribution

I'm currently reading papers on Variational Autoencoders (VAE). According to this article (http://proceedings.mlr.press/v95/guo18a/guo18a.pdf): By fitting the input data sample x(i) into the Gaussian ...
0
votes
0answers
27 views

Gaussian Mixture Implementation and Optical Recognition of Handwritten Digits Data Set

Trying to implement Gaussian Mixture model implementation in python using the Optical Recognition of Handwritten Digits Data Set which consists of 10 training folds each of size $\left[100x64\right]$, ...
0
votes
0answers
8 views

Gaussian Mixture Classification Implementation with multidimensional trainning data

I'm trying to implement the gaussian mixture classification (GMC) implementation from scratch using python. The training dataset consists of 10 folds each of size $\left[100x64\right]$. In addition, ...
0
votes
0answers
14 views

Robust Gaussian Fit

I have tried to find some literature on robust gaussian fits, all I could find was good old EM gaussian mixtures. The question is : given a mixture of gaussians, find the dominant one around a given ...
0
votes
0answers
17 views

Basis Function Regression - Providing analytic expression - What to do with implicitly defined parameters?

within the probability distribution of p(y|x,w,c,d,a) c and d are implicitly defined within f(x). For a) I would have suggested: p(y | x,w,c,d,a) = N(y | f(x),a) My question: Is it okay to ignore c,d ...
0
votes
0answers
48 views

Practical difference between Bayesian Neural Networks and Feed Forward Neural Network with Gaussian Noise

To my understanding, a BNN's weights come from a Gaussian with trained mean and standard deviation, while a FFNN of the following form, comes from a learned weight, which acts as a 'mean', and is ...
0
votes
1answer
970 views

How to create a complex Gaussian random noise with a specific covariance matrix

I am trying to generate a complex Gaussian white noise, with zero mean and the covariance matrix of them is going to be a specific matrix which is assumed to be given. Assume i to be a point on the ...