Questions tagged [gaussian]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
2answers
30 views

CNN: How do I handle Blurred images in the dataset?

I have 30% blurred images in each classes. I have a total of 10 classes. I'm not allowed to drop these blurred images. How do I train the model to get better accuracy for both blurred and nonblurred ...
0
votes
0answers
15 views

does gaussian distribution of the data features stimulate us to apply PCA? [closed]

before applying PCA on data, I plotted the distribution of each feature. my data is 5 face landmarks each landmark has 2 coordinates which result in 10 features the distribution of all the features ...
0
votes
0answers
13 views

Calculating probability from a distribution

I have a histogram/count plots of average time a property is in the market. Given this distribution, I'd like to calculate the probability that a similar property will be leased within 'x # of weeks' ...
0
votes
0answers
22 views

Kernel approximation of a function known only point-wise?

Assume that I have a set of $N$ points $x_i, i=1,...,N,$ in some space $\mathbb{R}^D$, and corresponding point-wise (scalar) function evaluations $f(x_i)$. It is my goal to approximate the unknown ...
1
vote
0answers
17 views

Multivariate Gaussian distribution - Covariance vs linear dependence

From prof. Andrew Ng's Multivariate Gaussian distribution lecture, covariance measures linear dependency between features, in which case we might use Multivariate Gaussian distribution with covariance ...
1
vote
2answers
117 views

Anconda R version - How to upgrade to 4.0 and later

I use R through the anaconda navigator, which manages all my package installations. I need to use qgraph for a project, which is dependent on mnormt library, which in turn needs RStudio verion >4.0 ...
3
votes
1answer
47 views

Why Gaussian mixture model uses Expectation maximization instead of Gradient descent?

Why Gaussian mixture model uses Expectation maximization instead of Gradient descent? What other models uses Expectation maximization to find best optimal parameters instead of using gradient descent?
0
votes
0answers
6 views

what are Latent model and Latent Varibles?

what are latent models and why they use Expectation maximization instead of gradient descent to optmize the parameters ? How to interpret and understand whether a hidden varible is present in model or ...
0
votes
0answers
8 views

what kind of distribution is followed by word and sentence vectors generated by TFIDF ,word2vec,glove,bert,flair?

what kind of distribution is followed by word or sentence embedding vectors generated by TFID or pretrained models like word2vec,glove,bert,flair ? is it continuous or discrete or any other ...
0
votes
0answers
7 views

Computing generalized variance for high-dimensional data

What are some practical methods to compute the generalized variance $|\Sigma|$ of a multivariate Gaussian, for high-dimensional data (d>200)? I'm having troubles computing the product of eigenvalues ...
0
votes
0answers
15 views

How to create anisotropic exponential and gaussian correlation function in Python for kernel?

I have a dataset of 1000 observed samples of 6 features that form the X and one target variable that forms the Y. I am using kriging or Gaussian Process Regressor to train my models. I would like to ...
0
votes
0answers
28 views

Question regarding Gaussian window function using pandas

I'm trying to aggregate my timeseries data using a rolling window. Within a particular window, I would like to use a bell curve to assign weights to individual data points. To be more specific: the ...
0
votes
2answers
28 views

Use a single Gaussian to represent a mixture of Gaussians

I want to merge a Gaussian mixture, $\sum_{i=1}^{K} w_i \exp(x; \mu_{i}, \Sigma_{i})$ into one single Gaussian, under the constraints that $w_1 >> w_2 \geq \dots \geq w_K$, i.e. we have a ...
0
votes
1answer
15 views

How to model anomaly data using Gaussian distribution assuming variables are dependent? (In Python)

I have some data which contains anomalies as well. I want to model data using Gaussian distribution assuming variables are dependent in Python. How can I model this? Should I use the PDF formula as ...
2
votes
1answer
70 views

why naive is needed in Naive Bayes ,what happens if naive is not included in Bayes theorem?

Im trying to understand why naive is needed in Naive Bayes and everyone says Naive Bayes assumes the input features (predictors) are not correlated hence they are not dependent on each other . i want ...
2
votes
1answer
28 views

What is the “learning” step in Gaussian Naive Bayes classification?

For conditionally independent features $f_i$, Naive Bayes Classification gives me the classifier $Classifier(f) := \arg \max_{k} P(C=k) · ∏^n_{i=1} P(f_i|C=k)$ for classes $k$. I understand that ...
2
votes
1answer
30 views

GMM in speech recoginition using HMM-GMM

I am trying to solve/understand ASR using HMM-GMM. At the abstract level i do understand what's happening but I did not understand how GMM fits into it. My data has 5K hours of speech from single ...
0
votes
0answers
26 views

Gaussian mixture models: find correct prior

This task might be pretty simple to the most of you. However, I am struggling to calculate the PDF for the Gaussian distributions. Help is very much appreciated!
4
votes
1answer
30 views

Modifying a distribution by adding in samples incrementally

I would like to calculate the distribution (e.g., Gaussian) of a set of samples. However, I would also like to see how the distribution changes as I fit the samples into the distribution ...
1
vote
1answer
74 views

Relationship between Sigmoid and Gaussing Distribution

I was reading this article where I came across the following statement in the context of "Why do we use sigmoid activation function in Neural Nets?": The assumption of a dependent variable to follow ...
0
votes
0answers
29 views

Gradient equations of gaussian kernel discriminant trained with gradiant descent

I am having a hard time trying to find the gradient equations for the weight $\alpha^t$ and $w_0$ for a gaussian kernel discriminant trained with gradient descent with the following error function $$E(...
0
votes
1answer
69 views

What is a latent space vector?

I do not understand this about GANs. Apparently the Generator is supposed to receive a latent space vector as its input. Yet I couldn't find an example of how I can implement it in Pytorch. This is a ...
2
votes
1answer
58 views

Co-joining multi-peak histograms

I am analysing a bunch of data files which represent responsiveness of cells to addition of a drug. If a drug is not added, cell responds normally, if it is added, it shows abnormal patterns: , . We ...
0
votes
1answer
34 views

What is a “variable index” in the Gaussian perspective?

I was going through this article about Gaussian processes, in which the author explains about the "variable index" in the form of a plot while writing about 2D Gaussian. The explanation and plot are ...
0
votes
0answers
22 views

Normalization of Distribution of numeric features and target

Here, I am talking about the Normalization of Distribution of Features/Target, not normalization/scaling of them. I've been seeing Notebooks which normalize some features and the target variable, ...
4
votes
2answers
38 views

Is it possible to train probabilistic model to return several distributions?

I have nonlinear data of function y(x), which is let's say parabolic. At some points of x there are several y's (look at the picture). Is it possible to train a probabilistic model to return several ...
1
vote
0answers
43 views

How can detect and highlight outliers by using gaussian function and normalize the data elegantly?

I tried to normalize the data by using Gaussian function 2 times on both positive and negative numbers of each parameter of this dataset. The dataset includes missing data as well. The problem is I ...
1
vote
1answer
459 views

A2C Continuous for Pendulum-v0 working implementation, negation for loss and entropy calculation

very good implementation of A2C continuous for Pendulum-v0 Code has snippet to stop execution when mean of last 10 or 20 is higher than -20 but the results look like: ...
1
vote
1answer
430 views

Prove GDA decision boundary is linear

My attempt: (a) I solved that $a=\ln{\frac{P(X|C_0)P(C_0)}{P(X|C_1)P(C_1)}}$ (b) Here is where I'm running into trouble. I'm plugging the distributions into $\ln{\frac{P(X|C_0)P(C_0)}{P(X|C_1)P(C_1)...
0
votes
0answers
31 views

How is the standard deviation of VAE's obtained?

I am trying to build a Variational Autoencoder. I was looking at various codes online and found most of them in some way or another copy Francois Chollet (Google researchers) code. Now my main ...
9
votes
1answer
1k views

Why Gaussian latent variable (noise) for GAN?

When I was reading about GAN, the thing I don't understand is why people often choose the input to a GAN (z) to be samples from a Gaussian? - and then are there also potential problems associated with ...
2
votes
1answer
695 views

Fast way of computing covariance matrix of nonstationary kernel in Python

Suppose I have symmetric positive definite covariance function $k:\mathbb{R}\times\mathbb{R}\rightarrow \mathbb{R}$ that is non-stationary (i.e. $k(x,y) \neq g(|x-y|)$ for any function $g$). Is there ...
5
votes
1answer
2k views

Gaussian Mixture Models as a classifier?

I'm learning the GMM clustering algorithm. I don't understand how it can used as a classifier. Here are my thought: 1) GMM is an unsupervised ML algorithm. At least that's how ...
1
vote
0answers
83 views

Deepmind conditional neural process: evaluation

Going through the Deepmind jupyter notebook conditional neural processes, the plots at the bottom of the notebook show that the ground truth and the predicted distribution only overlap around the "...
0
votes
1answer
419 views

How to create a complex Gaussian random noise with a specific covariance matrix

I am trying to generate a complex Gaussian white noise, with zero mean and the covariance matrix of them is going to be a specific matrix which is assumed to be given. Assume i to be a point on the ...
1
vote
0answers
23 views

How to use Adaptive Rejection Sampling to Update Alpha in iGMM

I am wondering how can I use ARS (adaptive rejection sampling) in dirichlet process mixture model (infinite Gaussian mixture model) as described by Rasmussen (https://www.seas.harvard.edu/courses/...
-1
votes
1answer
52 views

Can I call this graph as a gaussian? [closed]

My program is a chatbot. It has rule to represent the state that user is talking to the bot at node level n. I have 1 to 9 nodes in the application. Here is the ...
0
votes
1answer
53 views

Limits of using a normal distribution in Bayesian inference

When applying a Bayesian inference method such as Gaussian Process Regression (GPR), the assumption of a prior and likelihood function following a normal distribution is inherent. One can use an ...
0
votes
1answer
5k views

Gaussian distribution in python without using libraries

I am implementing Gaussian distribution of a variable, but it gives multiple bell shapes. It should be a single bell shape. Below is my code and plot. ...
2
votes
1answer
193 views

Probabilistic Outlier Detection (edited + clarified)

Measured data $D \in \mathbb{R}^3$, every $d^i \in D$ is $d^i_{(x)}$, where the $x=[x_1, x_2]$. Simply said, the measured data are function of $x$. It is known, the dependency is linear, such as: $$...
2
votes
0answers
33 views

What are the reasons for drawing initial neural network weights from a Gaussian?

Are there theoretical or empirical reasons for drawing initial weights of a multilayer perceptron from a Gaussian rather than from, say, a Cauchy distribution?
3
votes
1answer
2k views

What mu and sigma vector really mean in VAE?

In standard autoencoder, we encode data to bottleneck, then decode with using initial input as output to compute loss. We do activate matrix multiplication all over the network and if we are good, ...
1
vote
0answers
23 views

Parameter of Conditional Gaussian Distribution

I'd like to understand how to determine the parameter of conditional gaussian distribution. Following is the network architecture of VUNET which learns the conditional gaussian distribution $q(z|x, \...
1
vote
0answers
55 views

Why are observation probabilities modelled as Gaussian distributions in HMM?

HMM is a statistical model with unobserved (i.e. hidden) states used for recognition algorithms (speech, handwriting, gesture, ...). What distinguishes DHMM form CHMM is the transition probability ...
1
vote
0answers
33 views

Training Gaussian Restricted Boltzmann Machines with Noisy Rectified (nrelu or ssu) linear hidden units

I'm not sure how to implement this architecture. I'm following this thesis (pages 17-19) or this paper but I'm not sure how to train it. I want to use this to extract features from raw audio. I know I ...
2
votes
1answer
81 views

Mixture Density Network: determine the parameters of each Gaussian component

I am reading Bishop's Mixture Density Network paper at: https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/bishop-ncrg-94-004.pdf This is a good paper, but I am still confused about ...
2
votes
1answer
51 views

Where can we find the application of bayes's theorem in Bayesian optimiation with gaussian processing

I am trying to learn bayesian optimisation by following this tutorial. However, until now I don't get the relation between bayes's theorem to the gaussian process formalism. Any ideas?
1
vote
1answer
153 views

Understanding GMM-MMI

While studying Gaussian mixture models and the expectation maximization algorithm, I also came across a number of studies that used 'Discriminative training' for the models that addressed some ...
1
vote
2answers
330 views

How to tune bandwidth in machine learning kernel model?

Gaussian kernel $k(x,y) = \exp(-\lVert x-y \rVert^2/\sigma^2)$ has a hyperparameter $\sigma$. I know grid search cross validation, but this would require a lot of computation since computational ...
1
vote
0answers
136 views

Gaussian Process Regression: does feature normalization affect final log-likelihood of model?

I'm trying to learn a Gaussian Process Regressor in SKLearn. I tried it both with and without feature (and output) normalization, and even though results seem similar-ish, the reported log marginal ...