Questions tagged [noise]
The noise tag has no usage guidance.
24
questions
2
votes
2answers
37 views
If my model is overfitting the training dataset, does adding noise to training dataset help regularizing the machine learning model
I would like to know if this is a best practice or not. Can we add noise to the training data to help the model "fit less the training data"; as a result, hoping to generalize better on new unseen ...
0
votes
0answers
4 views
Remove noise from a k dimensional dataset made up of connected components situated far away from each other
I want to remove "meaningless" points from a k-dimensional datset which's structure follows some predefined rules.
In order to make the problem easier to visualize, I'll use a 2-d datset.
Dataset ...
0
votes
0answers
16 views
How to measure performance of a denoising autoencoder?
Is there a way to theoretically estimate (avoiding brute force) what is the minimum signal-to-noise ratio required for a denoising autoencoder (like a regular filter)? What I want to know specifically ...
2
votes
0answers
24 views
How to remove noise using morphological filtering
I have two groups of dots that both contain noise between them:
The line that separates the two groups in the picture is diagonal in shape.
I tried to use morphological filtering on this image to ...
0
votes
0answers
7 views
Smoothing a random noise causes undesirable results
I have some sample data with 7 features out of which only one feature is different. All other 6 features are same. But I add white noise to the data and multiply it with a factor to test some ML ...
0
votes
0answers
26 views
How can I reduce the noise of prediction graph?
I am trying to use LSTM to predict a time series data as you can see in the following image, the predicted graphs is very noisy:
The original data is looking like this:
That I normalized it like ...
1
vote
1answer
45 views
Noise Elimination with majority vote filtering
I have a dataset with label noise which I wan't to clean with majority/consensus vote filtering. This will mean I will divide the data in K-Folds and train an ensemble model. Than using the ...
1
vote
0answers
15 views
Isolated/noisy instances that have outsized effect on SVM hyperplane selection
Consider two linearly separable classes and the optimal separating hyperplane (image credit Prof Jiawei Han of UIUC):
Now consider if there were a single "rogue" point for the Yellow class - which ...
0
votes
0answers
13 views
Compare noise level of time series from different sources
I have multiple time series from different sources and they have different scale. For example -
...
0
votes
0answers
20 views
Microscope Image Denoise
Hi I'm working in a computer vision project, basically, the goal is to detect some specific parasites, but now that I have the images I noticed that they have a watermark that specifies the microscope ...
0
votes
1answer
111 views
what is correct way to perform normalization on data in Auto encoder?
working on anomaly detection problem. i'm using auto-encoder to denoise given input. I trained network with normal data(anomaly free). so model predict normal state of given input. Normalization of ...
3
votes
0answers
125 views
Training deep CNN with noisy dataset
I am training a Mask RCNN model with a train dataset that has been generated from some simple computer vision operations (color thresholding) and some morphological filtering.
The train set captures ...
3
votes
1answer
820 views
Effect of adding gaussian noise to the input layer in a CNN
I often come across Keras code that adds GaussianNoise to the input, however its not clear to me what advantages does it offer to the learning.
...
0
votes
0answers
8 views
A noise robust Local binary patterns variant
I’m thinking of using Local Binary Patterns (LBP) to extract features from MRI images of brain tumours to build a module for classification, due to its computational simplicity and good performance, ...
0
votes
0answers
201 views
How to create a complex Gaussian random noise with a specific covariance matrix
I am trying to generate a complex Gaussian white noise, with zero mean and the covariance matrix of them is going to be a specific matrix which is assumed to be given.
Assume i to be a point on the ...
0
votes
1answer
29 views
How can I avoid requiring global information for performing regression on meter variables?
Note: With a meter variable a timestamped value is the sum of all previous differences plus a difference to the most recent value. Think of a electricity meter counting the use of energy.
The goal ...
2
votes
1answer
65 views
Paramaeter estimation in noisy conditions with Machine Learning, possible?
Let's take two constants, $\alpha$ and $\beta$, both are given by two functions $f_1(\vec{\theta})$ and $f_2(\vec\theta$) (the model). These functions are known: we have an analytical closed ...
1
vote
0answers
129 views
Rain radar image noise reduction and cleanup
An application that I am building is plotting rain radar images on map. The images are transparent PNGs that are sourced straight from the local meteorological service.
As can be seen in the example, ...
4
votes
1answer
725 views
Training on accurate data versus noisy data
I have data currently available that is very accurate and I would like to train my classification methods on this set of clean data to learn the important markers for distinguishing between classes. ...
0
votes
1answer
37 views
Reducing noisy data from non normal distribution of data with std deviation?
I have used MATLAB code and get the two different row vectors A=1×18 and B=1×350. From both row vectors separately I need to remove the noisy data by using standard deviation. But the problem is that ...
3
votes
2answers
68 views
What is the loss function defined by Mnih and Hinton in their paper “Learning to Label Aerial Images from Noisy Data”?
In section 3.3 of the paper, they state that they use the cross entropy.
Then they define the probability for a label to be a false positive as $\theta_0$ and a false negative as $\theta_1$.
They use ...
1
vote
1answer
22 views
When we should use binning to redure noise? or How we find out we have noise?
I read several times which binning is helpful for reducing the noise of data. But how can we find out our data has noise? What if our data is clean and we reduce the accuracy of data?
Is there any ...
1
vote
0answers
50 views
Rprop is too noisy
Is there a way to reduce the noisiness and stochasticity of Rprop (and for that matter the iRprop+)?
Specifically, in deep networks (with 8+ layers) this effect starts to become apparent, as the ...
6
votes
2answers
3k views
Can Neural Networks be trained to smooth values / output the average?
Let's say we have a neural network with one input neuron and one output neuron. The training data $(x, f(x))$ is generated by a process
$$f(x) = ax + \mathcal{N}(b, c)$$
with $a, b, c \in \mathbb{R}^...
