Questions tagged [outlier]

For questions regarding outliers or unusual points in the data.

Filter by
Sorted by
Tagged with
3
votes
1answer
4k views

Anomaly Detection In Univariate Time Series Data Using ARIMA In Python With Updating

I have trained an ARIMA model on some 15 minute incremented time series data by using the statsmodels library. I would like to determine how anomalous the next 15 minute increment's data I observe is. ...
1
vote
0answers
261 views

Outlier Detection

I have a dataset which has two class. It has 13 features. They are values which are sent from 13 sensors. Label is True or False. When I use mad outlier detection, when the label is false(really there ...
5
votes
3answers
538 views

Do you apply outlier detection of numerical data in practical applications?

In data science we often get raw data to work on. It is the main task to draw conclusions from the training data that can be generalized to future unseen data. Do you apply outlier detection in your ...
3
votes
2answers
535 views

How can I identify and remove outliers in R

I am performing regression analysis on prices of product that we have purchased, based on size and other attributes. However there are often buys in odd circumstances which factor into the price, ...
8
votes
1answer
7k views

Difference: Replicator Neural Network vs. Autoencoder

I'm currently studying papers about outlier detection using RNN's (Replicator Neural Networks) and wonder what is the particular difference to Autoencoders? RNN's seem to be treaded for many as the ...
3
votes
2answers
2k views

Outlier detection for unbalanced classes

I have to make a predictive model for predicting a boolean Won/Lost variable based on some other numeric data; and further find out the features of observations that have 'Won'. However, the number ...
2
votes
3answers
2k views

Finding outliers in multiple dimensions

I'm working on a dataset which isn't normally distributed. The dataset contains three dimensions like cost, discount and profit. I'm trying to find possible outliers in all these dimensions. I used ...
11
votes
2answers
6k views

Tools for automatic anomaly detection on a SQL table?

I have a large SQL table that is essentially a log. The data is pretty complex and I'm trying to find some way to identify anomalies without me understanding all the data. I've found lots of tools for ...
8
votes
3answers
816 views

Which algorithms or methods can be used to detect an outlier from this data set?

Suppose I have a data set : Amount of money (100, 50, 150, 200, 35, 60 ,50, 20, 500). I have Googled the web looking for techniques that can be used to find a ...
0
votes
1answer
422 views

Identifying outliers in an unknown distribution

I have a sorted sequence of integers, e.g. 1,2,480,1000,1100 representing volumes in some categories. The task is to separate the valid data (high volumes) from ...
3
votes
1answer
790 views

How to identify outliers from a small list of numbers?

I want to identify outliers from a very small group of numbers. How shall I do that? For example, for the group of numbers: -0.4, 0.4, 52.1, actually 52.1 is an outlier. I've tried using ...
10
votes
2answers
2k views

Scalable Outlier/Anomaly Detection

I am trying to setup a big data infrastructure using Hadoop, Hive, Elastic Search (amongst others), and I would like to run some algorithms over certain datasets. I would like the algorithms ...
10
votes
4answers
765 views

Gas consumption outliers detection - Neural network project. Bad results

I tried to detect outliers in the energy gas consumption of some dutch buildings, building a neural network model. I have very bad results, but I can't find the reason. I am not an expert so I would ...

1 2 3
4