Questions tagged [anomaly]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
54 views

Anomaly Detection: Large number of categories

Looking for some advice. I am working on an Anomaly detection problem, I am looking at parcels being transported from A-B and want to identify which parcels are considered anomalies for given routes. ...
darren's user avatar
  • 1
0 votes
0 answers
23 views

Varying feature vector lengths for learning

[I am a total beginner in machine learning algorithms] I have 10 spectrograms (lines) for phytoplankton (each composed of 288 points). Each spectrogram is associated with a phytoplankton dendity data ...
Marianne's user avatar
0 votes
0 answers
17 views

High dimensionality one class input

I am currently doing research on anomaly detection and currently I am facing the following problem: My input data has only one label (anomalies) and the associated data has a very high dimension and ...
much_data_many_mem's user avatar
0 votes
1 answer
19 views

How to find an anomalous matrix among many?

Let's say we have a bunch of matrices that we know are non-anomalous. We now receive a new matrix and want to know if it belongs into the group or is way off. Is there a way to do that? I'm thinking ...
TheDataScientist101's user avatar
0 votes
0 answers
25 views

What type of Anomaly Detection Model could I use?

I would like to create an anomaly detection model that assigns a probability of risk instead of labels (1 or 0). My problem is that I only know for sure which records are anomalous but not which are ...
nameguest's user avatar
0 votes
1 answer
42 views

Assign a risk score in records in a dataset

I was wondering, if I have a dataset with categorical and numerical data and labels such as 1 or 0 that shows if a row is anomalous or normal respectively. Is it possible to create somehow a model ...
nameguest's user avatar
0 votes
1 answer
90 views

Anomaly Detection Techniques

Often the hardest part of solving an Anomaly Detection problem can be finding the right technique for the job. Different Anomaly techniques are better suited for different types of data and different ...
Pluviophile's user avatar
  • 3,550
1 vote
1 answer
113 views

How to detect anomalies in each feature - time series

I have a dataset with 5 features corresponding to 5 sensors that measure each three seconds the state of an accelerator. It is structured as well: ...
Fabio's user avatar
  • 53
1 vote
2 answers
89 views

How do I determine the top "reason" for anomaly when using Isolation Forests

I am using Isolation Forests for Anomaly Detection. Say, my set has 10 variables, var1, var2, ..., var10, and I found an anomaly. Can I rank the 10 variables var1, var2, ..., var10 in such a way I can ...
user's user avatar
  • 1,971
0 votes
1 answer
44 views

which statistical parameters are more useful to detect anomalies and outlier? mean max min var?

This time series contains some time frame which each of them are 8K (frequencies)*151 (time samples) in 0.5 sec [overall 1.2288 millions samples per half a second) I need to find anomalous based on ...
user10296606's user avatar
  • 1,794
0 votes
0 answers
304 views

How is convex hull method used in outlier detection?

I think the slides are bit unclear on what they want to say. Can someone elaborate this with example.
achhainsan's user avatar
3 votes
1 answer
85 views

How to test unsupervised learning methods for anomaly detection?

How to test unsupervised learning methods for anomaly detection? I am looking for a test strategy to evaluate my result of my anomaly detection technique? what is your offer more than evaluate with ...
user10296606's user avatar
  • 1,794
1 vote
1 answer
63 views

Practical problems in anomaly detection where the number of normal data is extremely high compared to abnormal data

If the ratio of abnormal data is about 1 to 10,000 normal data, even if the true negative rate is 99%, there will be 100 false positive data, and the precision( TP/(TP+FP) ) will be low. If this kind ...
pie's user avatar
  • 111
3 votes
1 answer
160 views

How to determine the abnormality of a specific variable by taking into account all the other variables in the data?

I have an issue of machine learning/anomaly detection. Indeed, I have a variable Y and several other variables X. The purpose is to quantify the degree of abnormality of the data on Y but I have to ...
AdrienC's user avatar
  • 31
2 votes
2 answers
49 views

How to perform Anomaly Detection on a force profile?

I have a set of force profiles of an industrial machine. I'm trying to develop an algorithm that tries to understand when a new profile is "anomalous" with respect to the ones in "...
Xela95's user avatar
  • 21
0 votes
2 answers
60 views

Are cluster feature and micro-cluster good summary statistics for outlier detection in high dimensional data streams?

I'm dealing with outlier detection in data streams. I'm looking for a way to summarize my data and obtain important statistics such as means and variance, etc. I want to know if the cluster features ...
I Sui's user avatar
  • 57
1 vote
1 answer
81 views

Anomaly Detection System

I need a sanity check. I want to create an anomaly detection system. The logic which I am planning to use is the following: Find anomalies in the past using Seasonal Hybrid Extreme Studentized ...
Angelos's user avatar
  • 13
1 vote
0 answers
129 views

How to find anomalies/outliers in Panel Data?

I have panel data based on 900000 different entities with 384 time steps and the data is not normally distributed. I am looking for outliers/anomalies, this is unsupervised as I have no examples of ...
Kale-ab Tessera's user avatar
4 votes
2 answers
263 views

Anomaly detection without any knowledge about structure

I have an interesting question, my code needs to be able to handle structured data where I don't know much about the structure at development time. I know the samples follow a schema that can be ...
Jan van der Vegt's user avatar
0 votes
1 answer
280 views

Anomaly Detection for Large Time Series Data [closed]

I am working on detecting anomalies within a large time series data set. It is updated on a regular basis and consists of more than 30 parameters. I am using R as a reference language. It is a first ...
Zaynab's user avatar
  • 3
24 votes
4 answers
24k views

Looking for a good package for anomaly detection in time series

Is there a comprehensive open source package (preferably in python or R) that can be used for anomaly detection in time series? There is a one class SVM package in scikit-learn but it is not for the ...
pythinker's user avatar
  • 1,237
1 vote
4 answers
512 views

How to detect anomalous points

As is clear from the figure, the blue points, which don't follow the trend, are anomalous points. I'm wondering about the best non-parametric method to detect those points. I have tested some ...
Arkan's user avatar
  • 443
2 votes
1 answer
8k views

How to improve precision under imbalanced classification

I am using an imbalanced dataset (rare positive cases) to learn models for prediction and the final good AUC is 0.92 but the F1 score is very low0.2. Is it possible to add some key features which ...
LUSAQX's user avatar
  • 783