4
$\begingroup$

I have transaction details for credit data (bank transfers, peer to peer transfers, etc). Currently, I have one year worth of data which I cannot properly classify.

I'm looking for input and suggestions about these two questions:

  1. How do I detect anomalies in the last hour with previous credit transaction data that I have?

  2. How can I detect anomalies in real-time for the current transaction?

$\endgroup$
  • 1
    $\begingroup$ Hi. Welcome to the site :) $\endgroup$ – Dawny33 Feb 13 '17 at 12:22
2
$\begingroup$

There are a few factors to consider in anomaly detection. A simple method would be to plot a boxplot of the data and calculate outliers this way (boxplot description).

If the time series is seasonal, you could take an approach similar to Twitter's anomaly detection algorithm (Twitter Anomaly Detection). This uses an outlier detection method (ESD) applied to the seasonal decomposition of the time series.

You could use clustering and SVMs as well.

There is also change-point detection which I understand less but can be very effective.

Really, your answer depends on how complex your data is. Sometimes, a simple heuristic algorithm works the best.

Here are some similar questions:

Anomaly detection in Time Series Data - Help Required

How to classify and cluster this time series data

| improve this answer | |
$\endgroup$
  • $\begingroup$ There is no seasonal data. Transactions are uniform. There is no training data. Would time-series work fine? $\endgroup$ – Kira Feb 14 '17 at 7:21
  • $\begingroup$ I would avoid any time series approach that specifically addresses seasonality. Start simple and work your way up. Some quick boxplots to visualize your data, and see if this captures your outliers. ESD (itl.nist.gov/div898/handbook/eda/section3/eda35h3.htm) could be a useful method. Clustering could also work, and it is unsupervised, however, there are some pitfalls to k-means. Without knowing the data, it is hard to say what time series approaches will be appropriate but it's definitely worth a look. $\endgroup$ – Hobbes Feb 14 '17 at 16:03

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.