1
$\begingroup$

I need to design and implement my 3rd year project which is a real-time alert system for parents to keep their kids safe with their smartphones.

My data is time-based and unsupervised, which means I don't have score for any events, it contains events from :

  • mobile browsing ( http requests )
  • gps coordinates
  • calls ( outgoing & incoming )

Should I choose cluster based / density based approach ? How do I find rare & suspicious events that parents should be notified for with the help of machine learning ?

Any suggestions on how to present the results visually ?

Is a week of data enough for training ?

Are there any good open sources in Java to detect anomaly ?

Improve this question
$\endgroup$

1 Answer 1

Reset to default
1
$\begingroup$

Should I choose cluster based / density based approach?

Yes, but depends on how good the algorithm is, and how effectively is the algorithm identifying important clusters. There is a lot of literature where people have taken the clustering approach.

If I were to go with the clustering approach, I would go with the hierarchical clustering technique, cause it would help me re-check my clusters and build hierarchies in them so that the seriousness of the fraud can also be explored.

How do I find rare & suspicious events that parents should be notified for with the help of machine learning ?

I would point out an answer which I have written for a very similar question, which also explores the aspect of fraud detection and anomaly analysis. And as I have said in the answer, the genetic algorithm still goes strong when it comes to fraud detection, owing to it's neat method of fitness calculation of the data points.

Any suggestions on how to present the results visually ?

Generally such charts are presented through pie charts and network graphs. you can also use infographics if you have a nice idea about design and aesthetics.

Is a week of data enough for training ?

Generally, data science teams at Paypal, Palantir, etc churn years of data for sensible insights. As you say it's a class project, data of several months should do good. You wouldn't really get anything suspicious or sensible from a week of data.

Are there any good open sources in Java to detect anomaly ?

Yes, there are some:

  1. Genetic algorithms library
  2. A Distributed Online Machine Learning Framework in java
Improve this answer
$\endgroup$
4
  • $\begingroup$ Thank you, I know what the parameters are, isn't that the main factor to for choosing an algorithm ? do you have any ideas for pre-processing stage, how to split this parameters into sub-parameters ? $\endgroup$
    – huji1991
    Commented Jan 24, 2016 at 8:53
  • $\begingroup$ @huji1991 Glad you liked the answer(you can also upvote it if it helped :)). Generally, the parameters/threshold depends on the problem domain. For example, a particular stretch of internet time might be okay for US kids, and might not go well with Indian kids. So, the context is the key, when dealing with fraud detection problems! $\endgroup$
    – Dawny33
    Commented Jan 24, 2016 at 9:01
  • $\begingroup$ I need reputation to upvote (15points+) $\endgroup$
    – huji1991
    Commented Jan 24, 2016 at 9:10
  • $\begingroup$ It's okay :) And welcome to the site! $\endgroup$
    – Dawny33
    Commented Jan 24, 2016 at 9:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.