-2
$\begingroup$

I have the adjustment data in telecom domain: There are problems that sometimes the automation script generates the bill twice which causes duplicate records.

I want to know how to prepare the data and train the ML model. Currently, I am considering the duplicate record as issues and training the SVM model for one-class classification.

Duplicate Bill
    ABC13C,13.59,2017-03-01,2017-03-01,2017-03-01,118,I,A,0,C,2011    1 

Should I train the model with actual bill and duplicate bill as both issues and train the model and then predict the rest or is there any other way to consider or should I implement time-series classification?

Records 
Actual Bill                                                     label
ABC13C,13.59,2017-03-01,2017-03-01,2017-03-01,118,I,A,0,C,2011    1
Duplicate Bill
ABC13C,13.59,2017-03-01,2017-03-01,2017-03-01,118,I,A,0,C,2011    1 
$\endgroup$
1
  • 1
    $\begingroup$ Look into deduplication or record linkage. This is a classic problem in information retrieval. $\endgroup$ – Emre Oct 23 '17 at 21:52
1
$\begingroup$

This really isn't a machine learning task, but a database task. Unless you want indication why such records appear as duplicates, but that is more of a debugging task.

$\endgroup$
2
  • $\begingroup$ Do you think I am not aware of that? $\endgroup$ – vinaykva Oct 24 '17 at 0:18
  • $\begingroup$ Then please explain why you consider this a machine learning task. Maybe I am missing some subtle point in your question. Or there is some domain knowledge that is more obvious for you than for me. $\endgroup$ – Pieter21 Oct 24 '17 at 7:56

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.