Low accuracy in multi-class classification despite all data being generated from rules

Question

I have a well defined data where i have cleaned up my data to final form which has 20 features mapping to a number between 1 to 100. Upto 5 features are enabled(value set to 1) for each row. The data looks something like below

 Result|f1|f2|...f19|f20
 45    |0 | 1|... 1 | 0
 92    |0 | 0|... 1 | 1

I'm trying to build machine learning models that can give me good accuracy and preferably models which can handle warm_start since each iteration generates 1 row that i need to fit into existing build model.

below are 2 classifiers that i tried to set some baseline

randclf = RandomForestClassifier(n_estimators=50)
decclf = DecisionTreeClassifier(criterion = "gini", random_state = 100,max_depth=3, min_samples_leaf=5)

However even with 100,000 records i'm getting very poor result with accuracy around 15-20%. considering how predictable data is(data is generated based on finite set of rules) i was expecting very high accuracy.

I'm i doing something wrong, i want get the high accuracy in classifying data(predicting Result) based on features given, can you suggest some models that might work well this kind of data. what about tensorflow and neural network approach?

data:

https://github.com/sachinhegde6/machinelearningdata

Update: Data imbalance is something i cant help as they are generated based on rules.

Answer 1

I think neural network will be computationally intensive and would require you to have a good GPU along with good amount of training data. You can try running a clustering algorithm like k-means or logistic regression using warm_start

Answer 2

I think the biggest problem is with your data. Accuracy only makes sense as a metric if your labels are balanced. Your labels (Result) are very unbalanced. Your most frequent label (Result = 60) appears 27326 times while your least frequent label (Result = 29) appears only 3 times. Your can check this yourself by doing:

import pandas as pd
data = pd.read_csv('/PATH/TO/FILE.csv', index_col=0)
data['Result'].value_counts(ascending=True)

or you can plot it:

data['Result'].value_counts().plot.bar()

So I suggest you start with generating balanced data where all labels are distributed equally.

Regarding your questions about neural networks and tensorflow. I would not recommend it to for your problem. The way you tackle multi-class problems with neural networks is by doing something called One vs. All which requires you to train one entire network per class. You have 101 classes and training 101 neural networks is not really practical. I think you should try out a gradient boosting classifier like LightGBM or XGBoost.