3
$\begingroup$

I have a data set of 36K processes each with 7 features. Each set represents a task and I know how long it took to complete each of the tasks. I want to build a model which will be able to predict the duration of the future tasks.

I've only learned about Decision Tree (DT) and tried to apply it to my problem. The resulting accuracy score is 0.03. I believe DT is not suitable because the time is continuous and DT is meant for categorization.

Which algorithm is suitable for duration prediction?

My environment: Python with sklearn, if that matters.

$\endgroup$
  • 1
    $\begingroup$ Are the features integer, numeric, categorical (ordinal/nominal?) or string? What is the distribution of the target variable (task durations)? (Plot a rough histogram of durations). Is it roughly normal, or could we apply some numerical transform to make it normal, or not? When you say "the accuracy is 0.03", how did you measure that? It sounds very low. $\endgroup$ – smci Dec 1 '16 at 16:35
  • 2
    $\begingroup$ I'd actually just start with a linear regression. You can always make more complex model, but a simple linear model as a baseline is can be quite useful. $\endgroup$ – hbaderts Dec 1 '16 at 21:35
  • $\begingroup$ 36k items with 7 features is hardly big data. Have you done some exploratory plots? Did you learn any statistics on your way to learning what a decision tree was? $\endgroup$ – Spacedman Dec 2 '16 at 9:06
  • $\begingroup$ Would you be able to share the dataset (and the model you end up building)? I am interested in building an ensemble for task duration estimation, but my dataset <700 tasks, is not large enough for proper model training. $\endgroup$ – a.t. May 4 at 8:38
4
$\begingroup$

What others have said is accurate, that you need to build a regression model of some sort. Depending on the scale of the duration of your task, you will have to model it slightly differently.

In fact, there's an entire class of models that try to predict duration. These are called survival models. Here's a Python library on survival analysis.

But these models are fairly academic. A typical hack is to use Gamma, Poison, or Log-Normal regression which works out nicely because these models predict non-negative values.

| improve this answer | |
$\endgroup$
-1
$\begingroup$

You might want to look into scikit's DecisionTreeRegressor() class. A decision tree regressor will predict a real number. The decision tree classifier, by contrast, will predict a discrete class for an observation. A more advanced version would be the RandomForestRegressor() class, which builds a random forest of regression trees. A third option to consider might be a GradientBoostedRegressor().

I would also recommend this flow chart from Scikit that can help you choose an estimator.

| improve this answer | |
$\endgroup$
-1
$\begingroup$

You are facing a regression problem: your aim is to predict the value of a continuous variable given the value of a set of input variables (these input variables can be of any type: numbers, categories, etc.) A decision tree is usually applied to classification problems, in which you are aiming at predicting a discrete value.

There are several regression methods in sklearn that you could use. The simplest ones, and maybe the ones you should start from, are linear models: http://scikit-learn.org/stable/modules/linear_model.html.

Notice that you may need to transform your input data. For instance, if one of the features is categorical, you may need to transform it into a set of binary variables. Other processes, like data normalisation, may also be advisable in order to get better results.

Edit: as stated in the comments, Decision Trees can also be applied to regression problems. However, and in my own experience, the output curve that you obtain by means of this algorithm usually has a step-wise shape that may affect the final bias (see, for instance the example in the scikit-learn docs.). I would suggest not to constraint yourself and try different types of algorithms.

| improve this answer | |
$\endgroup$
  • $\begingroup$ Decision Trees can also be used for regression. $\endgroup$ – franciscojavierarceo Dec 4 '16 at 11:08

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.