1

This is about distributed computing: let's say that you have 100 tasks and 10 cores available. You parallelize your tasks so that each core processes 10 of them. Now let's imagine that the task involves some subtasks and internally tries to use all the cores available: at the two levels of parallelization the processes compete for the cores, causing a loss ...


1

Instead of GridSearchCV you should try Optuna. It is much faster than GridSearchCV. But apart from that, coming to your question, there is no best value for a hyperparameter per se! Period! It depends on what kind of data you have. What hyperparameter value works for one dataset might not work for another dataset. Also another point to keep in mind, there ...


1

In general there's no way to know the best values to try for a parameter. The only thing one can do is to try many possible values, but: this mathematically requires more computing time (see this question about how GridSearchCV works) there is a risk of overfitting the parameters, i.e. selecting a value which is optimal by chance on the validation set.


Only top voted, non community-wiki answers of a minimum length are eligible