The description on the
RandomizedSearchCV says this about best hyperparameters :
"Estimator that was chosen by the search, i.e. estimator which gave highest score (or smallest loss if specified) on the left out data. Not available if refit=False."
Lets say i used
RandomizedSearchCV with 5 folds.
Lets say fold number 2 had best validation score out of five, then the hyperparameters of the training data of that model would be returned as best hyperparameters?
I thought the hyperparameters would be same for each fold in a given iteration and hence the iteration with highest validation score will be the best hyperparameter.
Are hyperparameters in each fold for one iteration different for some methods ?