Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 45264

Refers to general procedures that attempt to determine the generalizability of a statistical result. Cross-validation arises frequently in the context of assessing how a particular model fit predicts future observations. Methods for cross-validation usually involve withholding a random subset of the data during model fitting and quantifying how accurate the withheld data are predicted and repeating this process to get a measure of prediction accuracy.

3 votes

Training with a subset of data: relationship between subset size and training metric?

Do I understand correctly from your test RMSE, that the error is lower as you increase the size of your fraction used in training? If you do 5-fold cross validation using a fraction of 0.01, that imp …
n1k31t4's user avatar
  • 15.1k
1 vote
Accepted

What is the best way to visualize 10 Fold Cross Validation Scores?

Do you only have one single model? If you were only mixing the data up (and not trying different parameter values) then any plot might not be very really useful. If performance is on the y-axis, what …
n1k31t4's user avatar
  • 15.1k
9 votes
Accepted

Stratify on regression

I have done this before and didn't find a default implementation - the StratifiedKFold and RepeatedStratifiedKFold are only documented to work with classes. The way I ended up doing it was not quite …
n1k31t4's user avatar
  • 15.1k