Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 17696

Refers to general procedures that attempt to determine the generalizability of a statistical result. Cross-validation arises frequently in the context of assessing how a particular model fit predicts future observations. Methods for cross-validation usually involve withholding a random subset of the data during model fitting and quantifying how accurate the withheld data are predicted and repeating this process to get a measure of prediction accuracy.

1 vote

Will cross validation performance be an accurate indication for predicting the true performa...

The theory behind cross validation ( v-fold cross validation) has been addressed in many papers. There is a proof for that in a set papers published from 2003-2007. Please refer to : - oracle selector …
Bashar Haddad's user avatar
10 votes
Accepted

Can overfitting occur even with validation loss still dropping?

I am not sure if the validation set is balanced or not. You have a severe data imbalance problem. If you sample equally and randomly from each class to train your network, and then a percentage of wha …
Bashar Haddad's user avatar
2 votes

Cross validation when training neural network?

Best by cross validation The whole data can be divided into training and testing. You can not touch the testing data set for any kind of training. Keep it away!! For the training data you can use i …
Bashar Haddad's user avatar
0 votes

Model selection and assessment using leave-one-out cross validation

What you just said is dividing the data into three parts: training, validating and testing. This is a very common practice in machine learning. We use validation to help in selecting hyper parameters …
Bashar Haddad's user avatar
4 votes

Using Cross Validation technique for a CNN model

The previous answer already got accepted, but I am answering this question just to make sure that things are clear. I will go one step deeper which can be helpful to advanced people. First of all, cr …
Bashar Haddad's user avatar
2 votes

Optimizing decision threshold on model with oversampled/imbalanced data

I am not sure if in the last point, you meant the validation set instead of the testing set. Here is my advice: 1- understand the impact of having data imbalance. Let start with understanding the dif …
Bashar Haddad's user avatar
1 vote

Hyperparameter tuning for stacked models

Do not mix dividing the data into k-fold with cross validation. You can use the 4 folds ( training data) to optimize the base classifiers. You can also find the best hyper parameters by applying cros …
Bashar Haddad's user avatar