# Questions tagged [bootstraping]

The tag has no usage guidance.

18 questions
Filter by
Sorted by
Tagged with
1 vote
14 views

### Model evaluation approach allowing manual experimentation without data leakage

In supervised machine learning, are there any evaluation approaches beside using a fixed holdout test dataset, which allow me as a scientist to manually compare preprocessing approaches, without ...
• 111
31 views

### Understanding the code for calculating the 95% confidence interval of AUC using bootstrapping

It's really embarrassing, but I lack statistical knowledge. I would like to find the confidence interval for AUC at 95%. Actually, I got the code from here(https://stackoverflow.com/questions/52373318/...
• 13
146 views

### How bootstrapping works for prediction intervals?

I'm experimenting with prediction interval (PI) over univariant time-data using skforecast pythonic package.. in the documentation it is mentioned that: Prediction intervals A prediction interval ...
• 400
36 views

### Bootstrapping formula for TD learning in Reinforcement Learning

In Reinforcement Learning (Sutton & Barto, 2018), p.120, equations (6.3)-(6.4) , to explain the idea of bootstrapping in Temporal-difference learning: v_{\pi}(s) := E_{\pi}[G_t|...
1 vote
190 views

### What is the best way to combine cross-validation and bootstrapping for one application?

We intend to model data with non-parametric covariate splines and we would like to understand the uncertainty of the parameter estimates/response estimates. Currently, we use cross-validation to model ...
167 views

### Understanding bootstrapping in bias variance decomposition

I was going through bias and variance tradeoff article and it makes use of bias_variance_decomp function from mlxtend library. ...
• 189
1 vote
62 views

### How to perform bootstrap validation on CART decision tree?

I have a relatively small dataset n = 500 for which I am training a CART decision tree. My dataset has about 30 variables and the outcome has 3 classes. I am using CART for interpretability purposes, ...
1 vote
59 views

### Evaluate Dendrogram Statistical Significance

I have N=21 objects and each one has about 80 possible not NaN descriptors. I carried out a hierarchical clustering on the objects and I obtained this dendrogram. I want some kind of 'confidence' ...
• 111
1 vote
33 views

### Stratified sampling - use of proxy variable

For splitting of the data into train/test/val I use stratified sampling. Is it appropriate to define strata using information extracted from the dataset? E.g. use machine-learning to model proxy ...
600 views

### List of samples that each tree in a random forest is trained on in Scikit-Learn

In Scikit-learn's random forest, you can set bootstrap=True and each tree would select a subset of samples to train on. Is there a way to see which samples are used in each tree? I went through the ...
1 vote
13 views

### How are the same observation sets treated in Random Forests with Bootstrapping?

Let's assume an extremely small dataset with only 4 observations. And I create a Random Forest model, with a quite large number of trees, say 200. If so, some sample sets that are the same each other ...
• 11
1 vote
2k views

### nnet in caret. Bootstrapping or cross-validation?

I want to train shallow neural network with one hidden layer using nnet in caret. In trainControl, I used method = "cv" to perform 3-fold cross-validation. The snipped the code and results ...
• 125
139 views

### Difference Bagging and Bootstrap aggregating

Bootstrap belongs to Efron. Tibshirani wrote a book about that in reference to Efron. Bootstrap process for estimating the standard error of statistic s(x). B bootstrap sample are generatied from ...
• 329
13 views

### Estimate class proportions of a feature, central limit theorem

haven't been feeling smart lately and this is probably the most trivial question ever but I really need to know. I'm trying to point estimate some population parameters. I sampled from 1000 randomly ...
• 53
262 views

### Resampling train and test data in R

I need to try out few different machine learning methods (SVM, Logistic regression etc.), predict a value either true or false, and write down their AUC and Accuracy of these predictions. I have ...
59 views

### Question on bootstrap sampling

I have a corpus of manually annotated (aka "gold standard) documents and a collection of NLP systems annotations on the text from the corpus. I want to do a bootstrap sampling of the system and ...
• 201