Questions tagged [bootstraping]
The bootstraping tag has no usage guidance.
15
questions
1
vote
0
answers
38
views
What is the best way to combine cross-validation and bootstrapping for one application?
We intend to model data with non-parametric covariate splines and we would like to understand the uncertainty of the parameter estimates/response estimates.
Currently, we use cross-validation to model ...
- 111
0
votes
0
answers
16
views
Random walk through Bootstrap
I'm performing a Bootstrap Random Walk over a set of points which is a time series with a certain pattern.
Right now, I took the set of points and then resample it with replacement.
...
0
votes
1
answer
70
views
Understanding bootstrapping in bias variance decomposition
I was going through bias and variance tradeoff article and it makes use of bias_variance_decomp function from mlxtend library. ...
- 179
1
vote
0
answers
33
views
How to perform bootstrap validation on CART decision tree?
I have a relatively small dataset n = 500 for which I am training a CART decision tree.
My dataset has about 30 variables and the outcome has 3 classes.
I am using CART for interpretability purposes, ...
- 11
1
vote
0
answers
41
views
Evaluate Dendrogram Statistical Significance
I have N=21 objects and each one has about 80 possible not NaN descriptors.
I carried out a hierarchical clustering on the objects and I obtained this dendrogram.
I want some kind of 'confidence' ...
- 11
1
vote
0
answers
30
views
Stratified sampling - use of proxy variable
For splitting of the data into train/test/val I use stratified sampling. Is it appropriate to define strata using information extracted from the dataset? E.g. use machine-learning to model proxy ...
- 11
3
votes
2
answers
480
views
List of samples that each tree in a random forest is trained on in Scikit-Learn
In Scikit-learn's random forest, you can set bootstrap=True and each tree would select a subset of samples to train on. Is there a way to see which samples are used in each tree?
I went through the ...
1
vote
0
answers
13
views
How are the same observation sets treated in Random Forests with Bootstrapping?
Let's assume an extremely small dataset with only 4 observations. And I create a Random Forest model, with a quite large number of trees, say 200. If so, some sample sets that are the same each other ...
- 11
1
vote
1
answer
1k
views
nnet in caret. Bootstrapping or cross-validation?
I want to train shallow neural network with one hidden layer using nnet in caret. In trainControl, I used method = "cv" to perform 3-fold cross-validation. The snipped the code and results ...
- 125
3
votes
0
answers
123
views
Difference Bagging and Bootstrap aggregating
Bootstrap belongs to Efron. Tibshirani wrote a book about that in reference to Efron.
Bootstrap process for estimating the standard error of statistic s(x). B bootstrap sample are generatied from ...
- 329
0
votes
0
answers
13
views
Estimate class proportions of a feature, central limit theorem
haven't been feeling smart lately and this is probably the most trivial question ever but I really need to know. I'm trying to point estimate some population parameters. I sampled from 1000 randomly ...
- 53
2
votes
2
answers
202
views
Resampling train and test data in R
I need to try out few different machine learning methods (SVM, Logistic regression etc.), predict a value either true or false, and write down their AUC and Accuracy of these predictions.
I have ...
- 21
2
votes
1
answer
47
views
Question on bootstrap sampling
I have a corpus of manually annotated (aka "gold standard) documents and a collection of NLP systems annotations on the text from the corpus. I want to do a bootstrap sampling of the system and ...
- 201
0
votes
1
answer
107
views
Perform bootstrapping of an ordinary linear regression model, using B=100 bootstrap resamples of my dataset, and getting RMSE
So Im studying machine learning through R, and Im working with the boston data set from the library MASS. I am practicing bootsrapping. I already carried out analysis to determine how ,many distinct ...
1
vote
1
answer
82
views
About confidence/prediction intervals: parametric methods VS non-parametric (via bootstrap) methods
About the methodology to find confidence and/or prediction intervals in, let's say, a regression problem, I know 2 main options:
Checking normality in the estimates/predictions distribution, and ...
- 2,666