Questions tagged [pruning]
The pruning tag has no usage guidance.
15
questions
0
votes
0
answers
11
views
Pruning using BERTology
I am trying out some BERT based models for a question and answering task. I need models trained on squad v2.0. To cut down on the inference time , I'm trying out pruning. I came across the BERTology ...
- 103
0
votes
0
answers
61
views
Difference between CNN filter and channel pruning
I've been reading up on DNN pruning techniques and came across filter pruning and channel pruning in CNNs. However, as was my understanding, confirmed by this paper:
Pruning a filter
in layer $i$ is ...
- 101
1
vote
1
answer
77
views
Optuna Median Pruner n_warmup_steps
For Gradient Boosting Models such as XGBOOST and LGBM does n_warmup_steps in optuna.pruners.MedianPruner refer to the minimum number of folds evaluated before pruning is triggered?
I.e. if number of ...
- 111
0
votes
0
answers
24
views
What is the difference between using Minimal Cost-Complexity Pruning and testing all possible tree depths in a decision tree?
I´m studying the sklearn decision tree classifier and I´m having some trouble understanding the concept of pruning. From what I understand it consists in making the tree less deep in order to avoid ...
- 1
0
votes
0
answers
17
views
Prune albert model using pytorch
I using albert model to retrain custom corpus with pytorch. I need to prune the model for better performance. Any code source to implement pruning for pretrained models?
- 58
1
vote
0
answers
15
views
Difference between rpart models, one with information split the other with rpart.control
What is the difference between these two models?
...
- 163
1
vote
1
answer
133
views
Efficient Decision Tree Pruning
Is there an efficient way to handle pruning in Decision Tree with Python ?
Currently I'm doing that:
...
- 301
1
vote
1
answer
218
views
cost-complexity-pruning-path with pipeline
I'm using Kaggle's titanic set. I'm using pieplines and I'm trying to prune my decision tree and for that I want the cost_complexity_pruning_path. The last line of code produces the error:
...
- 113
1
vote
0
answers
52
views
Search for redundant filters(channels) in CNN
When training a CNN one specifies in each layer the number of channels. In the input we have 1 channel for grayscale image and 3 for RGB image, and then usually the ...
1
vote
0
answers
136
views
How to apply pruning on a BERT model?
I have trained a BERT model using ktrain (tensorflow wrapper) to recognize emotion on text, it works but it suffers from really slow inference. That makes my model not suitable for a production ...
0
votes
1
answer
499
views
Pruning in Decision trees
Following is what I learned about the process followed during building and pruning a decision tree, mathematically (from Introduction to Machine Learning by Gareth James et al.):
Use recursive binary ...
- 115
1
vote
0
answers
42
views
Different Decision Tree pruning method
I am trying to learn different pruning methods for decision trees. I have put together a list of methods below.
Reduced Error Pruning
Cost Complexity pruning
Minimum error pruning
Pessimistic Error ...
- 11
1
vote
1
answer
584
views
Structured and unstructured pruning for deep learning models
I was trying to understand structured and unstructured pruning techniques used for deep learning models: link 1 and link 2. To recap what I have understood that unstructured pruning is based on weight ...
- 125
0
votes
2
answers
450
views
Weight pruning of CNN
I was confused when i was reading about weight pruning on CNN. Is it applied for all the layers including convolutional layers or only it is done for dense layers?
- 125
6
votes
1
answer
2k
views
What is Pruning & Truncation in Decision Trees?
Pruning & Truncation
As per my understanding
Truncation: Stop the tree while it is still growing so that it may not end up with leaves containing very low data points. One way to do this is to set ...
- 2,776