Questions tagged [pruning]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
11 views

Pruning using BERTology

I am trying out some BERT based models for a question and answering task. I need models trained on squad v2.0. To cut down on the inference time , I'm trying out pruning. I came across the BERTology ...
  • 103
0 votes
0 answers
61 views

Difference between CNN filter and channel pruning

I've been reading up on DNN pruning techniques and came across filter pruning and channel pruning in CNNs. However, as was my understanding, confirmed by this paper: Pruning a filter in layer $i$ is ...
  • 101
1 vote
1 answer
77 views

Optuna Median Pruner n_warmup_steps

For Gradient Boosting Models such as XGBOOST and LGBM does n_warmup_steps in optuna.pruners.MedianPruner refer to the minimum number of folds evaluated before pruning is triggered? I.e. if number of ...
0 votes
0 answers
24 views

What is the difference between using Minimal Cost-Complexity Pruning and testing all possible tree depths in a decision tree?

I´m studying the sklearn decision tree classifier and I´m having some trouble understanding the concept of pruning. From what I understand it consists in making the tree less deep in order to avoid ...
  • 1
0 votes
0 answers
17 views

Prune albert model using pytorch

I using albert model to retrain custom corpus with pytorch. I need to prune the model for better performance. Any code source to implement pruning for pretrained models?
  • 58
1 vote
0 answers
15 views

Difference between rpart models, one with information split the other with rpart.control

What is the difference between these two models? ...
1 vote
1 answer
133 views

Efficient Decision Tree Pruning

Is there an efficient way to handle pruning in Decision Tree with Python ? Currently I'm doing that: ...
  • 301
1 vote
1 answer
218 views

cost-complexity-pruning-path with pipeline

I'm using Kaggle's titanic set. I'm using pieplines and I'm trying to prune my decision tree and for that I want the cost_complexity_pruning_path. The last line of code produces the error: ...
1 vote
0 answers
52 views

Search for redundant filters(channels) in CNN

When training a CNN one specifies in each layer the number of channels. In the input we have 1 channel for grayscale image and 3 for RGB image, and then usually the ...
1 vote
0 answers
136 views

How to apply pruning on a BERT model?

I have trained a BERT model using ktrain (tensorflow wrapper) to recognize emotion on text, it works but it suffers from really slow inference. That makes my model not suitable for a production ...
0 votes
1 answer
499 views

Pruning in Decision trees

Following is what I learned about the process followed during building and pruning a decision tree, mathematically (from Introduction to Machine Learning by Gareth James et al.): Use recursive binary ...
1 vote
0 answers
42 views

Different Decision Tree pruning method

I am trying to learn different pruning methods for decision trees. I have put together a list of methods below. Reduced Error Pruning Cost Complexity pruning Minimum error pruning Pessimistic Error ...
  • 11
1 vote
1 answer
584 views

Structured and unstructured pruning for deep learning models

I was trying to understand structured and unstructured pruning techniques used for deep learning models: link 1 and link 2. To recap what I have understood that unstructured pruning is based on weight ...
  • 125
0 votes
2 answers
450 views

Weight pruning of CNN

I was confused when i was reading about weight pruning on CNN. Is it applied for all the layers including convolutional layers or only it is done for dense layers?
  • 125
6 votes
1 answer
2k views

What is Pruning & Truncation in Decision Trees?

Pruning & Truncation As per my understanding Truncation: Stop the tree while it is still growing so that it may not end up with leaves containing very low data points. One way to do this is to set ...
  • 2,776