Questions tagged [pruning]
The pruning tag has no usage guidance.
14
questions
0
votes
0answers
8 views
Prune Neural Networks layers for f% sparsity - TensorFlow2
I am using TensorFlow 2.5 and Python3.8 where I have a simple TF2 CNN having one conv layer and an output layer for binary classification as follows:
...
1
vote
1answer
32 views
Efficient Decision Tree Pruning
Is there an efficient way to handle pruning in Decision Tree with Python ?
Currently I'm doing that:
...
0
votes
0answers
8 views
Cost-complexity pruning: what the method does exactly?
The tree::prune.tree R function has a method parameter, described in the guide as:
character string denoting the measure of ...
1
vote
1answer
41 views
cost-complexity-pruning-path with pipeline
I'm using Kaggle's titanic set. I'm using pieplines and I'm trying to prune my decision tree and for that I want the cost_complexity_pruning_path. The last line of code produces the error:
...
1
vote
0answers
24 views
Search for redundant filters(channels) in CNN
When training a CNN one specifies in each layer the number of channels. In the input we have 1 channel for grayscale image and 3 for RGB image, and then usually the ...
0
votes
0answers
71 views
Pytorch: Faster inferences
I have trained a DL image classification model. The model size is 250 MB. I want to expedite the inference timing for both GPU and CPU run. On searching a bit, the general trend for faster inference ...
1
vote
0answers
76 views
How to apply pruning on a BERT model?
I have trained a BERT model using ktrain (tensorflow wrapper) to recognize emotion on text, it works but it suffers from really slow inference. That makes my model not suitable for a production ...
0
votes
0answers
24 views
SNIP (single-shot network pruning) definition in SynFlow paper
I am trying to understand how the SNIP saliency metric definition in the original paper is equivalent to the definition in the SynFlow paper on neural network pruning.
The former defines saliency $\...
0
votes
0answers
9 views
Is iterative pruning always structured?
Iterative pruning works like the following:
Evaluate model performance, continue if performance is fine
Apply pruning
Train the model
Go back to step 1
When doing this process using unstructured ...
0
votes
1answer
211 views
Pruning in Decision trees
Following is what I learned about the process followed during building and pruning a decision tree, mathematically (from Introduction to Machine Learning by Gareth James et al.):
Use recursive binary ...
1
vote
0answers
36 views
Different Decision Tree pruning method
I am trying to learn different pruning methods for decision trees. I have put together a list of methods below.
Reduced Error Pruning
Cost Complexity pruning
Minimum error pruning
Pessimistic Error ...
1
vote
1answer
409 views
Structured and unstructured pruning for deep learning models
I was trying to understand structured and unstructured pruning techniques used for deep learning models: link 1 and link 2. To recap what I have understood that unstructured pruning is based on weight ...
0
votes
2answers
339 views
Weight pruning of CNN
I was confused when i was reading about weight pruning on CNN. Is it applied for all the layers including convolutional layers or only it is done for dense layers?
5
votes
1answer
824 views
What is Pruning & Truncation in Decision Trees?
Pruning & Truncation
As per my understanding
Truncation: Stop the tree while it is still growing so that it may not end up with leaves containing very low data points. One way to do this is to set ...
