Data Science

Questions tagged [pruning]

Ask Question

The tag has no usage guidance.

10 questions
Newest
Active
Bountied
Unanswered
Filter by
Sorted by
Tagged with
1
vote
0answers
21 views

How to apply pruning on a BERT model?

I have trained a BERT model using ktrain (tensorflow wrapper) to recognize emotion on text, it works but it suffers from really slow inference. That makes my model not suitable for a production ...
0
votes
0answers
16 views

SNIP (single-shot network pruning) definition in SynFlow paper

I am trying to understand how the SNIP saliency metric definition in the original paper is equivalent to the definition in the SynFlow paper on neural network pruning. The former defines saliency $\...
0
votes
0answers
7 views

Is iterative pruning always structured?

Iterative pruning works like the following: Evaluate model performance, continue if performance is fine Apply pruning Train the model Go back to step 1 When doing this process using unstructured ...
0
votes
0answers
7 views

Common sub-networks

I am pruning a neural network (CNN and Dense) and for different sparsity levels, I have different sub-networks. Say for sparsity levels of 20%, 40%, 60% and 80%, I have 4 different sub-networks. Now, ...
0
votes
1answer
45 views

Pruning in Decision trees

Following is what I learned about the process followed during building and pruning a decision tree, mathematically (from Introduction to Machine Learning by Gareth James et al.): Use recursive binary ...
0
votes
0answers
25 views

Pruning CNN filters & Reinforcement Learning

I don't know if this is an appropriate place to ask this type of questions but I don't know where to ask. I was reading this paper, it's about pruning cnn filters using reinforcement learning (policy ...
1
vote
0answers
22 views

Different Decision Tree pruning method

I am trying to learn different pruning methods for decision trees. I have put together a list of methods below. Reduced Error Pruning Cost Complexity pruning Minimum error pruning Pessimistic Error ...
0
votes
0answers
175 views

Structured and unstructured pruning for deep learning models

I was trying to understand structured and unstructured pruning techniques used for deep learning models[link 1][link 2]1. To recap what I have understand that unstructured pruning is based on weight ...
0
votes
2answers
148 views

Weight pruning of CNN

I was confused when i was reading about weight pruning on CNN. Is it applied for all the layers including convolutional layers or only it is done for dense layers?
5
votes
1answer
378 views

What is Pruning & Truncation in Decision Trees?

Pruning & Truncation As per my understanding Truncation: Stop the tree while it is still growing so that it may not end up with leaves containing very low data points. One way to do this is to set ...