Questions tagged [convolution]
For use when discussing the commutative and linear, but not associative operator interpreted on functions and distributions.
280
questions
0
votes
2
answers
34
views
Transpose Convolution Output Size
I have been learning GAN (Generative Adversarial Networks) lately and having a hard time understanding the output size for transpose convolution. Let's say I am using a Tensor of [1, 64, 1, 1] as an ...
- 27
0
votes
0
answers
18
views
Transposed Convolution in PyTorch Visualisation
I am trying to visualize the output of the transpose convolution in pytorch to better understand the operation. Here is my code, inputs and output images as well:
...
- 27
0
votes
0
answers
8
views
How to select best kernel_size and max_pool_size in CNN1D
I have data with shape size 1,89. setup kernel_size = 3 and pool_size = 2 on the conv1d layer. However, the model is not able to predict the peak well. i think the problem is because the kernel_size ...
- 21
0
votes
1
answer
174
views
CNN model why is ReLu used in Conv1D layer and in the first Dense Layer?
I have a problem. I have a CNN model which is used for an NLP problem. This is written in Python. I have questions about this, which I can't find an answer to.
Why is ReLu used inside the Conv1D ...
- 89
0
votes
0
answers
45
views
What happens in a transposed convolution when the stride is bigger than the kernel width/height?
In Pytorch's transposed convolution API, you can specify a stride that is larger than the kernel_size.
For example:
Input image of size 2x2
Kernel of size 2x2
...
- 115
0
votes
0
answers
36
views
How to see Latency at layer granularity in a CNN
I am finding documents or an example that measure Latency at layer granularity in the AlexNet model.
Please could share or tutorial for me.
0
votes
1
answer
41
views
Transpose Convolution feature extraction
Convolution extracts high-level features, but what about Transpose Convolution (or De/Up-Convolution)? Does it behave exactly the opposite? Does it generate lower-level features?
- 91
2
votes
0
answers
20
views
why layer of dimension 1 is outputting image of size n
I am studying a model where landmarks from an image are calculated. The work comes from Convolutional Experts Constrained Local Model for 3D Facial Landmark Detection.
I need to confirm why the ...
- 21
0
votes
0
answers
17
views
NCHW input matrix to Dm conversion logic for convolution in cuDNN
I have been trying to understand the convolution lowering operation shown in the cuDNN paper. I was able to understand most of it by reading through and mapping various parameters to the image below. ...
0
votes
0
answers
22
views
Inbetween CNN and MLP: neural network architecture for "close to convolutional" problem?
I am looking to approximate an (expensive to calculate precisely) forward problem using a NN. Input and output are vectors of identical length. Although not linear, the output somewhat resembles a ...
- 1
1
vote
1
answer
214
views
Why does the 1st derivative appear to lag the slope of the fit in Scipy's Savitzky-Golay filter?
I have a simple script that performs the Savitzky-Golay filter on a toy dataset of forex prices from yahoo finance:
...
- 121
5
votes
0
answers
72
views
How is image convolution actually implemented in deep learning libraries using simple linear algebra?
As a clarifier, I want to implement cross-correlation, but the machine learning literature keeps referring to it as convolution so I will stick with it.
I am trying to implement image convolution ...
- 51
1
vote
0
answers
55
views
Scaling the output of a segmentation model (UNet)
So, I have to solve an instance segmentation problem and I am thinking of implementing a UNet model based on Ronneberger et. al. 2015 paper. The problem I have is that the output size has to be ...
0
votes
1
answer
61
views
ResNet output dimensions of initial convolution don’t yield in an integer
I am trying to understand the ResNet dimensions, but got stuck at the first layer. We are passing a [224x224x3] image into 64 filters with kernel size 7x7 and stride=2. According to the ResNet source ...
- 3
2
votes
0
answers
105
views
when depthwise separable convolution should be preferred over normal convolution?
As a novice in the realm of deep learning, I recently learned about Depthwise Separable Convolution. I have seen some tutorials and articles about it on internet, and in all of them the author ...
- 21
1
vote
1
answer
133
views
Can a CNN have a different number of convolutional layers and kernel and what does it mean?
So if I have $3$ RGB channels, $6$ convolutional layers and $4$ kernels, does this mean that each kernel does a convolution on each channel and so the input for the next convolution will be $3 \times ...
- 13
0
votes
1
answer
54
views
Why keras Conv2D makes convolution over volume?
I have a very basic question, but I couldn't get the idea about 2D convolution in Keras.
If I would create a model like this :
...
1
vote
1
answer
109
views
Does a rotational convolutional filter exist in neural networks?
Traditionally, a convolutional filter is one where you take a matrix of numbers, multiply it with a subset of the data, and then sum it up. Then you move the filter left to right and top to bottom in ...
- 620
0
votes
0
answers
24
views
How do convolutional layers in a CNN feed forward when there is multiple input feature maps?
I've been trying to recreate LeNet 1(LeNet 1 architecture is pictured in the top diagram) in python using NumPy. I am unsure of how the forward pass works when there is multiple Input feature maps in ...
- 21
0
votes
1
answer
66
views
1x1 Convolution learnable parameters
Here is a code snippet wherein I add two convolution layers one with 3x3 filter followed by a layer with 1x1 filter. While I am sure how the parameters are calculated for 3x3 filter, I could not ...
0
votes
1
answer
711
views
Why is the kernel of a Convolutional layer a 4D-tensor and not a 3D one?
I am doing my final degree project on Convolutional Networks and trying to understand the explanation shown in Deep Learning book by Ian Goodfellow et al.
When defining convolution for 2D images, the ...
0
votes
1
answer
230
views
Performing 1D Depthwise conv using Keras 2D Depthwise conv
I would like to perform a 1D Depthwise convolution (ie the first step of the depthwise-separable convolution) for a machine learning model I am working on. This means that for an input activation ...
- 21
0
votes
1
answer
329
views
How to calculate convolution for 2nd conv Layer in CNN, Do we need to average across all feature maps?
I understand that for the first layer (assuming we have a grayscale image) we calculate the convolution of 3*3 receptive field as a weighted sum of receptive weights with pixels
$ x1 · w1 + x2 · w2 + ...
- 316
1
vote
0
answers
47
views
Understanding, visualizing and interpreting CNN activations
I am working with the first layer of a CNN and trying to understand how to interpret the activation output. My CNN takes input from 3 channels (RBG picture) and the first layer is ...
- 111
0
votes
0
answers
2k
views
Understanding scipy.signal.convolve2d full convolution and backpropagation between convolutional layers
I'm learning about convolutional neural networks. The convolution operation in order to extract features that is described in literature and posts used for this is quite intuitive and easy to ...
- 99
0
votes
1
answer
868
views
What will be the input_shape of tf.keras.layers.Conv3D be for these inputs
I have many videos, and each video is made up of 37 images (there are 37 frames in the whole video). And the dimension of each image is (100, 100, 3).... So the ...
user113403
1
vote
0
answers
18
views
Finding optimal time series using convolution [closed]
we logged sensor data while milling a workpiece. At several points, the workpiece was damaged and this induced a certain sensor data time series. Due to noise and since its a real world measurement, ...
- 11
1
vote
0
answers
64
views
Trade-off between number of channels and size of convolutional filters
As far as I understand, the common practice in the modern CNN architectures is to use a smaller convolutional filters, but deeper networks with more channels.
One of the reason behind this is that one ...
1
vote
0
answers
42
views
Are convolutions in deep learning associative?
Let's denote "convolution in deep learing" as "convolution-deep", and "convolution in math or signal processing" as "convolution-math".
As we all know, ...
- 21
1
vote
0
answers
48
views
Padding in Convolution Formula
Why is it that the formula for each element in a convolution between an image $I$ and a $k \times k$ sized kernel $K$ is
$$ (I*K)_{ij}=\sum_{m=0}^{k-1}\sum_{n=0}^{k-1}I_{(i-m),(j-n)}K_{mn}=\sum_{m=0}^{...
3
votes
1
answer
72
views
Does a Convolutional Layer in a Neural Network learn the correlation between its input signals via its kernel?
I am interested in the theory behing what a convolutional neural network learns with its convolutional operations. I think it learns (useful) kernels which measure the correlation between its input ...
- 449
0
votes
1
answer
201
views
What features used by CNN model should a feature store actually store? [closed]
According to MLOPs principle, it is recommended to have a feature store. The question is in the context of doing image classification using deep learning models like convolutional neural networks ...
- 2,008
1
vote
0
answers
22
views
Are 3D kernels in convolutions summed over their channels?
Say for example that I have a 28x28x1 grey scale image and I will perform two consecutive convolutions. The first convolution has 2 3x3x1 filters and the second has 3 3x3x2 filters. Each convolution ...
1
vote
0
answers
24
views
Can I say that a trained neural network model with less parameters requires less resources during real world inference?
Let us imagine that we have two trained neural network models with different architectures (e.g., type of layers). The first model (a) uses 1D convolutional layers with fully-connected layers and has ...
- 449
1
vote
0
answers
271
views
Comparison of different ways of Upsampling in detection models
There are various ways to increase the resolution of tensor in (width, height) dimensions, frequently used in detection models like ...
0
votes
1
answer
62
views
Should kernel size always be a prime number?
Should kernel size always be a prime number? E.g. (3,3) (5,5) (7,7).
While tinkering with sklearn.preprocessing.KernelCenterer(), I noticed that I could only get it ...
- 489
1
vote
1
answer
349
views
Error after merging two Deep Learning models VGG16 and ResNet50
I have merged two different models namely VGG16 and ResNet50 and given the outputs of the two models as input to another model. I have checked the Layers graph is correct. Before merging the code was ...
1
vote
1
answer
30
views
Adapting ZFNet on 2244x224 image using a filter 7X7
I am building a model based on ZFNet in Tensorflow 2.0. I am using the Petal images dataset. The images are of size 224x244x3.
So my question is when implementing the first layer (conv2d) with filter ...
- 13
1
vote
0
answers
81
views
There are 2 figures explaining transposed convolution. Which one is correct?
I have been struggling to understand transposed convolution. When I search for "transposed convolution", there are 2 figures explaining transposed convolution in which I think are not ...
- 11
2
votes
1
answer
41k
views
ValueError: Input 0 of layer sequential is incompatible with the layer: expected ndim=3, found ndim=4. Full shape received: [None, 25, 25, 1]
I am trying to use conv1D but getting that error.
My dataset's is batched and has a shape of [None, 25, 25, 1]
I am using input_shape=(25,25)
I am not able to figure out what should I change so I can ...
- 141
0
votes
1
answer
772
views
Can anyone recommend me a very good pre-trained model for face or head detection?
I really need to know the best pre-trained models to detect faces and/or peoples' head. Not a face recognition model, but only to classify whether an object is a person's head/face or not.
I'm ...
- 125
1
vote
0
answers
17
views
Can convolutional network learn structural properties of one feature w.r.t to other?
I'm going through the literature on pose-estimation ( DeeperCut, OpenPose, MultiPersonPosetrack).
I'm interested in knowing whether these networks/ generally a CNN can learn properties (geometrical) ...
1
vote
0
answers
109
views
What does it mean to say convolution implementation is based on GEMM (matrix multiply) or it is based on 1x1 kernels?
I have been trying to understand (but miserably failing) how convolutions on images (with height, width, channels) are implemented in software.
I've heard people say their convolution implementation ...
- 123
1
vote
0
answers
275
views
Understanding image size changes in DCGAN
I have been studying and trying to implement Generative Adversarial Networks using PyTorch. More precisely I tried to replicate the DCGAN PyTorch Tutorial tutorial using some custom dataset.
My code ...
- 23
2
votes
0
answers
23
views
Strategy for improving performance of 3D convolutional GAN
Others working with neural nets and GAN's might find this question interesting.
Background:
I've been working with data from Berkeleys PEER Ground Motion Database to generate new novel seismic traces. ...
- 121
2
votes
1
answer
63
views
Can I tune a model after training it? (Convolutional Neural Network & Classification)
I am relatively new to Data Science and I've recently embarked on a project. Long story short, I've trained a CNN model to distinguish between Male and Female genders. However, I wish to tune my model....
- 21
0
votes
1
answer
166
views
How to perform upsampling (and NOT interpolation) process theoretically modelled?
As an example, I know that sampling a signal $s$ is modelled by multiplication of s by a dirac comb, which has the effect of convolving the Fourier Transform (FT) of $s$ by the FT of the dirac comb ...
- 313
0
votes
1
answer
235
views
How to backpropogate Convolution layer padding inputs with respect to output derivative
I created a convolution network with 5 Conv blocks, let discuss the issue based on Conv block 4 & 5
Conv Block 4
Input Image size : 28 * 28,
Padding size 1 : 30 * 30 (image size ...
0
votes
1
answer
1k
views
PyTorchs ConvTranspose2d padding parameter
Im confused about what PyTorchs padding parameter does when using torch.nn.ConvTranspose2d.
The docs say that:
"The padding argument effectively adds dilation * (kernel_size - 1) -
padding ...
- 351
0
votes
0
answers
42
views
Why is the accuracy on the test dataset very low when training a neural network on an IMU dataset?
I am trying to train an IMU (Inertial Measurement Unit) dataset. The dataset contain 6 features (3-gyro, 3-accelerometer) and 1 label column. I have build a neural network via Conv1D, LSTM and Dense ...
- 136