Questions tagged [convolution]

For use when discussing the commutative and linear, but not associative operator interpreted on functions and distributions.

Filter by
Sorted by
Tagged with
2
votes
1answer
47 views

Autoencoders for the compression of time series

I am trying to use autoencoder (simple, convolutional, LSTM) to compress time series. Here are the models I tried. Simple autoencoder: ...
0
votes
1answer
23 views

How CNN applies backpropagation to update its weights and biases?

I understand that the 3 main layers for CNN are convolutional layer, ReLU layer and pooling layer. However, I do not understand how CNN updates its weights and biases using backpropagation. I ...
0
votes
2answers
17 views

Choosing a set of CNNs for paper

There are so many CNNs out there and im trying to do a comparison between some of them in my paper which networks should I use? Resnet, vgg and inception are obvious but I need 3 or 4 others. which ...
0
votes
1answer
11 views

How to design n-dimensional feature descriptor similar as the input image?

I am re-writing the H-Net code in Keras for cross-domain image similarity. The network architecture is described in the attached paper. I wrote the encoder and decoder parts but unable to get similar ...
-1
votes
0answers
19 views

How are convolution weights represented?

I am trying to implement the Yolo algorithm and having hard time understanding how to read the weights. Using a hex editor, I can see the data written in hex format, but I m not sure what to do with ...
0
votes
0answers
12 views

what type of classifier to use for a multiclass multilabel problem where the input dimensions are binary

The input dimension are (100,104,1) in shape and each value could be either 1 or 0. This is basically a multilabel multiclass problem where output needs to be mapped to a 104 bit vector. 104 bit ...
0
votes
1answer
12 views

I'm not getting the no of parameters concept in CNN

Hi guys i've attached two images of question please help me on solution. Thank you
2
votes
2answers
64 views

Is Max Pooling and Conv used on anything else but images?

Can you think of any domain of application, other than 2D images, where it could make sense to use max pooling or convolution? Because the ONNX format allows for non 2D inputs. On the operators page (...
1
vote
0answers
22 views

Winograd Convolution

For https://www.intel.ai/winograd-2/ , why use stride = 2 ? Why need to transform input image pixels ? Why this C++ implementation of winograd convolution does not require any input tensors ...
0
votes
0answers
10 views

How can I stack one feature-engineering based model and another one non-feature engineering based model in python?

I have a StackOverflow question answer dataset. ( this is a classification problem ) So , far I have created two different models. Model 1: LightGBM model optimized. Data fed into LightGBM model ...
0
votes
0answers
13 views

SRCNN - the colors disappear from the output

I'm training a custom CNN (built for academic purpose) to perform Super-Resolution. I based my work on this review. The input of the network is a RGB color image, so 3 channels of size image_width x ...
0
votes
0answers
19 views

Forward and backward pass in Conv2D transpose Layer

I’ve several questions regarding the transposed convolution 2d layer. I’ve not been able to find a proper resource explaining the forward and backward pass. What I know (but not for sure) is, that ...
0
votes
0answers
10 views

How to find layer-wise split of non trainable parametes in keras?

I am working on an image classifier using a CNN architecture in keras. I Instantiated a model with several Conv2D layers followed by batch normalization layers and Pooling layers and then a fully ...
1
vote
1answer
60 views

Backpropagation in a convolutional neural network with stride and padding

So i am trying to learn backpropagation of convolutional neural networks. A lot of articles only cover convolutions without a stride and a padding variable, so i decided to try it on my own. For ...
0
votes
1answer
13 views

SRGAN Generator Architecture: Why is it possible to do this elementwise sum?

Consider the first residual block. Its first convolution layer takes in inputs: THe PRELU's output 64 filters(64 outputs) each one being 3*3 with a stride of (1 ; 1) So I think that the output of ...
2
votes
1answer
23 views

Do CNN convolution and pooling layers get backpropogated?

I can't find a simple answer to this by Googling which leads me to think the answer is no, but I want to be sure... In a feed forward network, all of the layers of weights get backpropogated, but ...
0
votes
0answers
36 views

How to implement N-Dimensional Convolution in TensorFlow / Keras? (with N > 3)

I had an idea for a model that requires multidimensional convolution (i.e. 4D or more). However, I can't find anything higher than 3D Conv on the TF 2.0 / Keras module. Is there a way to implement ...
6
votes
1answer
32 views

Unable to understand the meaning of following lines of the research paper for image segmentation

I am implementing a paper on image segmentation. It is based on the slight modification of the u-net architecture. The paper is based on encoder and decoder steps Following are the lines of the paper ...
4
votes
2answers
22 views

What is the benefit of using Max pooling in convnets as opposed to just using convolution layers? (from Francois Chollet's Deep Learning with Python)

I am reading Francois Chollet's Deep learning with python, and I came across a section about max pooling that's really giving me trouble. I am unable to copy paste the content, so I've included ...
1
vote
1answer
28 views

SRCNN - how to get a color image output training only with luminance

I'm quite new to convolutional neural network, applied to super-resolution. I read this review article, itself based on this paper as an attempt to understand it better. In the review, the author ...
0
votes
0answers
15 views

Does a max-pooling layer in a ConvNet contribute to the “vanishing gradient” problem?

I would answer no, but am not sure if I'm missing something and hope you can help me out: The derivative of a max-pooling layer in a ConvNet is one w.r.t. the maximum value and zero for all others. A ...
1
vote
1answer
139 views

What is the difference between multiply and dot functions that is used to merge layer in Keras?

I want to merge two CNN deep learning model using Keras and would like to know what is the difference multiply and dot functions that is used to merge layer? ...
0
votes
0answers
19 views

Atrous convolution allows arbitrary feature map resolution

I'm reading Deeplab paper. In this paper, the authors proposed to use atrous convolution, whose 1-D form is: $\hspace{3.0cm} y[i] = \sum_k x[i + r \cdot k] w[k]$ Given this scheme, they wrote that ...
1
vote
1answer
18 views

Saving images in a non-retraceable way, but still able to train R-CNN's on them

For a computer vision project I am working with images that the company only allows me to have on my computer for a maximum of 24 hours due to regulations. Every day a few hundred images come in via ...
0
votes
0answers
10 views

MaskRCNN generated masks are not sharp

I have trained my maskrcnn for object segmentation but the generated masks are not sharp. They have a blurry edges and unrefined outlines. Do you have a work around to this solve this problem?
0
votes
0answers
115 views

ValueError: Error when checking input: expected input_1 to have 4 dimensions, but got array with shape (1, 4, 4, 200, 200)

I am working on a dqn agent with a CNN which takes input of 4 images, each grey-scaled image array is of size 80x80. my model structure is like this:- ...
0
votes
0answers
10 views

In the context of deep learning , are “data reduction layers” and “pooling layers” the same concept?

From this book About this time, Dr. Le Lu joined my group. An expert in computer vision, Le brought the passion and knowledge required to apply deep learning to the challenging problems we ...
0
votes
0answers
21 views

Keras / TensorFlow 2.0: are UpSampling2D() layers the inverse of Max-Pooling?

I am trying to build a Variational Autoencoder for image data. As I employ MaxPool2D() in the encoding part, I need the reverse it in the decoder. Are ...
0
votes
1answer
19 views

Сlassification using convolutional layers

I have a simple neural network of 2 layers, recognizing 10 classes: ...
0
votes
0answers
14 views

How to correctly use depthwise convolutional layers

I am trying to speed up my CNN by replacing all convolutional layers with depthwise convolutional layers, which can require only as much as $10$% of the operations ...
2
votes
2answers
156 views

In CNN, why do we increase the number of filters in deeper Convolution layers for complex images?

I have been doing this online course Introduction to TensorFlow for AI, ML and DL. Here in one part, they were showing a CNN model for classifying human and horses. In this model, the first ...
0
votes
1answer
23 views

How many parameters in a Conv2d Layer?

I was following andrew-ng coursera course on deep learning and there's a question that has been asked there which I couldn't figure out the answer for? Suppose your input is a 300 by 300 color (RGB) ...
2
votes
1answer
135 views

Sliding window Algorithm and its convolutional implementation

I want to know why the convolution implementation of the sliding windows is equivalent to the sequential step-by-step sliding window? Why are they the same thing? I'm following Andrew NG for this: ...
1
vote
1answer
25 views

Making sense of indices in 2D convolution operations in convolutional neural networks

Referring to the answer here: https://www.quora.com/Why-are-convolutional-nets-called-so-when-they-are-actually-doing-correlations, the equation for a discrete 2D convolution is specified as: $$C(x,y)...
0
votes
1answer
40 views

Resize instead of transposed convolutions

I'm trying to build a decoder version of ResNet, i.e. one that goes from the prelogits layer and attempts to recreate the image. I can get it working by using transposed convolutions, but the quality ...
1
vote
1answer
41 views

LeCun paper on deeplearning (Nature, 2015)

As I was reading Y. LeCun's paper on Deep Learning (Nature, vol. 521, 2015), I came across a figure (the 1st one in the paper) which was associated to the backward ...
0
votes
1answer
31 views

How to approach the PlantVillage dataset?

I'm working on the PlantVillage dataset and i want to predict the type of the disease from the image of a leaf. The dataset is labeled in pairs (Type of the plant,Healthy/name of the disease). I'm ...
0
votes
0answers
21 views

Help needed implementing Convolutional Sequence-to-Sequence Network

I am trying to build convolutional Sequence-to-Sequence network that takes inputs (satellite images) and predicts the next sequence of images. As a result, we can then predict the weather. I have ...
2
votes
0answers
12 views

wavenet structure explanation

I am a beginner in deep learning and recently I am trying to understand the structure of Wavenet. (for more information, please refer to the paper http://sergeiturukin.com/2017/03/02/wavenet.html) ...
1
vote
1answer
107 views

Why use separable convolutions on one channel input?

I'm currently working on the Text Classification Guide from Google. During step 4, they create a CNN with separable convolutions for use with word embeddings: <...
1
vote
2answers
82 views

Why do we use a softmax activation function in Convolutional Autoencoders?

I have been working on an image segmentation project where I have created a convolutional autoencoder. I saw this image and implemented it using Keras. At the output layer, the author has used the ...
0
votes
1answer
36 views

1D convolution for uni-variate data

Every one. I have EEG dataset with 80 subjects, 3072 data points and 100 trials. This a univariate data, it mean there is only one channel. I am confused how to feed this data to convolution neural ...
0
votes
0answers
56 views

Backpropagation from a fully-connected layer to a pooling or convolution layer

I've a problem where I currently try to wrap my head around. Consider a CNN with a single convolution layer and a fully-connected layer. During the forward pass, the input is processed through the ...
1
vote
1answer
117 views

Tensorflow F-RCNN first stage input and output strides

Trying to optimize performances on Tensorflow's faster_rcnn_resnet50 (from the model zoo), I'm currently working on understanding the full .config file they provide, and I'm having a hard time with ...
1
vote
0answers
21 views

When is bias set to False?

I have been working with DC-GAN to generate pairs of images based on WGAN paper. For which I referred fastai notebook on WGAN where the bias in the network has been set to False. Jeremy Howard in his ...
0
votes
0answers
37 views

Map predictions to real text

I have read the paper "Learning to Read by Spelling" by Gutpa et al. They present a method for visual text recognition without using any paired supervisory data. In chapter 4 they describe how to ...
1
vote
0answers
48 views

Understanding Faster R-CNN

I'm having some trouble understanding the way the Faster R-CNN algorithm works. Specifically, the way the authors describe the concept of anchors. In their paper from here they describe anchors in ...
0
votes
0answers
6 views

In a CNN do filters that account for depth do so for just the initial input, or for a layers with any depth?

For example, if you have an input of an image of size 100x100x3 (where 3 is the RGB of the image), then put it through a conv layer that results in an output of <...
1
vote
1answer
145 views

conv2d function in pytorch

I'm trying to use the function torch.conv2d from Pytorch but can't get a result I understand... Here is a simple example where the kernel (filt) is the same size ...