5
votes
Accepted
Why do we need to concatenate in a U-Net?
These types of connections between layers are called skip connections, searching for this will give you a way to find more in-depth information. Broadly speaking, there are two advantages to using ...
- 7,167
3
votes
Accepted
What are features in computer vision?
CNNs like U-Net extract lower level features like edges on lower layers (i.e. the first convolutional layers) and higher level features on higher layers (i.e. convolutional layers closer to the final ...
- 5,360
3
votes
How can I create .nii (nifti) file from 3D Numpy array
You can this using nibabel:
import nibabel as nb
ni_img = nib.Nifti1Image(numpy_array, affine=np.eye(4))
nib.save(ni_img, "dicom_volume_image.nii")
- 31
2
votes
Modifying U-Net implementation for smaller image size
It appears that the original images are 68x68 pixels and the model expects 256x256.
You can use the Keras image processing API, in particular the smart_resize function to transform the images to ...
- 20.5k
2
votes
Algorithms to do a CTRL+F (find object) on an image
Invariant object recognition(IOR), refers to rapid and accurate recognition of objects in the presence of variations such as size, rotation and position.
SIFT and SURF are the most popular among them, ...
- 1,229
2
votes
Determining which deep learning model architecture is better
Not sure what language/framework you are using for your experiments but, you should try to deep seed your models so that performance is decoupled from random as much as possible. See an example here: ...
- 2,008
2
votes
Splitting a pdf containing batch of scanned documents
"Machine Learning for Digital Document Processing: from Layout Analysis to Metadata Extraction" by Esposito, Ferilli, Basile, and Mauro goes into detail about how to create a custom system for parsing ...
- 20.5k
1
vote
Google Earth Pro Satellite image segmentation using clustering
Whoa, are you trying to do clustering based on satellite images?! Just use the underlying long & lat coordinates to do this. It will be infinitely easier and so much more accurate too. Look at ...
- 575
1
vote
Accepted
How does the "skip" method work for upsampling? (fully convolutional NN)
So as you already know, the convolutions extract some local information from the image, but for some decisions you need more global info. This is what pooling is supposed to do, it basically erases ...
- 1,515
1
vote
What Deep Learning model to use in this spectroscopy task?
I think you need a deep learning model that can perform both image segmentation and image classification. Image segmentation is the process of dividing an image into regions or pixels that share some ...
- 111
1
vote
Accepted
What preprocessing should I do to a multiclass segmentation mask?
You can perform the following pre-processing steps to mask images.
Convert your mask to one hot encoding as it converts class to binary as [0,0,0]for 0,[0,1,0] for 1, and [0,0,1] for 2, and so on...
...
- 173
1
vote
Accepted
Can you use a trained image segmentation model to label more training data for itself?
I assume you're thinking of only using images where you are confident the model has segmented them correctly? I don't think this would cause overfitting - at least what we normally think of as ...
- 1,206
1
vote
Accepted
Yolov5 image detection without segmentation?
segmentation mainly uses Fully Convolutional Network(FCN) architecture. FCN is a CNN without fully connected layers(FC). segmenation can be thought as an encoder followed by a decoder. Here encoder ...
1
vote
resnet50 implementation for semantic segmentation
The output from the ResNet model is a vector containing the probability that the image belongs to each of the n classes, in your case to any of the 21 classes. If ...
- 7,167
1
vote
Accepted
Hook up PyTorch U-Net model to video
The RuntimeError error you're getting is caused by an incorrect number of dimensions in the input. The model expects an input with four dimensions with the first ...
- 7,167
1
vote
Accepted
Segmentation model to predict face forward and profile parts of the face
There is a library called facemesh for Python. It can detect face landmark points in Python. Connecting facemesh points to crop image to a desired polygon is ...
- 201
1
vote
Accepted
Implementing U-Net segmentation model without padding
$\hspace{3cm}$
If we follow the definition of each arrow.
Gray => Copy and Crop
Every step in the expansive path consists of an upsampling of the
feature map followed by a 2x2 convolution (“up-...
- 5,544
1
vote
Photorealistic synthetic data for object segmentation
I used such an approach at the Computer Vision Lab at TU Delft for my Bachelor thesis.
The goal was to analyze different aspects of the same problem: identifying LEGO bricks in a photograph of an ...
- 201
1
vote
Accepted
What is Deep learning approach to count the number of Diamonds in an image?
I say that go with Object Detection. Because you already have annoted images. And segmentation applied to locate objects and boundaries (lines, curves, etc.) in images. . In Recent days EfficientDet ...
- 273
1
vote
Accepted
What do the parameters used in crop mean?
Lets say my image is called frame and x, y, w and h are xmin, ymin, xmax and ymax
You're confusing $w$ with $xmax$ and $h$ with $ymax$: Usually $w$ is the width of the crop whereas $xmax$ is the ...
- 25k
1
vote
Tool for annotation of images for semantic segmentation
Diffgram is really great for this! I used it for a construction monitoring project. It's Open Source. From their site:
Semantic Segmentation Tools:
Auto Bordering: Automatically detects edges to ...
- 111
1
vote
Extremely stochastic validation loss/accuracy
There can be a few reasons for this behavior as already pointed out in "Why is the validation accuracy fluctuating?":
Size of train / validation stes: Fluctuations may become stronger the ...
- 508
1
vote
Accepted
For semantic sementation, why am I getting better loss values with binary cross entropy than dice coef?
So the question asks about why different loss function lead to different error scores.
So globally error is there to help us measure the level of discrimination between the output of the model and the ...
- 1,418
1
vote
Accepted
Which colour channel from a TIFF image do I have to use?
From the readme of your kaggle link;
All images are provided in .tif format with 3 channels per image.
For 101 cases, 3 sequences are available, i.e. pre-contrast, FLAIR, post-contrast (in this order ...
- 352
1
vote
Accepted
Multiple output size in neural network
As you can see in lines 286-296 in newmodels.py the model can use two different loss functions for the four different outputs.
...
- 7,167
1
vote
Accepted
neural network probability output and loss function (example: dice loss)
I think there is a bit of confusion here. The dice coefficient is defined for binary classification. Softmax is used for multiclass classification.
Softmax and sigmoid are both interpreted as ...
- 1,515
1
vote
Accepted
Confusion matrix of UNET image sgemenation model
If your masks have only one channel and in the case of binary segmentation, you can easily compute a confusion matrix from one image thanks to:
TP: ground truth and predicted pixel are of class 1 (...
- 244
1
vote
What are features in computer vision?
In addition to the previous answer, I would add that many convolutional NN architectures (and not only convolutional!), are effectively contraction mappings of data points from input space to the ...
- 510
Only top scored, non community-wiki answers of a minimum length are eligible