Questions tagged [image-segmentation]

The tag has no usage guidance.

56 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
6
votes
0answers
2k views

Why is my Keras model not learning image segmentation?

Edit: as is turns out, not even the model's initial creator could successfully fine-tune it. This is most likely a problem of implementation, or possibly related to the non-intuitive way in which the ...
3
votes
1answer
129 views

Segmentation Network produces noisy output

I've implemented a SegNet and SegNet ReLU variant in PyTorch. I'm using it as a proof-of-concept for now, but what really bothers me is the noise produced by the network. With ADAM I seem to get ...
2
votes
0answers
17 views

Instance Segmentation using the predefined bounding boxes

I want to do Instance Segmentation using the images in my dataset which are already annotated and I don't want to train the model but use the pre-trained model. I was following this colab notebook. ...
2
votes
0answers
23 views

Transfer Deep Learning from one aerial imagery datset to many others

I am new to Deep Learning but have been able to use RasterVision successfully to predict building footprints within a set of aerial imagery. This aerial imagery data set is for a province of New ...
2
votes
0answers
27 views

Video segmentation vs image segmentation

I am new to data science & working on a segmentation model, Basically I need to deploy this segmentation model in android devices using TensorFlow-Lite for real time camera frame segmentation. I ...
1
vote
1answer
16 views

How to resize image along with their mask?

I have original images of the size 1935x1481. I am using labelme to annotate the images. I am creating polygons on the original image. Is there a way to resize the image along with their mask? I am ...
1
vote
0answers
21 views

Beginner level: how to interpret LIME and classification result

I am new to the concept of model interpretability using LIME method. I am following the tutorial LIME for spectrogram classification. I am finding hard to understand the color coding -- before using ...
1
vote
1answer
39 views

Correct way of computing dice score for image segmentation?

In binary image segmentation, for given a set of images, it's true mask and predicted mask. How do you compute dice score? Should I compute the dice score for each image separately and then find mean ...
1
vote
1answer
77 views

How can I create .nii (nifti) file from 3D Numpy array

I have a prediction numpy array. How can I make a .nii or .nii.gz mask file from the array?
1
vote
1answer
19 views

Photorealistic synthetic data for object segmentation

Let's say that we have a very small labelled dataset for instance segmentation and there is a photorealistic physics engine available that can produce synthetic data for us. Looking on the web I haven'...
1
vote
0answers
95 views

How do you deal with variable input sizes with an encoder-decoder net with skip connections in Keras?

I am currently getting into image segmentation with Keras, and I am using an encoder-decoder type as in the image below. My problem is that applying a MaxPooling2D ...
1
vote
1answer
135 views

Normalization of CT scans

I trained an infection segmentation models on a large dataset of CT scans, and want to extend it to other datasets to show the ability of the model to generalize. What I found though, is that CT scans ...
1
vote
1answer
37 views

Ways of calculating the area of colored regions in a map

Background I am a PHD student trying to improve my data science. One of my research projects, has me tasked with determining the size of the clusters in a colored image of regions. Here is an example ...
1
vote
1answer
428 views

How can I use my own dataset for Image segmentation using Tensorflow

I have a huge problem using my own created dataset for image segmentation using Tensorflow. The dataset that I've build contain images like the one shown below: The problem that I have is: How do I ...
1
vote
0answers
13 views

How to approach coarse-grained semantic segmentation?

I’m looking at doing something like semantic segmentation of images but where I only have pretty coarse-grained labels - roughly, for each 32x32 patch, I know if the answer should be “yes”, “no” or “...
1
vote
0answers
197 views

How to deal with severe overfitting in a UNet Encoder/Decoder CNN in a task very similar to image translation?

I am trying to fit a UNet CNN to a task very similar to image to image translation. The input to the network is a binary matrix of size (64,256) and the output is of size (64,32). The columns ...
1
vote
0answers
1k views

Image Segmentation Class weight using tensorflow keras

I remember definitely being able to pass a list to class_weight with keras (binary image segmentation specifically). For example: ...
1
vote
0answers
103 views

What is the difference between proposal-based approach and proposal-free approach?

From here it says that Techniques to solve instance segmentation can be roughly grouped into two categories: proposal-based methods and proposal-free methods. In proposal-based methods, a set of ...
1
vote
0answers
26 views

Paragraph extraction from text

I am trying to separate scanned pages of a 3 column book into paragraphs. On the pages there can be images located in an arbitrary location, occupying part of one, two or all three of the columns. ...
1
vote
1answer
26 views

Is it cheating to stratified sample the whole dataset based on a previous evaluation result?

I trained a model using a small mri dataset(57 patients). The model's performance was so low(Train set 0.7, Val set 0.7, Test set 0.45). I found the model segment tumor in upper part of brain well, ...
1
vote
1answer
349 views

How to prepare masks for multiclass semantic segmentation?

It's very straightforward for binary semantic segmentation: black color (0s) is responsible for background, whereas white color (1s) is responsible for objects of interest. But what about multiclass ...
1
vote
0answers
38 views

Image segmentation for small images with rectangles

I am doing toy project and trying to make image segmentation for rectangles generated in small images. Here the code: ...
1
vote
0answers
17 views

An CNN seems like capturing specific range of input data. (Image Segmentation)

I'm trying to build a model to segment brain tumors. I trained a model, and the validation dice coefficient is disappointing(0.6). When i saw the predicted images with the ground truths, it seems ...
1
vote
0answers
15 views

Is there a way to test out simple filters before committing to coding them?

Is there a way to test out simple filters before committing to coding them? Like if I want to estimate the feasibility of recognizing some features from images. Or to estimate the effort/...
1
vote
1answer
17 views

Tools suitable for semi-automatic video labeling?

So far I have been using labelme to label objects in videos I use for training, but it is quite time consuming. Are there good tools to help with that? I was thinking about a tool where I label ...
0
votes
0answers
2 views

Number classes in tf.keras.metrics.MeanIoU for one class in image segmentation why must set num_classes = 2? What difference between this and IoU?

I train U-Net model for audiometric CT image segmentation. I have one class in train data set and test data set (such as bladder). At the first time I set tf.keras.metrics.MeanIoU in model.fit, I set (...
0
votes
0answers
13 views

Computing symmetric difference hypothesis divergence $H \Delta H$ for two domains using a segmentation network

Given two domains $D_1$ and $D_2$, the symmetric difference hypothesis divergence ($H \Delta H$) is used as a measure how much two domains differ from each other. Let the hypothesis, segmentation ...
0
votes
0answers
6 views

How to check if 2 images where splitted?

There is an original data-set of images. Each image was splitted into 2 parts (left-right). I want to run on all those splitted images and check if each 2 images are spliited from same image. Is ...
0
votes
0answers
24 views

How to use mean IoU for RGB mask (keras implementation)?

I am training pix2pix GAN for converting SAR satellite images to segmentation mask. But I am not aware about how to use the mean IoU to evaluate my model. My output is of ...
0
votes
0answers
44 views

Best algorithm for real-time instance segmentation in videos?

I want to do object detection in real-time (meaning localization and classification) on videos (25 FPS), but with the added constraint that my training data is labelled using binary masks, rather than ...
0
votes
0answers
16 views

U-Net doesn't work with images different from the dataset

I have implemented a very similar U-Net code from github, but for a different dataset, this one, to segment roads, it works fine using the test folder images, but when i for example, pick a print from ...
0
votes
0answers
8 views

Instance segmentation mask creation for adjacent objects within the same class

How are instance segmentation masks created for adjacent objects from the same class ? If for example we have different objects, we can distinguish between them using the labels, but how to ...
0
votes
0answers
7 views

Boundary segmentation

I have one problem regarding segmentation. I would like to put more concentration on the boundary instead of the interior of segmented part. Is that possible to do using Tensorflow 2? For example, if ...
0
votes
1answer
19 views

Semantic segmentation in high-resolution images with high variance - cannot avoid underfitting

I am working on a dataset of 2K images for a semantic segmentation problem. I want to detect and localize small objects, with the smallest mask to be 5x5 pixels. The images include 5 different ...
0
votes
0answers
17 views

Changing order of input dimension in Tensorflow 3-D Layers

According to the official documentation of tf.keras.layers.Conv3D 5+D tensor with shape: batch_shape + (channels, conv_dim1, conv_dim2, conv_dim3) if data_format='channels_first' or 5+D tensor with ...
0
votes
0answers
31 views

Agglomerative Hierarchical Clustering on Images

My goal is to implement the agglomerative hierarchical clustering algorithm on an RGB image to cluster every pixel until some stopping criteria is reached. In order to do so, I assumed that each pixel ...
0
votes
0answers
12 views

Semantic segmentation to instance segmentation

Having a mask from semantic segmentation I want to split it to list of non-overlapping instances masks(like an output from instance segmentation). Do you know some fast algorithm, approach, tool or ...
0
votes
0answers
11 views

I have no access to gpu due to usage limits?

I start running my code using google colab I first set the execution to GPU and then I run my code for a training task using keras !after 1 hour I got a message saying I can't use GPU due to usage ...
0
votes
0answers
135 views

Implementing Multiclass Dice Loss Function

I am doing multi class segmentation using UNet. My input to the model is HxWxC and my output is, ...
0
votes
0answers
14 views

Satellite Change Segmentation using Unet

Hi StackExchange community I am working on to train a Unet for satellite change segmentation. My dataset consists of images(before change),images(after change) and the corresponding change ...
0
votes
0answers
11 views

How to generate fixed number of superpixels?

A lot of work regarding Graph Neural Networks require fixed number of nodes. In the case of image processing using graph, the image representation is often super pixels (like in this work https://...
0
votes
0answers
16 views

Loss function to compare non binary segmentation

I need to compare two images corresponding to landmark locations. I was thinking of something related to Dice loss. I cannot use dice loss since the image is not binary. The background is black but ...
0
votes
0answers
25 views

loss function for multi-label segmentation with class inbalance

In order to use a binary segmentation loss function in a multi label problem, I would like to permute the batch axis with the channel axis in the loss computation in order to compute the loss by ...
0
votes
0answers
11 views

How to Convolve a High-Res Image by a (fully convolutional) CNN kernel?

My CNN is an extremely simple neural network. ...
0
votes
0answers
24 views

IOU and dice_coef exceed 100% in multi task learning

Im doing a multi task learning for road and center line extraction (2 classes) I used IOU and dice_coef as a metrics : ...
0
votes
0answers
20 views

Model selection Tensorflow for custom dataset comparing panoramic images vs regular images (Image segmentation)

I have a question regarding the use of a specific model such as Deeplab and how to create a custom dataset for it. Background To give a bit of background info, I want to compare panoramically stitched ...
0
votes
0answers
17 views

Why it is reshaped the last layers of VGG_UNet segmentation model?

I want to do a multiclass segmentation task using deep learning (in python). Here, is a summary of vgg_unet model that is mainly collected from GitHub. So, in my dataset 8 labels are available. So, at ...
0
votes
0answers
15 views

Is it possible to create a 3d to 2d U-net?

I was curious if it is possible to create a U-net type architecture that takes in a 3d image and outputs a 2d image? Or, alternatively, would some other architecture be better suited for this problem? ...
0
votes
0answers
58 views

Why does dice coefficient equally weigh false positive and false negative?

According to this article: Dice coefficient= The 2-class DSC variant for class c is expressed in Equation 1, where gic ∈ {0, 1} and pic ∈ [0, 1] represent the ground truth label and the predicted ...
0
votes
0answers
59 views

Image segmentation network to extract questions from an image of a test paper?

This is the sample document -> I want to extract questions along with the options. There are other question papers as which have questions with diagrams in them. I want to be able to extract them ...