Questions tagged [computer-vision]
Computer Vision is a subfield of computer science which deals with analyzing and understanding images. This includes detection of objects like faces in images or segmenting images.
624
questions
0
votes
0
answers
11
views
How to rotate a rectangle which has been formed by cv2.rectangle function
Exactly as the question says.
Constraints:
You cannot do anything to the image itself. Any and all operations has to be on the rectangle formed.
- 482
0
votes
0
answers
14
views
What is wrong with my Torch HMDB51 Dataloader?
I'm trying to prepare a HMDB51 dataset for some image classification tasks. Have done this many times before in TF but this time I am working in PyTorch. Running into this strange problem when ...
- 1
0
votes
2
answers
33
views
Is SVM is a good choice for large dataset?
With my limited knowledge of SVM, I am following a tutorial on YouTube to create an End-to-End multi-class ML model . There the person is using SVM on a dataset with 9 images dataset, but the dataset ...
2
votes
0
answers
25
views
CLIP Visual Transformer image encoder
I was doing some experiments with the CLIP's visual transformer encoder output (clip-ViT-B-32). So basically given the same scene or image, it should output almost ...
- 217
0
votes
0
answers
10
views
Retraining with the same test data returns different accuracies
I am using Pytorch for training my vit-3d model on my data. I have designed my cross-validation function and trained the model. While running the code file, I am getting different test accuracies each ...
0
votes
0
answers
15
views
Swin Transformer Relative Position Biases
I was reading the swin transformer paper and looking at the github implementation, i noticed that when calculating the relative position bias the input to the log function before the CPB MLP is scaled ...
- 1
0
votes
0
answers
4
views
Techniques for training a CV model based on PDF markup
Given a PDF of a home blueprint (e.g. https://www.roomsketcher.com/content/uploads/2023/04/blueprint-maker.jpg), what are techniques and approaches for training a CV model to lean how a user would ...
- 1
0
votes
1
answer
26
views
Detector vs Classification - Detecting a netted bag for fruit/vegetables in image
The application is detecting the presence of a netted bag in an image.
The image can contain fruit and vegetables, either with or without a netted bag around them, or below them (no constraints about ...
1
vote
0
answers
15
views
Can CNNs complete lines and contours?
Are there deep convolutional networks capable of recognizing two overlapping triangles in this image - or is this beyond the capabilities of CNNs?
And are there CNNs that can recogize two boxes ...
0
votes
0
answers
19
views
Computer Vision - is splitting by annotation considered data leakage?
We are using a COCO like dataset, with around 1500 images and 4700 annotations.
We want to define our train-test dataset split.
Will splitting our dataset by annotations cause data leakage? We fear ...
0
votes
0
answers
9
views
Differences between the two ViT-based models: GLP and DPT?
I've been learning to do some depth estimation tasks so I came across the GLP model (https://arxiv.org/pdf/2201.07436.pdf) which is suggested on huggingface website. I'm new to machine learning, so ...
- 101
0
votes
0
answers
14
views
Multilabel Image Classification - problem with probability at prediction
I'm building a multilabel image classification problem usinc MIMIC CXR dataset. I'm struggling with probability at prediction as for every image in test dataset the probability of an existance of ...
0
votes
1
answer
19
views
Depth Estimation Algorithms without Reference Image in Computer Vision for Webcam Captured Video Data of a Person
I am currently working on a computer vision project that involves analyzing video data of a person captured from a webcam. In this project, I need to compute the depth map or distance of a specific ...
- 101
0
votes
1
answer
30
views
Label_fields are not valid error when using Albumentations
I'm not sure if you can have duplicates cross-forums, but my previous question on Stack Overflow was never answered. I'll paste it here just in case.
I'm using albumentations with the following code:
<...
0
votes
1
answer
46
views
Use computer vision to detect door blockage
I want to detect door blockage on a camera. Basically if the exit door is blocked by an object, it detects it as an anomaly. How can we do it? Is it possible to do it using OpenCV?
Remember, it doesn’...
- 217
1
vote
0
answers
64
views
Annotating and Structuring a Dataset for Duplicate Detection
I'm currently working on a project that requires the detection of duplicate bands in Western blot images. The task involves two types of duplicates:
...
- 111
0
votes
0
answers
27
views
Object detection on largest number of classes
Does anyone know any pretrained object detection models to run with python with highest number of objects to be recognised? Yolo finds 80 objects, it is good if I can find a larger number. It would be ...
- 37
0
votes
0
answers
17
views
Model suggestion for estimating 6D pose of custom object
For a project of mine I’m trying to be able to track the 6D pose of a tennis racket. I’ve been looking for a model that I can use to to track either the pose or 3D keypoints of a custom object and I ...
3
votes
0
answers
71
views
Multi-page document image classification [closed]
Sorry for the long post but I needed it to be able to capture all the details and questions.
I am working on multi-page document image classification problem and am kind of confused on what approach ...
- 141
0
votes
0
answers
16
views
Need to edit in YOLO Classes
In YOLO v8 I want to only the Person class after that I will want to custom train my object and I have the dataset for that. For example, if I want to train pen and charger I want to give a custom ...
0
votes
0
answers
96
views
Augmentation and transformations in Detectron2
I'm working on a custom Faster RCNN with Detectron2 framework and I have a doubt about transformation during training and inference.
I created a custom Trainer ...
0
votes
0
answers
94
views
Meta's SAM model: can extract semantic embedding vector?
I'm interested in finding an embedding vector for each segment found by the Facebook/Meta Segment Anything model (for classification and tracking of segments).
Can ...
- 111
0
votes
0
answers
53
views
Can DeepSort be made to track objects beside people?
As far as my understanding goes, the model used for feature extraction in DeepSort is specified as the first argument of the function create_box_encoder in the file ...
- 140
1
vote
0
answers
33
views
Blip2 for image metada
I want to detect attributes of objects in an image - like what is color of a patch on shirt of person, how many patches are there, type of objects, exact dimensions of the objects etc
I've heard of ...
- 11
1
vote
0
answers
84
views
Where exactly in YOLO's architecture is the input image divided into a grid?
I am currently studying the YOLO algorithm for a project. What I'm not quite sure about is where exactly the input image is divided in an SxS grid. After my research on the paper, videos and websites ...
- 11
1
vote
2
answers
44
views
High accuracy on test and validation data but still can not predict on real data
Hello i am having a classification between two classes A and B and i have trained CNN model. I have high accuracy on all three set of data i.e training (98.7%) validation (99.3%) and test(98%) but ...
- 11
1
vote
1
answer
47
views
Convolution neural network loss increasing instead of decreasing
I am working on a binary image classification task in which I have greyscale images of size (1, 224, 224) (all normalized between 0 and 1) and a set of labels (0 or 1). I have around 2.6k images with ...
0
votes
0
answers
38
views
Why does my validation loss go so high after few epochs?
I am facing an issue with my pretrained mobilenetv3 model, it is quite strange how the validation loss is behaving, it starts low but then goes up ridiculously high. I have normalized my images as ...
- 47
0
votes
0
answers
13
views
Best model / approach to detect the number of standing bowling pins?
I want to build an ML model to detect the number of standing bowling pins, here is an example of an image from the dataset:
Do you think it's a hard task ? (considering that bowling pins are hidden ...
- 101
0
votes
0
answers
45
views
How can I prevent mobilenetv3 from overfitting with less data?
So I have around 462 images and I can't really get more images. I am using a pretrained model of MobileNetV3 with the respective weights. I am facing a huge problem of overfitting and no real solution ...
- 47
0
votes
0
answers
21
views
Embedding vector of MaskRCNN (Resnet with FPN)
I have a MaskRCNN model for instance segmentation with Resnet 50 - FPN backbone trained in detectron2. And I want to extract the embedding/feature vectors for visualizing input and hopefully detecting ...
0
votes
0
answers
548
views
How does the background class work in object detection?
I am using YOLOv5 for object detection.
I understand that any labelled classes that are not predicted, that is, false negatives (FN) shows up as background. But how are the false positive (FP) being ...
0
votes
2
answers
473
views
computer vision transformers: ViT does not have a decoder?
from https://www.youtube.com/watch?v=TrdevFK_am4 that explains the paper titled, "AN IMAGE IS WORTH 16X16 WORDS:
TRANSFORMERS FOR IMAGE RECOGNITION AT SCALE"
compare that to the architecture ...
- 574
0
votes
1
answer
18
views
How is the classification step performed in Swin Transformer?
I've read the original paper of the Swin Transformer, and understand it quite well apart from the last step: the classification. In the paper, this is completely brushed over, and none of the blog ...
- 195
0
votes
0
answers
14
views
Image based ML paradigms where input vector integrates pixel intensity with pixel coordinates
Are there image based machine learning formulations where the input is not just the plain 2D image grid but one where pixel intensity $I(x,y)$, at position $(x,y)$ is coupled with the actual position ...
- 101
0
votes
0
answers
15
views
Need help in Image Similarity search engine
I need to build a Jewellery Image Similarity engine.
As in if the user shows an image of a Golden earring with blue stones, the similar jewellery images should be fetched from our DB.
I have a dataset ...
- 265
0
votes
1
answer
157
views
Can I use one-hot encoded output for segmentation in Pytorch, with focal and dice losses?
know that for classification using a neural network and CrossEntropy Loss, we need one-hot encoded output, but in PyTorch, the CrossEntropy loss does not accept one-hot encoded targets, and we should ...
- 101
0
votes
0
answers
28
views
How do you find the coordinates of the bounding box for meituan Yolov6?
I'm trying to track a runner in a frame and eventually output velocity of the runner. The way that I am trying to do this is by finding the midpoint of the bounding box and then calculate the change ...
- 1
0
votes
0
answers
82
views
Getting a dimension mismatch when training dataset on openAI CLIP
Here's the code I've written:
...
0
votes
0
answers
52
views
Algortihm for clustering 2d grid-like scattered points
I struggle to find a way to cluster points scattered on a 2D map. The points are mostly following parallel lines (more or less curvy) and are crossed by other parallel lines in another direction.
Here ...
0
votes
0
answers
8
views
Image Captioning problem where we expect a specifc type of answer depending on the objects in the image
I'm working on an ML problem where I'm trying to generate captions for the images, but depending on the category of the image, the caption should contain specific information. For example, if the ...
0
votes
0
answers
8
views
How to generate embedding for Image Dataset with multiple features?
My dataset has Jewellery images. The jewellery is of 4 types:
Type
Color
Shape
Material
Now I am aware of converting images to embeddings. I need to group similar images like two plain gold rings ...
- 265
0
votes
0
answers
16
views
Improving Deep Learning Model to Detect Train Wagon Gaps in Variable Conditions
The original question has been asked here:
https://stackoverflow.com/questions/75897626/improving-deep-learning-model-to-detect-train-wagon-gaps-in-variable-conditions
Our team records video streams ...
1
vote
1
answer
282
views
Is it possible to modify YOLOv8 to use it as a feature extractor for other tasks?
I'm reading through the documentation of YOLOv8 here, but I fail to see an easy way to do what I suggest in the title. What I want to do is to load a pretrained YOLOv8 model, create a bigger model ...
- 377
0
votes
0
answers
4
views
SingleShotDetector Notation
The SSD uses a Conv4_3 Layer from VGG16 with Size 38x38x512. What does 38x38x512 exactly mean?
Is it a 3d convolutional layer? Or does it has 512 output channels?
0
votes
0
answers
11
views
Faster R-CNN: are the proposal coordinates predicted in stage 1 fed as input to the bbox regressor of stage 2?
If I understand correctly, stage 2 of Faster R-CNN "refines" the proposals predicted by stage 1. However, this would require providing the coordinates from stage 1 as input to the bbox ...
- 377
0
votes
0
answers
8
views
Implementing a dataset to Computer Vision Article
I want to implement the PIE dataset in the AgentFormer arch.
AgentFormer uses ETH and nuScene datasets. I successfully run these datasets on this arch. However, I couldn't take a good way with the PIE ...
- 1
0
votes
0
answers
20
views
Fast Fourier Transform in computer vision
Can someone explain me how does FFT works in computer vision, please. I know something about FFT as an algorithm of competitive programming but I can't understand how it perform an image in computer ...
- 101
1
vote
2
answers
93
views
Class Imbalance in Dataset of Images
When dealing with an imbalanced dataset, I have been taught to oversample on only the train samples and not the entire dataset to avoid overfitting, however this was for structured text based data in ...
- 11
0
votes
1
answer
65
views
Understanding image reconstruction from human brain activity
In this article, the authors apparently "reconstruct" images from brain activity represented by functional MRI. I'm impressed, but I don't really understand what is being done.
I would like ...
- 24.8k