Skip to main content
OverflowAI is here! AI power for your Stack Overflow for Teams knowledge community. Learn more

Questions tagged [labels]

Use for questions about the labels associated with the ground-truth of a dataset. Typically these data points have been labelled by a domain expert and can therefore be assumed to be true, against which we can compare the predictions of our algorithms.

Filter by
Sorted by
Tagged with
1 vote
1 answer
23 views

What techniques can I use to detect wrongly tagged fraud transactions?

Context: we have a fairly well performing XGBoost model that gives out a prob score denoting the probability of a transaction being a Fraud transaction. The model is trained on past data, with ...
WorldGov's user avatar
  • 133
0 votes
0 answers
19 views

How to best visualize feature-label combinations as a tree/chart/table?

Given different combinations of four feature, a, b, c, d, we can get different different sets of labels from a fixed label set ...
alvas's user avatar
  • 2,410
0 votes
1 answer
29 views

Best practice labeling grouped anomalies for object detection

I would like to train object detection model (e.g. YOLO) for images that contain anomalies. The anomalies are essentially the holes in a surface of different sizes. How do I label correctly such ...
In777's user avatar
  • 3
0 votes
1 answer
913 views

How to compare labels from clustering analysis and original ones?

I was asked to run a clustering analysis to assess the validity of labels for a manually labelled dataset. I can simply save the actual labels (4 classes: 0, 1, 2, 3) and run clustering analysis (let'...
AngelMarcos's user avatar
1 vote
1 answer
630 views

How to predict on data that is label encoded as end user will input a categorical data?

My dataset contains about 29 features with 3 class labels as result. Among these 29 features around 24 features are categorical i cannot transform each category into numbers as there are many more ...
Muhammad Minhas's user avatar
0 votes
0 answers
45 views

Is my image too low res for semantic segmentation task?

I am trying to solve a semantic segmentation task in the field of agriculture and I have some ortophoto drone images that have been acquired at the same height above the crops and in different ...
Vlad Timu's user avatar
1 vote
0 answers
23 views

Supervised recommender system design feedback

I am facing a challenge that I am not quite sure how to solve and would like to hear feedback. Basically, I have to implement a recomendation system for certain courses to be recommended to users of ...
user138557's user avatar
2 votes
1 answer
104 views

Using k-means to create labels for supervised learning

I want to know if the following is a valid approach to create labels, if I have measurements under some conditions, and the conditions are similar but never exactly the same. This doesn't correspond ...
Seb001's user avatar
  • 23
1 vote
1 answer
53 views

Sub labelling of an object

First timer in image processing - Pardon my cluelessness. Is there a concept of sub labeling in objection identification? I want to label a person and sub label "eye" of a person and train a ...
Jean's user avatar
  • 111
1 vote
0 answers
16 views

How to label legit users when trying developing a bot flagging classification model?

I’m working on a project where I try to flag bots from legit users on social media. The data I collected is not labeled but I have labeled about 17% of it (22k users) thought different techniques. ...
Marc's user avatar
  • 222
2 votes
0 answers
314 views

Are more target labels in a multi-label classification always better?

Context We work on medical image segmentation. There are a lot of potential labels for one and the same region we segment. There can be different medically defined labels like anatomical regions, more ...
Spenhouet's user avatar
  • 121
1 vote
1 answer
401 views

How to use confidence labels?

I have 2 sets of training data in csv files. The training data have class labels, 1 for memorable, and 0 for not memorable. In addition, there is also a confidence label for each sample. The class ...
user avatar
0 votes
1 answer
162 views

Using CNNs to detect incorrect label images in dataset

What I want to do is to train a model to identify the images that are incorrectly labeled in my dataset, for example, in a class of dogs, I can find cats images and I want a model that detects all ...
Lema Zaidi's user avatar
1 vote
1 answer
167 views

Labelling for churn measurement

I have 3 domains of supplier data (Jan 2017 to Jan 2022) and they are as follows a) Purchase data - Contains all the purchase (of product) data made by the suppliers with us. It contains columns such ...
The Great's user avatar
  • 2,565
1 vote
2 answers
63 views

Given daily sequence of events with only event ID labels (alphanum strings), what algorithms can be used to detect sequences that are outliers?

For example, the data might be something like this: ...
demoman's user avatar
  • 11
0 votes
1 answer
18 views

Ordered categorical xlabel number - what to call xlabel

Say I have 105 brand names from a store, and I know the average retrun percentage for the products of the different brands. . For example: ...
nammerkage's user avatar
1 vote
1 answer
47 views

Supervised vs Unsupervised - Flag fake accounts on social medias

I have this project I'm working on where I scraped users' data from social media to predict if they are bots, fake accounts or legit users based on their comments, likes, posts, public data only. I'm ...
Marc's user avatar
  • 222
0 votes
0 answers
10 views

Best Practices For Dealing With This Scenario

I'm presently building a spam classifier. The model is unable to even overfit the training set at present. To investigate, I plotted the distributions of the model's features, and compared them across ...
Michael's user avatar
  • 101
3 votes
1 answer
42 views

Who is supposed to label my sentiment analysis? Linguistics or psychologist?

I'm starting off my undergraduate research on text classification even though I'm still considered new to this topic. I've collected more than 20K data from Twitter. I've been trying to label the data ...
Faaiz's user avatar
  • 33
2 votes
1 answer
75 views

Labeling and aggregating features issue

I am trying build a simple binary classifier (some tree based algorithm for now) and my training data will have features aggregated at the user level. So I'll have a unique records of each user. These ...
cryp's user avatar
  • 123
1 vote
1 answer
21 views

Classifying visual environment in Tensorflow CNN (video analytics)

I am given a selection of videos of users exploring simulated 3D enviroments (kind of looks like the Sims video game) and I am tasked with being able to classify each room using a tensorflow framework....
NoahSCode's user avatar
1 vote
3 answers
119 views

How to detect outliers to lable my unsupervised data?

I have unsupervised sensor data and i want to lable each row of data as anomaly or normal. Here K-mean clustering will work?
user12's user avatar
  • 171
1 vote
0 answers
10 views

Transformer removes heading labels [closed]

Question: Is there a way to retain/include headers once they go through a make_column_transformer? My dataframe has the usual columns and rows, but a header is included. Example: When I take the data ...
Neal Liddle's user avatar
0 votes
0 answers
81 views

Label description for scikit-learn Diabetes dataset

I am studying how to build a regression model using the Diabetes dataset from scikit-learn and I cannot find a good interpretation for the target value, meaning that I do not know what value would be ...
Ciprian Teletin's user avatar
1 vote
2 answers
567 views

One hot vector output in classification task

I'm working on CNN model and I used one hot vector type of labels. The number of classes is 3: [1,0,0], [0,1,0], [0,0,1]. net(x) I'm getting such an output: [0....
Adolf Miszka's user avatar
0 votes
1 answer
1k views

What is the difference between a bounding box and ROI (Region of Interest)

I was reading about the Fast RCNN for object detection. From what I understand, it uses pre-computed ROI's (using selective search) and uses these to predict the bounding box offsets and uses smooth ...
Jitesh Malipeddi's user avatar
1 vote
1 answer
57 views

Which samples to inspect in a noisy labeled classification task?

I have a dataset with noisy labels on which I train a binary classifier. Inspecting the loss I see some samples were misclassified with high confidence and others were classified with indecision ...
anon's user avatar
  • 13
0 votes
1 answer
3k views

Changing order of LabelEncoder() result

Assume I have a multi-class classification task. The labels are: Class 1 Class 2 Class 3 After LabelEncoder(), the labels are transformed into 0-1-2. My questions are: Do the labels have to start ...
iso_9001_'s user avatar
  • 175
0 votes
1 answer
36 views

(Labeled, if possible) time-series datasets for anomaly detection [closed]

I would like to create a big list of available time-series datasets for anomaly detection. I'm especially interested in the following: The time-series data should be segmented into cycles Ideally, ...
Guillermo Mosse's user avatar
2 votes
1 answer
59 views

How would you build a big production ready image training dataset from scratch?

How would you most likely create a large production ready image training dataset from scratch including annotations for a image classification task? We will take a large amount of images (~1 million) ...
Basti's user avatar
  • 21
3 votes
2 answers
346 views

Is there a clustering algorithm which accepts some clusters as input and outputs some more clusters?

Heres the task: I have data I don't know much about. The final task is to build a classifier to classify the samples into a few categories. Some of the categories are pretty clear, we can easily use ...
chefhose's user avatar
0 votes
1 answer
1k views

MultiLabelBinarizer() with inverse_transform()

I have multilabel labels. Elements in a label mean voting. Here is how labels look: ...
Scott's user avatar
  • 111
0 votes
1 answer
83 views

Is there a deep learning method for 3D labels?

As the question says, I want to feed labels into a neural net that are three dimensional. Let's say that I have 3 possible labels and each one of my data points corresponds to a percentage of those ...
La Cordillera's user avatar
3 votes
3 answers
731 views

Should you turn off label smoothing when validating?

As the subject says. On one hand, the answer should be yes because label smoothing is a regularization feature and how can you know if it improves performance without turning it off? On the other hand,...
Gaslight Deceive Subvert's user avatar
2 votes
2 answers
496 views

How to train a machine learning algorithm with multiple labels

I have the following challenge and I very much hope that there is a solution to it. I also suspect that there is a simple approach to it. I just don't see it at the moment. Any help or advice is ...
requalys's user avatar
1 vote
1 answer
1k views

sklearn serialize label encoder for multiple categorical columns

I have a model with several categorical features that need to be converted to numeric format. I am using a combination of LabelEncoder and OneHotEncoder to achieve this. Once in production, I need to ...
revy's user avatar
  • 133
1 vote
0 answers
29 views

Excluding "mislabeled" examples in training set based on out of time data

This question is specifically regarding imperfect labels. I'd like to understand the theoretical and practical implications of removing examples from the training set based on information obtained ...
Thomas Boser's user avatar
0 votes
1 answer
82 views

Get Label Statistics of Image Dataset

I have a labeled image dataset, where the images are in subfolders and there is one Pascal XML per image with the labels. I would like to compute stats like: how many images have exactly two labels? ...
to_the_nth's user avatar
1 vote
1 answer
1k views

How to fix spelling mistakes in data?

I have an input data file which contains list of drug names. I have more than 1000 unique drug names. However, the drug names has spelling mistakes and space character issues. For ex: we have ...
The Great's user avatar
  • 2,565
1 vote
1 answer
201 views

LSTM Time-series classification - derived feature

I have a time-series dataset and I want to derive a new feature based on a date column which I believe might improve my predictive model. The feature is if it's weekday or weekend. I am not sure how ...
Robert's user avatar
  • 23
1 vote
1 answer
247 views

How to trust the labels generated using ML models?

I have a dataset of patient records. But I do not know whether he is +ve for a cancer or not. So, I do not have the labels in my dataset. Now I can run a machine learning models like clustering to ...
The Great's user avatar
  • 2,565
0 votes
1 answer
148 views

why we need data labelling tool for computer vision?

Before start training images with tensorflow object detection api we need to use labelling tool to annotate our images and converted to XML format. What happens when we convert our annoted image to ...
Bala venkatesh's user avatar
1 vote
1 answer
59 views

LabelEncoder with a Multi-Layer Perceptron?

So we're working on a machine learning project at work and it's the first time I'm working with an actual team on this. I got pretty good results with a model that uses the following SKLearn pipeline: ...
lte__'s user avatar
  • 1,320
3 votes
1 answer
50 views

When unsupervised learning is more beneficial in comparison with supervised learning even the labelings are existed?

When unsupervised learning is more beneficial in comparison with supervised learning even the labeling are existed? If there is no labeling the unsupervised learning is better than supervised learning ...
user10296606's user avatar
  • 1,844
6 votes
2 answers
870 views

Can I use confident predictions to correct incorrect labels?

From visual inspection of a sub-portion of my data, I estimate that around 5-6% of the labels are incorrect. My classifier still performs well and when I take prediction probabilities that are above ...
Danyal Andriano's user avatar
2 votes
1 answer
675 views

How is a coincidence matrix constructed for computing Krippendorff's alpha?

I am looking at two documents to help me learn about constructing coincidence matrices in order to gain a better understanding of Krippendorff's alpha. I am using these two: https://repository.upenn....
quanty's user avatar
  • 133
9 votes
3 answers
486 views

Is (nearly) all data separable?

Suppose I have some data set with two classes. I could draw a decision boundary around each data point belonging to one of these classes, and hence, separate the data, like so: Where the red lines ...
Data's user avatar
  • 467
3 votes
1 answer
767 views

Discriminator of a Conditional GAN with continuous labels

OK, let's say we have well-labeled images with non-discrete labels such as brightness or size or something and we want to generate images based on it. If it were done with a discrete label it could ...
user3023715's user avatar
1 vote
1 answer
56 views

Tools suitable for semi-automatic video labeling?

So far I have been using labelme to label objects in videos I use for training, but it is quite time consuming. Are there good tools to help with that? I was thinking about a tool where I label ...
user avatar
3 votes
2 answers
510 views

How to correct mislabeled data in dataset?

I have a dataset of about 300k records. Classes are highly imbalanced (which means that one may have 30k records, and the other may have only 100). Unfortunately, about 5% of records is incorrectly ...
severin's user avatar
  • 31