Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [labelling]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
3 votes
1 answer
275 views

Using training data that requires manual interpretation

I have a dataset that comprises several data streams that are measured on objects (>10k objects). The data is essentially time series data (0.5 second intervals). Typically, an expert interpreter ...
user1563247's user avatar
0 votes
0 answers
18 views

How can i retrieve incorrect labelled predictions on new unseen data on image classification when i want to retrain my model later on?

I've recently made a binary image classification model with transfer learning. The model is used on an api and the predictions gets saved into a database. The problem is that it predicts images ...
Enes Aygun's user avatar
1 vote
1 answer
26 views

What are good ways to extend an ML model with a new class without relabeling all previous data?

I have a segmentation model trained using 1,000 images that can predict 4 classes (dog, cat, mouse, elephant). I would now like to extend the model with a 5th class (horse). Horses are present in the ...
nickponline's user avatar
0 votes
0 answers
49 views

Mislabeled problem with hospital data

I am writing this post to ask or see if someone can help me with this problem in case you may have faced a similar situation. My problem has to do with a ML tool that I am trying to develop in a ...
Daniel's user avatar
  • 1
0 votes
1 answer
147 views

How can I labelling a sequence of network traffic to one single classification?

I want to labelling network traffic (several .pcap-files) to different classifications. But this network traffic are not just one entry, there are sequence of entries (~50). So how is it possible, to ...
user155518's user avatar
0 votes
1 answer
297 views

Fine-tuning LLM with limited documents and hierarchy

Hello LLM enthusiasts. I am wondering w.r.t. a neighbouring project if there are state of the art approaches to fine tune a model if: the realm of documents is limited (still more than just a few), ...
MaK's user avatar
  • 1
1 vote
0 answers
36 views

Labelling spectrograms

Currently I'm working on a ML project, just need an information, is there any tool that is present that can load audios file and generates spectrograms as well as an option to annotating/ label the ...
Karthik Sudapelli's user avatar
5 votes
5 answers
1k views

Is using GPT-4 to label data advisable?

If I have a lot of text data that needs to be labeled (e.g. sentiment analysis), and given the high accuracy of GPT-4, could I use it to label data? Or would that introduce bias or some other issues?
cookiecutter's user avatar
1 vote
1 answer
158 views

Labelling large amounts of audio data in automatic or semi-automatic way

I am working on a project, where I have to label the audio datasets which has thousands of data, each audio data is for one second. I have to label where it is in idle or event happening or noise. I ...
saranyaa suresh's user avatar
1 vote
1 answer
53 views

Sub labelling of an object

First timer in image processing - Pardon my cluelessness. Is there a concept of sub labeling in objection identification? I want to label a person and sub label "eye" of a person and train a ...
Jean's user avatar
  • 111
1 vote
0 answers
16 views

How to label legit users when trying developing a bot flagging classification model?

I’m working on a project where I try to flag bots from legit users on social media. The data I collected is not labeled but I have labeled about 17% of it (22k users) thought different techniques. ...
Marc's user avatar
  • 222
2 votes
1 answer
150 views

too much data to label

I'm working on a Data Science project to flag bots on Instagram. I collected a lot of data (+80k users) and now I have to label them as bot/legit users. I already flagged 20k users with different ...
Marc's user avatar
  • 222
2 votes
0 answers
53 views

Labelling a dataset for sentiment analysis, which model is the best?

I want to do some sentiment analysis on a large text dataset I scraped. From what I've learned so far, I know that I need to either manually label each text data (positive, negative, neutral) or use a ...
Dan K's user avatar
  • 21
0 votes
2 answers
1k views

Why label encoding before split is data leakage?

I want to ask why Label Encoding before train test split is considered data leakage? From my point of view, it is not. Because, for example, you encode "good" to 2, "neutral" to 1 ...
Anar's user avatar
  • 73
0 votes
0 answers
110 views

Unsupervised clustering for Text labelling

I have millions semi structured text descriptions of a job requirement. Which needs to be labelled, such as the number of hours, years of experience required, shifts, certifications, licensure etc., ...
Timoth Dev A's user avatar
1 vote
1 answer
65 views

CRFSuite/Wapiti: How to create intermediary data for running a training?

After having asked for and been suggested two pieces of software last week (for training a model to categorize chunks of a string) I'm now struggling to make use of either one of them. It seems that ...
Sixtyfive's user avatar
  • 125
1 vote
1 answer
52 views

Software/Library Suggestion: Is there a usable open-source sequence tagger around?

(Not sure if this is the right community for the question - please do downvote if stats. or whatever else is more appropriate...) I'm looking for a suggestion for ...
Sixtyfive's user avatar
  • 125
0 votes
1 answer
104 views

How should I construct a binary classifier for small set of positive data and million of unlabeled data?

Does anyone have suggestions for specific algorithm or implementation for labeled data of only one class and unlabeled data that can be from either classes? And I'm unsure what is the proportion of ...
Deli's user avatar
  • 1
0 votes
1 answer
36 views

(Labeled, if possible) time-series datasets for anomaly detection [closed]

I would like to create a big list of available time-series datasets for anomaly detection. I'm especially interested in the following: The time-series data should be segmented into cycles Ideally, ...
Guillermo Mosse's user avatar
0 votes
0 answers
32 views

Sampling items from a population of subpopulations

I have a population of $n$ items to label and a budget to label only $m$ ($m << n$) of them before training. The population can be partitioned into subpopulations, recursively. In other words, ...
dzieciou's user avatar
  • 697
1 vote
0 answers
274 views

Best practices to image annotation for object detection when objects overlap

If I have the following example: How should I annotate the bottom image? I can think of those scenarios: Create a large box that captures class B and a second box that captures entirely class A. ...
Emanuel Huber's user avatar
2 votes
1 answer
32 views

Solutions for Labelling Training Data for Binary Classification Problems

I have a huge dataset for which I am trying to use an 80-20 (Holdout method) approach to train and test my model. However, the dataset I have been given has 6m rows. The objective is to train+test+...
ha9u63a7's user avatar
  • 141
1 vote
2 answers
1k views

How do I label images faster

I have around 1600 images extracted from videos shot at night time. I am labeling each image and trying to be as accurate as I can in assigning bounding boxes. I am labeling vehicles and traffic light/...
Vendetta's user avatar
  • 121
2 votes
1 answer
370 views

Online Audio annotation tools

I need to find a decent online annotation tool to transcribe audio. There are some requirements for a potential tool: I should be able to deliver audio files to a few labelers. I should be able to ...
Aidos's user avatar
  • 123
0 votes
1 answer
93 views

Is an image with 5 labels equivalent to 5 images with 1 label?

I am collecting data to train an object detection model using and was wondering if 5 labels in the same image and 5 images with 1 label each provided the same quality of input training data. Example: ...
Joshua Wilkinson's user avatar
1 vote
1 answer
34 views

Label A records B times or label A*B records

This question concerns pre-training data sourcing. Suppose you have a human workforce of B individuals and a potentially unlimited source of data. The task is ...
dasjanik's user avatar
0 votes
0 answers
248 views

How to pass more than 2 input columns to a Deep learning Keras model for sequence tagging/labeling

I have to build a neural network which extract relationship between two entities.Input should be: Input text/paragraph, vocabulary of entities and relationship phrases that system should recognize. ...
P.Sneha's user avatar
2 votes
1 answer
693 views

Python package for machine-learning aided data labelling

In a lot of cases unlabelled data needs to be transformed to labelled data. The best solution is to use (multiple) human classifiers. However, going to all the data by hand (i.e. in text-mining or ...
Pieter's user avatar
  • 961