Questions tagged [labelling]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
33 views

Mislabeled problem with hospital data

I am writing this post to ask or see if someone can help me with this problem in case you may have faced a similar situation. My problem has to do with a ML tool that I am trying to develop in a ...
Daniel's user avatar
  • 1
0 votes
1 answer
131 views

How can I labelling a sequence of network traffic to one single classification?

I want to labelling network traffic (several .pcap-files) to different classifications. But this network traffic are not just one entry, there are sequence of entries (~50). So how is it possible, to ...
user155518's user avatar
0 votes
1 answer
182 views

Fine-tuning LLM with limited documents and hierarchy

Hello LLM enthusiasts. I am wondering w.r.t. a neighbouring project if there are state of the art approaches to fine tune a model if: the realm of documents is limited (still more than just a few), ...
MaK's user avatar
  • 1
1 vote
0 answers
22 views

Labelling spectrograms

Currently I'm working on a ML project, just need an information, is there any tool that is present that can load audios file and generates spectrograms as well as an option to annotating/ label the ...
Karthik Sudapelli's user avatar
5 votes
5 answers
885 views

Is using GPT-4 to label data advisable?

If I have a lot of text data that needs to be labeled (e.g. sentiment analysis), and given the high accuracy of GPT-4, could I use it to label data? Or would that introduce bias or some other issues?
cookiecutter's user avatar
0 votes
0 answers
25 views

How to label a transactions dataset made from scratch?

I have a question regarding creating a transactions dataset from scratch. I've created customer profiles and am generating transactions based on these profiles. The way I do this is based on the ...
pnav32's user avatar
  • 1
0 votes
0 answers
27 views

Labeling tool for ASR to either create audio or transcripts

Is there a labeling tool where I can create audio-transcription-pairs in both directions: record audio for given text create transcriptions for given audio? What I have tried so far: I went through ...
DaveFar's user avatar
  • 101
0 votes
0 answers
20 views

multi label classifictaion - single class or group labels?

I currently working on a vehicle dataset, with the goal of detection and classification vehicle types (car, bus, truck, motorcycle). In addition, for each vehicle, I want to detect and classify each ...
Eviatar Ben-Arush's user avatar
1 vote
1 answer
129 views

Labelling large amounts of audio data in automatic or semi-automatic way

I am working on a project, where I have to label the audio datasets which has thousands of data, each audio data is for one second. I have to label where it is in idle or event happening or noise. I ...
saranyaa suresh's user avatar
1 vote
1 answer
46 views

Sub labelling of an object

First timer in image processing - Pardon my cluelessness. Is there a concept of sub labeling in objection identification? I want to label a person and sub label "eye" of a person and train a ...
Jean's user avatar
  • 111
1 vote
0 answers
13 views

How to label legit users when trying developing a bot flagging classification model?

I’m working on a project where I try to flag bots from legit users on social media. The data I collected is not labeled but I have labeled about 17% of it (22k users) thought different techniques. ...
Marc's user avatar
  • 222
2 votes
1 answer
135 views

too much data to label

I'm working on a Data Science project to flag bots on Instagram. I collected a lot of data (+80k users) and now I have to label them as bot/legit users. I already flagged 20k users with different ...
Marc's user avatar
  • 222
2 votes
0 answers
48 views

Labelling a dataset for sentiment analysis, which model is the best?

I want to do some sentiment analysis on a large text dataset I scraped. From what I've learned so far, I know that I need to either manually label each text data (positive, negative, neutral) or use a ...
Dan K's user avatar
  • 21
0 votes
2 answers
888 views

Why label encoding before split is data leakage?

I want to ask why Label Encoding before train test split is considered data leakage? From my point of view, it is not. Because, for example, you encode "good" to 2, "neutral" to 1 ...
Anar's user avatar
  • 73
0 votes
0 answers
97 views

Unsupervised clustering for Text labelling

I have millions semi structured text descriptions of a job requirement. Which needs to be labelled, such as the number of hours, years of experience required, shifts, certifications, licensure etc., ...
Timoth Dev A's user avatar
1 vote
1 answer
61 views

CRFSuite/Wapiti: How to create intermediary data for running a training?

After having asked for and been suggested two pieces of software last week (for training a model to categorize chunks of a string) I'm now struggling to make use of either one of them. It seems that ...
Sixtyfive's user avatar
  • 125
1 vote
1 answer
48 views

Software/Library Suggestion: Is there a usable open-source sequence tagger around?

(Not sure if this is the right community for the question - please do downvote if stats. or whatever else is more appropriate...) I'm looking for a suggestion for ...
Sixtyfive's user avatar
  • 125
0 votes
1 answer
75 views

How should I construct a binary classifier for small set of positive data and million of unlabeled data?

Does anyone have suggestions for specific algorithm or implementation for labeled data of only one class and unlabeled data that can be from either classes? And I'm unsure what is the proportion of ...
Deli's user avatar
  • 1
0 votes
1 answer
36 views

(Labeled, if possible) time-series datasets for anomaly detection [closed]

I would like to create a big list of available time-series datasets for anomaly detection. I'm especially interested in the following: The time-series data should be segmented into cycles Ideally, ...
Guillermo Mosse's user avatar
0 votes
0 answers
31 views

Sampling items from a population of subpopulations

I have a population of $n$ items to label and a budget to label only $m$ ($m << n$) of them before training. The population can be partitioned into subpopulations, recursively. In other words, ...
dzieciou's user avatar
  • 697
1 vote
0 answers
256 views

Best practices to image annotation for object detection when objects overlap

If I have the following example: How should I annotate the bottom image? I can think of those scenarios: Create a large box that captures class B and a second box that captures entirely class A. ...
Emanuel Huber's user avatar
2 votes
1 answer
27 views

Solutions for Labelling Training Data for Binary Classification Problems

I have a huge dataset for which I am trying to use an 80-20 (Holdout method) approach to train and test my model. However, the dataset I have been given has 6m rows. The objective is to train+test+...
ha9u63a7's user avatar
  • 141
1 vote
2 answers
892 views

How do I label images faster

I have around 1600 images extracted from videos shot at night time. I am labeling each image and trying to be as accurate as I can in assigning bounding boxes. I am labeling vehicles and traffic light/...
Vendetta's user avatar
  • 121
2 votes
1 answer
365 views

Online Audio annotation tools

I need to find a decent online annotation tool to transcribe audio. There are some requirements for a potential tool: I should be able to deliver audio files to a few labelers. I should be able to ...
Aidos's user avatar
  • 123
0 votes
1 answer
88 views

Is an image with 5 labels equivalent to 5 images with 1 label?

I am collecting data to train an object detection model using and was wondering if 5 labels in the same image and 5 images with 1 label each provided the same quality of input training data. Example: ...
Joshua Wilkinson's user avatar
1 vote
1 answer
34 views

Label A records B times or label A*B records

This question concerns pre-training data sourcing. Suppose you have a human workforce of B individuals and a potentially unlimited source of data. The task is ...
dasjanik's user avatar
0 votes
0 answers
234 views

How to pass more than 2 input columns to a Deep learning Keras model for sequence tagging/labeling

I have to build a neural network which extract relationship between two entities.Input should be: Input text/paragraph, vocabulary of entities and relationship phrases that system should recognize. ...
P.Sneha's user avatar
2 votes
1 answer
691 views

Python package for machine-learning aided data labelling

In a lot of cases unlabelled data needs to be transformed to labelled data. The best solution is to use (multiple) human classifiers. However, going to all the data by hand (i.e. in text-mining or ...
Pieter's user avatar
  • 961