Questions tagged [labelling]
The labelling tag has no usage guidance.
28
questions
0
votes
0
answers
33
views
Mislabeled problem with hospital data
I am writing this post to ask or see if someone can help me with this problem in case you may have faced a similar situation.
My problem has to do with a ML tool that I am trying to develop in a ...
- 1
0
votes
1
answer
131
views
How can I labelling a sequence of network traffic to one single classification?
I want to labelling network traffic (several .pcap-files) to different classifications. But this network traffic are not just one entry, there are sequence of entries (~50).
So how is it possible, to ...
0
votes
1
answer
182
views
Fine-tuning LLM with limited documents and hierarchy
Hello LLM enthusiasts.
I am wondering w.r.t. a neighbouring project if there are state of the art approaches to fine tune a model if:
the realm of documents is limited (still more than just a few),
...
- 1
1
vote
0
answers
22
views
Labelling spectrograms
Currently I'm working on a ML project, just need an information, is there any tool that is present that can load audios file and generates spectrograms as well as an option to annotating/ label the ...
5
votes
5
answers
885
views
Is using GPT-4 to label data advisable?
If I have a lot of text data that needs to be labeled (e.g. sentiment analysis), and given the high accuracy of GPT-4, could I use it to label data? Or would that introduce bias or some other issues?
- 63
0
votes
0
answers
25
views
How to label a transactions dataset made from scratch?
I have a question regarding creating a transactions dataset from scratch.
I've created customer profiles and am generating transactions based on these profiles. The way I do this is based on the ...
- 1
0
votes
0
answers
27
views
Labeling tool for ASR to either create audio or transcripts
Is there a labeling tool where I can create audio-transcription-pairs in both directions:
record audio for given text
create transcriptions for given audio?
What I have tried so far:
I went through ...
- 101
0
votes
0
answers
20
views
multi label classifictaion - single class or group labels?
I currently working on a vehicle dataset, with the goal of detection and classification vehicle types (car, bus, truck, motorcycle).
In addition, for each vehicle, I want to detect and classify each ...
1
vote
1
answer
129
views
Labelling large amounts of audio data in automatic or semi-automatic way
I am working on a project, where I have to label the audio datasets which has thousands of data, each audio data is for one second. I have to label where it is in idle or event happening or noise. I ...
1
vote
1
answer
46
views
Sub labelling of an object
First timer in image processing - Pardon my cluelessness.
Is there a concept of sub labeling in objection identification? I want to label a person and sub label "eye" of a person and train a ...
- 111
1
vote
0
answers
13
views
How to label legit users when trying developing a bot flagging classification model?
I’m working on a project where I try to flag bots from legit users on social media. The data I collected is not labeled but I have labeled about 17% of it (22k users) thought different techniques. ...
- 222
2
votes
1
answer
135
views
too much data to label
I'm working on a Data Science project to flag bots on Instagram. I collected a lot of data (+80k users) and now I have to label them as bot/legit users. I already flagged 20k users with different ...
- 222
2
votes
0
answers
48
views
Labelling a dataset for sentiment analysis, which model is the best?
I want to do some sentiment analysis on a large text dataset I scraped. From what I've learned so far, I know that I need to either manually label each text data (positive, negative, neutral) or use a ...
- 21
0
votes
2
answers
888
views
Why label encoding before split is data leakage?
I want to ask why Label Encoding before train test split is considered data leakage?
From my point of view, it is not. Because, for example, you encode "good" to 2, "neutral" to 1 ...
- 73
0
votes
0
answers
97
views
Unsupervised clustering for Text labelling
I have millions semi structured text descriptions of a job requirement.
Which needs to be labelled, such as the number of hours, years of experience required, shifts, certifications, licensure etc., ...
- 11
1
vote
1
answer
61
views
CRFSuite/Wapiti: How to create intermediary data for running a training?
After having asked for and been suggested two pieces of software last week (for training a model to categorize chunks of a string) I'm now struggling to make use of either one of them.
It seems that ...
- 125
1
vote
1
answer
48
views
Software/Library Suggestion: Is there a usable open-source sequence tagger around?
(Not sure if this is the right community for the question - please do downvote if stats. or whatever else is more appropriate...)
I'm looking for a suggestion for ...
- 125
0
votes
1
answer
75
views
How should I construct a binary classifier for small set of positive data and million of unlabeled data?
Does anyone have suggestions for specific algorithm or implementation for labeled data of only one class and unlabeled data that can be from either classes? And I'm unsure what is the proportion of ...
- 1
0
votes
1
answer
36
views
(Labeled, if possible) time-series datasets for anomaly detection [closed]
I would like to create a big list of available time-series datasets for anomaly detection. I'm especially interested in the following:
The time-series data should be segmented into cycles
Ideally, ...
- 335
0
votes
0
answers
31
views
Sampling items from a population of subpopulations
I have a population of $n$ items to label and a budget to label only $m$ ($m << n$) of them before training. The population can be partitioned into subpopulations, recursively. In other words, ...
- 697
1
vote
0
answers
256
views
Best practices to image annotation for object detection when objects overlap
If I have the following example:
How should I annotate the bottom image? I can think of those scenarios:
Create a large box that captures class B and a second box that captures entirely class A. ...
2
votes
1
answer
27
views
Solutions for Labelling Training Data for Binary Classification Problems
I have a huge dataset for which I am trying to use an 80-20 (Holdout method) approach to train and test my model. However, the dataset I have been given has 6m rows. The objective is to train+test+...
- 141
1
vote
2
answers
892
views
How do I label images faster
I have around 1600 images extracted from videos shot at night time. I am labeling each image and trying to be as accurate as I can in assigning bounding boxes. I am labeling vehicles and traffic light/...
- 121
2
votes
1
answer
365
views
Online Audio annotation tools
I need to find a decent online annotation tool to transcribe audio.
There are some requirements for a potential tool:
I should be able to deliver audio files to a few labelers. I should
be able to ...
- 123
0
votes
1
answer
88
views
Is an image with 5 labels equivalent to 5 images with 1 label?
I am collecting data to train an object detection model using and was wondering if 5 labels in the same image and 5 images with 1 label each provided the same quality of input training data. Example: ...
1
vote
1
answer
34
views
Label A records B times or label A*B records
This question concerns pre-training data sourcing.
Suppose you have a human workforce of B individuals and a potentially unlimited source of data.
The task is ...
- 11
0
votes
0
answers
234
views
How to pass more than 2 input columns to a Deep learning Keras model for sequence tagging/labeling
I have to build a neural network which extract relationship between two entities.Input should be:
Input text/paragraph, vocabulary of entities and relationship phrases that system should recognize.
...
- 1
2
votes
1
answer
691
views
Python package for machine-learning aided data labelling
In a lot of cases unlabelled data needs to be transformed to labelled data. The best solution is to use (multiple) human classifiers. However, going to all the data by hand (i.e. in text-mining or ...
- 961