Questions tagged [annotation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
6 views

Organizing datasets, dataset version control, MLOps and other questions

I am currently looking into structuring data and work flows for my ML end to end pipeline. I therefore have multiple problems, and ideally I am looking for one platform that can do all: Visualize and ...
user avatar
  • 1
0 votes
1 answer
25 views

How to annotate complete images?

I am currently playing around with tensorflows object detection to learn the basics. Now I've set myself the goal to detect letters in computer written text. For example the header of a newspaper ...
user avatar
1 vote
0 answers
18 views

Merging models: using a named entity recognition model to annotate data on a different dataset [closed]

Lets say we have two trained models Ma and Mb which were trained with different datasets in a Named Entity Recognition task. Those datasets A and B contain different document and also variables or ...
user avatar
  • 111
1 vote
1 answer
86 views

Annotating NER dataset

I am working on annotating a dataset for the purpose of named entity recognition. In principle, I have seen that for multi-phrase (not single word) elements, annotations work like this (see this ...
user avatar
4 votes
2 answers
335 views

Inter-Annotator Agreement score for NLP?

I have several annotators who annotated strings of text for me, in order to train an NER model. The annotation is done in json format, and it consists of a string followed by the start and end index ...
user avatar
  • 61
2 votes
1 answer
26 views

Manual Data Cleanup Tools

I am writing an ETL pipeline for geospatial data of the form place_name,address,longitude,latitude,id_linking_to_other_dataset As the last step in the pipeline, I ...
user avatar
  • 21
2 votes
1 answer
41 views

How would you build a big production ready image training dataset from scratch?

How would you most likely create a large production ready image training dataset from scratch including annotations for a image classification task? We will take a large amount of images (~1 million) ...
user avatar
  • 21
1 vote
1 answer
58 views

Identify outliers for annotation in text data

I read the book "Human-in-the-Loop Machine Learning" by Robert (Munro) Monarch about Active Learning. I don't understand the following approach to get a diverse set of items for humans to ...
user avatar
1 vote
1 answer
79 views

For obejct detection, should I resize my custom images first and then start the annotation or it won't matter?

I have my custom dataset images of size (1080 x 1920) and I am trying to use yolov3 for object detection. I noticed that yolov3 model accepts an input image size of 416 x 416. So I am in confusion if ...
user avatar
3 votes
1 answer
186 views

Tool for annotation of images for semantic segmentation

I have been searching around for a software tool, that I can use for annotating images. More specifically I want to do annotation to be used for semantic segmentation, meaning I want to create masks. ...
user avatar
  • 31
2 votes
1 answer
294 views

Online Audio annotation tools

I need to find a decent online annotation tool to transcribe audio. There are some requirements for a potential tool: I should be able to deliver audio files to a few labelers. I should be able to ...
user avatar
  • 123
2 votes
1 answer
265 views

Are there any open-source text annotation for multi label classification tools?

I have a large texts in each document and I want to know if there are any open source text annotation tools available online for multiple label annotation. Each sentence takes two labels. If there ...
user avatar
  • 327
2 votes
2 answers
379 views

How should labeled data from multiple annotators be prepared for ML text classification?

My specific question is how NLP data from multiple human annotators should be aggregated - though general advice related to the question title is appreciated. One critical step that I've seen in ...
user avatar
0 votes
1 answer
50 views

Semantic Annotation in text with curlie.org

I came across curlie.org (previously known as the dmoz taxonomy) and I'm interested to see how I could best start tagging a given text, with concepts from that taxonomy: Are there any tools out there ...
user avatar
  • 103
1 vote
0 answers
12 views

Corpus suggestion for financial domain [closed]

I am looking for a financial corpus or any form of publicly available financial texts which is replete with technical terms and acronyms. Any suggestion is appreciated.
user avatar
1 vote
0 answers
167 views

Image masking tool to implement mask RCNN using python

I am trying to understand Mask RCNN. For that I have to input image with mask in png format while building the model. I try to follow the article present in this blog. The blogger used Pixel ...
user avatar
4 votes
1 answer
182 views

How to deal with annotation errors?

I know my annotators are not perfect, sometimes making mistakes. What would be the best way to deal with the annotation errors for my training data?
user avatar
  • 2,475
0 votes
1 answer
17 views

Best practice on count of manual annotations for building criminal detection from news articles?

We have 7 million news articles corpus, which we want to classify into crimes or non-crimes and further identify criminals by using NERs/annotating criminals, crime manually. For creating a model that ...
user avatar
0 votes
0 answers
25 views

Create labels or annotation from two color images

I have two categories of images to use in my deep learning model. The firs category is aerial images that contain roads (such as road-1.jpg). The second category is two color images that contains road ...
user avatar
  • 1
1 vote
1 answer
348 views

How to train a neural network for high recall?

I would like to train a neural network for named entity recognition to tag an unlabeled dataset of texts. The generated labels will then be checked via a crowdsourcing platform. The goal is to ...
user avatar
1 vote
0 answers
31 views

App or Service to QA 80,000 classified images?

I've been reviewing services and apps for the past week and my head is exploding. I just haven't found the right one yet, but I know it has to be out there, so I'm turning to the collective wisdom ...
user avatar
2 votes
1 answer
422 views

Using doccano for Aspect Based Sentiment Analysis annotation

Currently looking for a good tool to annotate sentences regarding aspects and their respective sentiment polarities. I'm using SemEval Task 4 as a reference. The following is an example in the ...
user avatar
  • 133
1 vote
0 answers
1k views

How to map RGB image segmentation ground truth to classes/one-hot vectors in TensorFlow?

Is there a TensorFlow function which takes multicategorical ground truth for semantic image segmentations in the form of RGB images and outputs a tensor with a one-hot vector encoding of the ...
user avatar
  • 173
1 vote
1 answer
126 views

Annotation tool for classification experiments

What tools are available that provide an interface to present text classification results? I need to keep and compare the results of different classification algorithms for unsupervised data. The tool ...
user avatar
1 vote
1 answer
283 views

What are the best tools for manually annotating textual topic segmentation?

I checked this old question on tools for text corpus annotation and there are many good tools there, however the tools there seem not to cover my problem. I have a linear text segmentation problem, ...
user avatar
  • 111
12 votes
6 answers
11k views

What are helpful annotation tools (if any)

I'm looking for tools that would help me and my team annotate training sets. I work in an environment with large sets of data, some of which are un- or semi-structured. In many cases there are ...