10
$\begingroup$

I'm looking for tools that would help me and my team annotate training sets. I work in an environment with large sets of data, some of which are un- or semi-structured. In many cases there are registration that help in finding a grounded truth. In many cases however a curated set is needed, even if it just were for evaluation. A complicating factor is that some of the data can not leave the premise.

We are looking to annotate an object detection task, but I anticipate an image segmentation task, a text classification task and a sentiment detection task in the near future.

What I'm looking for is a system that can help a group make an annotation, preferably in a way that motivates the annotators by showing group progress, relative individual progress and perhaps personal inter annotator agreement.

$\endgroup$
  • 1
    $\begingroup$ Annotation tools are often task-dependent. $\endgroup$ – Franck Dernoncourt Mar 6 at 20:56
2
$\begingroup$

You can try Prodigy by explosion.ai, creators of spacy or brat an open source alternative to it. You may also refer to this post on qoura.

| improve this answer | |
$\endgroup$
  • 1
    $\begingroup$ Try using EVA annotation tool. github.com/Ericsson/eva ,this has an excellent tracking function. you mark the object in only 1 frame and rest/many of the frames are automatically annotated. This also has lock unlock feature to help annotate faster and more number of objects in each frame. This supports video upload or image data sets. $\endgroup$ – Manish S Oct 22 '19 at 8:30
9
$\begingroup$

Doccano is an open source simpler alternative to Prodigy. Its native python via Django. I found it suitable for simple implementations.

| improve this answer | |
$\endgroup$
1
$\begingroup$

Diffgram can be used for creating and managing training data.

| improve this answer | |
$\endgroup$
1
$\begingroup$

I have been working with the spaCy extenstion on INCEpTION from Technische Universität Darmstadt. Seems pretty good so far.

| improve this answer | |
$\endgroup$
0
$\begingroup$

I have just created a python library (GitHub --Blog post) to quickly create training data for spaCy NER models using ipywidgets.

Demo

$\endgroup$
0
$\begingroup$

You could try UBIAI Annotation tool, it is pretty easy to use, has multiple annotation exports and is currently free.

| improve this answer | |
$\endgroup$
0
$\begingroup$

Label Studio is a powerful opensource with a web interface to annotate different data types. It can be audio, text, image, video, time series sources and mixes of them. The conditional and nested annotations are supported too. You write your own labeling config fitting your needs to configure the system.

Check it here: https://labelstud.io/playground

Annotation tool Label Studio

| improve this answer | |
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.