7
$\begingroup$

I'm looking for tools that would help me and my team annotate training sets. I work in an environment with large sets of data, some of which are un- or semi-structured. In many cases there are registration that help in finding a grounded truth. In many cases however a curated set is needed, even if it just were for evaluation. A complicating factor is that some of the data can not leave the premise.

We are looking to annotate an object detection task, but I anticipate an image segmentation task, a text classification task and a sentiment detection task in the near future.

What I'm looking for is a system that can help a group make an annotation, preferably in a way that motivates the annotators by showing group progress, relative individual progress and perhaps personal inter annotator agreement.

$\endgroup$
2
$\begingroup$

You can try Prodigy by explosion.ai, creators of spacy or brat an open source alternative to it. You may also refer to this post on qoura.

$\endgroup$
  • $\begingroup$ Try using EVA annotation tool. github.com/Ericsson/eva ,this has an excellent tracking function. you mark the object in only 1 frame and rest/many of the frames are automatically annotated. This also has lock unlock feature to help annotate faster and more number of objects in each frame. This supports video upload or image data sets. $\endgroup$ – Manish S Oct 22 at 8:30
9
$\begingroup$

Doccano is an open source simpler alternative to Prodigy. Its native python via Django. I found it suitable for simple implementations.

$\endgroup$
1
$\begingroup$

Diffgram can be used for creating and managing training data.

$\endgroup$
1
$\begingroup$

I have been working with the spaCy extenstion on INCEpTION from Technische Universität Darmstadt. Seems pretty good so far.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.