Questions tagged [active-learning]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
53 views

How to do Data acquistion focused on improving accuracy on hold-out test set?

I have the task of coming up with a model of 95% accuracy for a classification problem. I have training data and a hold-out data set. I have the opportunity to request data of a particular class with ...
0
votes
0answers
21 views

Difference between Active learning and Optimal experimental design?

During my research in the active learning field, I found a similar concept that has the same idea that is the optimal experimental design (OED) for machine learning which is based on finding new data ...
1
vote
1answer
22 views

How continuous learning differs from active learning?

I have known Active Learning for a while and I am wondering what is the difference between the well known AL, and Continuous Learning? Is this a new buzzword for the old approach or is there anything ...
0
votes
0answers
7 views

When should we apply active learning in testing?

Case 1: I would apply active learning to query a small chunk of samples gradually to label them and my model is being trained during this process. After a certain number of iterations, I have a ...
1
vote
1answer
19 views

object detection model with few shot and active learning

This video https://youtu.be/60Sk-mq3Cr8, from 0 to 2:00 minutes, mentioned an object detection model that can train on 10 samples and improved over time, what kinds of the latest model out there that ...
4
votes
2answers
226 views

Overfitting in active learning

How can I make sure that the initial model trained on a small dataset will not suffer from overfitting before applying the active learning sampling techniques? because I will use this model to select ...
1
vote
1answer
68 views

How to construct a test set for an active learning project?

With active learning I hope to keep the annotation effort to a minimum, yet building still a good classifier. My initial starting point is that I have about 20k images which can belong to ten ...
1
vote
0answers
11 views

Self-attention model trained with active learning stops learning after a few iterations

I'm doing some active learning with uncertainty sampling on a self-attention model implemented in PyTorch. The algorithm works as follows (steps 3-7 are repeated for 14 iterations): ...
1
vote
0answers
25 views

Active learning with mixture model cluster assignments - am I injecting bias here?

Suppose I have a dataset of people's phone numbers and heights, and I'm interested in learning the parameters $p_{girl}$, $p_{boy}=1-p_{girl}$, $\mu_{boy}$, $\mu_{girl}$, and overall $\sigma$ ...
0
votes
0answers
17 views

Active learning with Fisher information matrix for regression with vector output

I am trying to enhance the learning capabilities of my regression task with the help of active learning. I decided to use variance reduction using the Fisher information matrix as a query strategy as ...
1
vote
1answer
41 views

Identify outliers for annotation in text data

I read the book "Human-in-the-Loop Machine Learning" by Robert (Munro) Monarch about Active Learning. I don't understand the following approach to get a diverse set of items for humans to ...
11
votes
2answers
4k views

What is the difference between active learning and reinforcement learning?

From Wikipedia: Active learning is a special case of machine learning in which a learning algorithm can interactively query a user (or some other information source) to label new data points with the ...
3
votes
1answer
52 views

Is active learning able to detect challenging cases?

Let's say we have a set of data points that need to be labelled for a classification task. In the pool-based active learning, if we go with the uncertainty measure, is the AL approach able to detect ...
1
vote
1answer
21 views

Model selection in active learning

I am dabbling in active learning and was wondering how to combine this in seeking out the best architecture for the network. In my understanding, active learning uses a heuristic for selecting the ...
1
vote
2answers
192 views

BIO tagging software

I would like to label character data with BIO tags as part of an active learning process on unlabelled data. I am assuming there are open source GUI tools available which I can use to make this easier ...
2
votes
0answers
40 views

What is the correct way to use Active Learning on a huge and unbalanced text dataset? [closed]

I am working on a huge and unlabeled text dataset. It has over 30M lines (= sentences). We are trying to detect illegal sentences by analyzing 20 different legal issues (e.g. racism, insults, etc.). ...
1
vote
1answer
38 views

Recommendation system with active learning

I have data where companies ask users to score a bunch of questions but some items may be randomly chosen while others are personalized. Users score higher in personalized questions on average. I have ...
0
votes
1answer
32 views

Active learning on image classification model

Say we have a trained image classification model. Theoretically, is it possible to update the model with only a sample without retraining? If not, is there any kinds of active image classification DL ...
3
votes
0answers
27 views

Gaussian process regressor returns almost identical std for all datapoints

I am using a Gaussian process regressor as the regressor for active learning and I use its standard deviation to choose the next training inctance (the one with the highest std is chosen). However, ...
4
votes
1answer
620 views

What is the difference between continual learning and active learning?

As per my understanding, active learning is a kind of continual learning. Is there any difference between them?
1
vote
2answers
37 views

Batch-mode active learning: How to select the batch that will bring the largest model improvement

I am facing a problem where I want to use active learning to improve my classifier. Basically, I can choose data from one (and only one) data set among a set of candidate data sets. The question is ...
0
votes
1answer
210 views

What is the convergence criteria of a semi-supervised learning algorithm?

I would like to know when to stop doing semi supervision? For example, if I learn a classifier from a small dataset and then use it to label a pool of unlabelled dataset. I then use the newly labelled ...
1
vote
1answer
112 views

Is this approach for Active Learning correct?

Let's say that we have 10,000 unlabeled documents, and we want to use pool-based sampling with batch size of 5. And we will use least confidence (LC) for querying strategy. Is this outline of active ...
1
vote
0answers
44 views

Commercial Software for Interactive Machine Learning and Annotation in NLP

We are evaluating make or buy for a tool for interactive machine learning on legal text. With little labeling effort, it should enable for (ml layman) domain experts to build classifiers on a GUI. ...
-2
votes
1answer
146 views

Help Interpreting a Active Learning Learning Curve

I am applying a active learning with a SGDClassifier (log loss function) as the base learner on some data and I have the following graphs representing the learning curve of queries vs error rate. The ...
2
votes
1answer
625 views

Python package for machine-learning aided data labelling

In a lot of cases unlabelled data needs to be transformed to labelled data. The best solution is to use (multiple) human classifiers. However, going to all the data by hand (i.e. in text-mining or ...
2
votes
1answer
218 views

Generic strategy for object detection

I have a huge collection of objects from which only a tiny fraction are in a class of interest. The collection is initially unlabelled, but labels can be added using an expensive operation (for ...