Questions tagged [semi-supervised-learning]
Making use of both unsupervised and supervised learning paradigms to train on a partially labelled dataset.
53
questions
0
votes
0
answers
10
views
What kind of learning do I need ? (use-case specific)
Consider a scenario where I have a model trained on gesture videos (say a 3D ResNet). I am looking for a technique (or a combination) that allows me to further train the model every time I have a new ...
- 139
0
votes
0
answers
13
views
Is it acceptable to perform inference on unlabeled data utilized during SSL training
I am facing a classification problem and I have both labeled and unlabeled data. To make use of the unlabeled data, I have chosen to adopt the self-learning approach, which is a type of semi-...
0
votes
0
answers
10
views
How can we integrate zero shot classification with a supervised classifier?
We have two sets of labels that are known and unknown to the supervised classifier (SC).
We infer for a test example using the SC and a zero shot classifier (ZC).
Let's assume, our inference datapoint ...
1
vote
1
answer
122
views
Topic classification on text data with no/few labels
I would like to achieve a classification of a text input into predefined categories.
From what I have understand unsupervised approach are unfeasible if my target label is something very rare in ...
- 45
0
votes
0
answers
31
views
Different ways to implement a semi-supervised Co-Training model?
in a book I have read about Co-training and I have a problem. Suppose there are features along with labels Y and unlabelled data . For simplicity, let's say we train two classifiers on different ...
1
vote
0
answers
13
views
Why only discrete labels are used for (semi-)supervised VAEs?
I've noticed all semi-supervised VAEs assume discrete (categorical) labels to encourage disentangled representation learning in VAEs.
e.g.,
Kingma, Durk P., et al. "Semi-supervised learning with ...
0
votes
1
answer
32
views
Why weak supervision works?
I've learned that weak supervision combines multiple labeling methods to generate labels for a large dataset. I can't understand why generated labels can be used to train a more accurate model than ...
- 3
1
vote
1
answer
38
views
What are the benefits of combining semi-supervised and supervised learning methods?
I've been looking into semi-supervised learning more, specifically label propagation and label spreading. When reading through tutorials and some papers I've seen it mentioned that often times the ...
- 51
0
votes
1
answer
24
views
forcasting anomaly in products
I have a question about the forecasting of anomalies. I would be very grateful if you could refer me to some papers that deal with this kind of problem or give me some hints to start with this problem....
- 101
1
vote
1
answer
23
views
Given a set of options where one option is selected prior to an outcome, how to model optimal selection that will increase likelihood of (+) outcome
Say that we have a set of treatment plans (the options) available to a patient. Treatment plans can be invasive-surgery, no-surgery, less-invasive surgery ext...
We have a dataset where a treatment ...
0
votes
1
answer
688
views
Semi-supervised classification with SelfTrainingClassifier: no training after calling fit()
I am practicing semi-supervised learning, at the moment experimenting with sklearn.semi_supervised.SelfTrainingClassifier. I found a dataset for multiclass ...
- 289
1
vote
0
answers
25
views
Semi-supervised learning algorithms for multibox/priorbox detection in images
I've read lots of papers on query strategies like BADGE, SCALAR, BatchBALD etc, but they all seem to be for situations where there is a single label to give an image (is this a cat, dog or horse), but ...
- 131
1
vote
1
answer
232
views
What the differences between self-supervised/semi-supervised in NLP?
GPT-1 mentions both Semi-supervised learning and Unsupervised pre-training but it seems like the same to me. Moreoever, "Semi-supervised Sequence Learning" of Dai and Le also more like self-...
- 33
1
vote
0
answers
46
views
Label spreading for classification/clustering problems
I have a question regarding label propagation and label spreading semi-supervised algorithms. I am working on building a look-alike model to identify marketing personas. Using supervised learning ...
- 113
1
vote
1
answer
35
views
Extract key phrases for binary outcome
I have a set of phrases that lead to a binary outcome (accept/reject) and I was wondering what techniques are most helpful for extracting key phrases that are most likely to determine the outcome, ...
1
vote
1
answer
176
views
Pros and Cons of Positive Unlabeled learning?
I've been looking for papers that discuss the pros and cons of positive unlabeled learning but I haven't been able to find anything.
I'm looking to compare the general differences between creating a ...
- 155
2
votes
1
answer
26
views
Solutions for Labelling Training Data for Binary Classification Problems
I have a huge dataset for which I am trying to use an 80-20 (Holdout method) approach to train and test my model. However, the dataset I have been given has 6m rows. The objective is to train+test+...
- 141
1
vote
1
answer
39
views
Is it better to have one model with more categories or less with two for multi-label classification?
For classifying text into three classes question, complain and complements
where each sample can have multi-labels (question and complains, question and complements):
is it better to have one model ...
- 11
3
votes
1
answer
106
views
How to approach semi-supervised binary classification problem with few labels only from one class?
I confront with a binary classification problem where I do have a few instances with labels (so far this is "semi-supervised" learning as far as I know), but only from the positive class. So ...
- 977
1
vote
1
answer
36
views
Identifying templates from SMS text
I am building an app where I identify information from the SMS, something similar to expense management apps. I have a parser which reads all the SMS of user, identifies SMS of interest and parses ...
- 119
1
vote
0
answers
27
views
How do I build a model to improve CTR on campaign?
I am trying to build a propensity model for a client to increase the CTR.
Client has the list of people who clicked in the previous campaigns but doesn't have the data on the list of people who didn't ...
- 111
1
vote
1
answer
158
views
Semi-supervised anomaly detection
I am currently exploring anomaly detection methods for my work and, basically I have gone through Local Oulier Factor and Isolation Forests, both unsupervised methods.
Now, the thing is, there might ...
user98969
2
votes
1
answer
168
views
What is the difference between all the different types of learning within machine learning?
This is a question that is really hard to google, and the differences are confusing. Does anyone have good examples of the differences between them all?
Supervised Learning
Semi-Supervised Learning
...
- 57
1
vote
1
answer
83
views
Validity of PU learning while using character-level encoding using CNNs for classifying text data
I'm trying to classify a large set of documents (~100M) as valid or invalid, based upon a small given set of labeled valid documents (~3k). I'd like to know if the PU learning approach described in ...
2
votes
4
answers
1k
views
Supervised clustering
I'm working on a clustering problem. I have a training set composed of sets of points where the clusters are known and I want to find the good clusters on a testing dataset.
It's a kind of supervised ...
- 121
2
votes
0
answers
402
views
Inductive vs Transductive Learning
I am reading about Inductive and Transductive Learning.
Some of the questions that come to mind are the following:
What is the difference between these two?
Which algorithms are usually employed for ...
- 1,037
0
votes
0
answers
30
views
using dataset to classifying and labelling another unlabeded dataset
I collect a collection of posts from Facebook and I use a published sentiment datset to labeling my collected dataset.
is this a right technique and what its name is this transfer-learning ?
- 33
0
votes
1
answer
44
views
Is there an algorithm for categorizing unlabeled samples into K classes? [closed]
I am not sure if this would be considered unsupervised, or semi-supervised learning. I am looking for an algorithm that will take N input arrays of features, and then cluster samples(not features) ...
- 111
0
votes
0
answers
38
views
Ignoring unlabeled data for a single class
I have a data set of transactions with a binary flag labeling each as fraud or not fraud. However, it can take up to 90 days for a transaction to reveal itself as fraudulent. Sometimes it happens in a ...
- 101
0
votes
3
answers
1k
views
What kind of learning is needed for anomaly detection? Supervised learning, semi-supervised learning or unsupervised learning?
I am doing anomaly detection recently, one of the methods is using AEs model to learn the pattern of normal samples.
Determine it as an abnormal sample if it doesn’t match the pattern of normal ...
- 97
0
votes
1
answer
273
views
What is the convergence criteria of a semi-supervised learning algorithm?
I would like to know when to stop doing semi supervision? For example, if I learn a classifier from a small dataset and then use it to label a pool of unlabelled dataset. I then use the newly labelled ...
- 131
2
votes
1
answer
46
views
Accuracy after selftraining didn't change
I used Decisiton Tree Classifier which I trained with 50 000 samples. I have also set with unlabeled samples, so I decided to use self training algorithm. Unlabeled set has 10 000 samples. I would ...
- 21
1
vote
1
answer
1k
views
How to get probability of classification
I have the binary classification, I tried several models KNN, SVM, decision tree, and random forest. I have 50 000 samples, X_train has 50 000 rows and 2300 columns....
- 113
1
vote
0
answers
27
views
General way of constructing adjacency matrix in Laplacian SVM semi-supervised technique
I am trying to implement a Laplacian SVM classifier (trained in primal) using algorithm from this paper.
I would like to know what is the most common way of constructing adjacency matrix and the most ...
2
votes
0
answers
21
views
Neural Network for detecting/checking for requirements in diagrams
My question is more about what approach is a good/the best approach for my problem:
THE PROBLEM -
I'm an (mechanical/software) engineer and we take extensive amount of time to review technical ...
- 121
1
vote
0
answers
58
views
Improving automated ingestion system using Machine Learning and/or NLP
I'm working on a automated ingestion system which takes a PDF or doc file or a URL. It then parses the file and get me the required text in a json format but there are some error and there are few ...
- 111
0
votes
1
answer
36
views
Adapting Neural Network to new domain without labels
Is there an approach for the following problem:
Lets say, I trained a neural network on a big dataset for categorizing different fruits in $k$ classes. Afterwards I got a nice model, which performs ...
- 921
1
vote
1
answer
343
views
Semi-supervised learning for regression
It is mentioned on this page that Label Propagation of scikit-learn can be used for regression also. However, nothing is ...
- 1,558
0
votes
1
answer
435
views
how to build a predictive model without training data neither historical data
I m trying to score "how much a product is expected in the market". I created some features:
How much this product is used each year.
Where was it used .
how many product for each country.
the main ...
- 215
2
votes
1
answer
566
views
Semi Supervised Learning without label propagation
I am trying to cluster some words by affinity.
Using Word2Vec I obtained vector representation of every word that I can cluster with a normal unsupervised method.
Of these words, though, I know the ...
- 205
3
votes
2
answers
442
views
Time series binary classificaiton with labelling issues
My situation is quite complicated so I will give a similar example from a simpler domain. Suppose we want to try to predict WHEN a mobile game users will make a purchase if given a sale. Almost every ...
- 326
0
votes
1
answer
533
views
suggest ingredients based on recipe title [closed]
I would like to construct system that would suggest user ingredients once he/she inputs title of the recipe.
I think that this is the task of machine learning or AI, but on the other hand I am pretty ...
1
vote
1
answer
44
views
Problem faced when collect data randomly from cluster [closed]
I have a semi structured data set. I need to collect some data (unlabeled) randomly for labeling.
As initiative at first I separated labeled and unlabeled data. Then I convert those data from string ...
- 295
-1
votes
1
answer
1k
views
How to do semi-supervised learning for regression
I am doing regression analysis on a data set with over 20000 samples using scikit learn. Trying to use regression models to fit three features to label which is a score ranges from 0 to 10. Problem is ...
- 203
0
votes
1
answer
105
views
Can You Purposely Bias A Clustering Model?
We have a large amount (Billions) of high cardinality, mixed nominal & numerical data, and are performing some clustering on it as an experiment. There is a small subset of these data, however, ...
- 151
5
votes
1
answer
12k
views
Custom conditional loss function in Keras
I'm looking for a way to create a conditional loss function that looks like this: there is a vector of labels, say l (l has the same length as the input x), then for a given input (y_true, y_pred, l) ...
- 51
9
votes
4
answers
12k
views
Why positive-unlabeled learning?
Machine learning can be divided into several areas: supervised learning, unsupervised learning, semi-supervised learning, learning to rank, recommendation systems, etc, etc.
One such area is PU ...
- 3,390
1
vote
1
answer
475
views
How should I construct a binary classifier for thousands of positive data and millions of unlabeled data?
So far, I have stumbled upon many advices and papers on PU Learning and Unary classification.
TLDR: Does anyone have suggestions for specific algorithm or implementation for labeled data of only one ...
- 121
3
votes
1
answer
184
views
Probability for label correctness in semi-supervised learning
I am aware of the existence of semi-supervised learning approaches, such as the Ladder Network, where only a subset of the data is labeled. Are there any methods or papers which consider correctness ...
- 149
5
votes
2
answers
705
views
General strategy for imbalanced, semi-supervised, sparse problem
I am looking for some general advice on where to start with this problem. There are 350 sparse (low positive integer) features. I have 2000 positives, 1000 negatives, and infinite unlabeled data, ...
- 51