Questions tagged [semi-supervised-learning]

Making use of both unsupervised and supervised learning paradigms to train on a partially labelled dataset.

Filter by
Sorted by
Tagged with
0 votes
0 answers
10 views

What kind of learning do I need ? (use-case specific)

Consider a scenario where I have a model trained on gesture videos (say a 3D ResNet). I am looking for a technique (or a combination) that allows me to further train the model every time I have a new ...
batman's user avatar
  • 139
0 votes
0 answers
13 views

Is it acceptable to perform inference on unlabeled data utilized during SSL training

I am facing a classification problem and I have both labeled and unlabeled data. To make use of the unlabeled data, I have chosen to adopt the self-learning approach, which is a type of semi-...
a_long_road_ahead's user avatar
0 votes
0 answers
10 views

How can we integrate zero shot classification with a supervised classifier?

We have two sets of labels that are known and unknown to the supervised classifier (SC). We infer for a test example using the SC and a zero shot classifier (ZC). Let's assume, our inference datapoint ...
user3190883's user avatar
1 vote
1 answer
122 views

Topic classification on text data with no/few labels

I would like to achieve a classification of a text input into predefined categories. From what I have understand unsupervised approach are unfeasible if my target label is something very rare in ...
Andrea's user avatar
  • 45
0 votes
0 answers
31 views

Different ways to implement a semi-supervised Co-Training model?

in a book I have read about Co-training and I have a problem. Suppose there are features along with labels Y and unlabelled data . For simplicity, let's say we train two classifiers on different ...
Waschbrettwade's user avatar
1 vote
0 answers
13 views

Why only discrete labels are used for (semi-)supervised VAEs?

I've noticed all semi-supervised VAEs assume discrete (categorical) labels to encourage disentangled representation learning in VAEs. e.g., Kingma, Durk P., et al. "Semi-supervised learning with ...
MerelyLearning's user avatar
0 votes
1 answer
32 views

Why weak supervision works?

I've learned that weak supervision combines multiple labeling methods to generate labels for a large dataset. I can't understand why generated labels can be used to train a more accurate model than ...
Neo's user avatar
  • 3
1 vote
1 answer
38 views

What are the benefits of combining semi-supervised and supervised learning methods?

I've been looking into semi-supervised learning more, specifically label propagation and label spreading. When reading through tutorials and some papers I've seen it mentioned that often times the ...
lamyvista's user avatar
0 votes
1 answer
24 views

forcasting anomaly in products

I have a question about the forecasting of anomalies. I would be very grateful if you could refer me to some papers that deal with this kind of problem or give me some hints to start with this problem....
Hana's user avatar
  • 101
1 vote
1 answer
23 views

Given a set of options where one option is selected prior to an outcome, how to model optimal selection that will increase likelihood of (+) outcome

Say that we have a set of treatment plans (the options) available to a patient. Treatment plans can be invasive-surgery, no-surgery, less-invasive surgery ext... We have a dataset where a treatment ...
Demetri Smith's user avatar
0 votes
1 answer
688 views

Semi-supervised classification with SelfTrainingClassifier: no training after calling fit()

I am practicing semi-supervised learning, at the moment experimenting with sklearn.semi_supervised.SelfTrainingClassifier. I found a dataset for multiclass ...
lazarea's user avatar
  • 289
1 vote
0 answers
25 views

Semi-supervised learning algorithms for multibox/priorbox detection in images

I've read lots of papers on query strategies like BADGE, SCALAR, BatchBALD etc, but they all seem to be for situations where there is a single label to give an image (is this a cat, dog or horse), but ...
Ken Y-N's user avatar
  • 131
1 vote
1 answer
232 views

What the differences between self-supervised/semi-supervised in NLP?

GPT-1 mentions both Semi-supervised learning and Unsupervised pre-training but it seems like the same to me. Moreoever, "Semi-supervised Sequence Learning" of Dai and Le also more like self-...
Inhyeok Yoo's user avatar
1 vote
0 answers
46 views

Label spreading for classification/clustering problems

I have a question regarding label propagation and label spreading semi-supervised algorithms. I am working on building a look-alike model to identify marketing personas. Using supervised learning ...
Sandhya Indurkar's user avatar
1 vote
1 answer
35 views

Extract key phrases for binary outcome

I have a set of phrases that lead to a binary outcome (accept/reject) and I was wondering what techniques are most helpful for extracting key phrases that are most likely to determine the outcome, ...
z73758437095439's user avatar
1 vote
1 answer
176 views

Pros and Cons of Positive Unlabeled learning?

I've been looking for papers that discuss the pros and cons of positive unlabeled learning but I haven't been able to find anything. I'm looking to compare the general differences between creating a ...
DN1's user avatar
  • 155
2 votes
1 answer
26 views

Solutions for Labelling Training Data for Binary Classification Problems

I have a huge dataset for which I am trying to use an 80-20 (Holdout method) approach to train and test my model. However, the dataset I have been given has 6m rows. The objective is to train+test+...
ha9u63a7's user avatar
  • 141
1 vote
1 answer
39 views

Is it better to have one model with more categories or less with two for multi-label classification?

For classifying text into three classes question, complain and complements where each sample can have multi-labels (question and complains, question and complements): is it better to have one model ...
Nouf 's user avatar
  • 11
3 votes
1 answer
106 views

How to approach semi-supervised binary classification problem with few labels only from one class?

I confront with a binary classification problem where I do have a few instances with labels (so far this is "semi-supervised" learning as far as I know), but only from the positive class. So ...
Fredrik's user avatar
  • 977
1 vote
1 answer
36 views

Identifying templates from SMS text

I am building an app where I identify information from the SMS, something similar to expense management apps. I have a parser which reads all the SMS of user, identifies SMS of interest and parses ...
rubish's user avatar
  • 119
1 vote
0 answers
27 views

How do I build a model to improve CTR on campaign?

I am trying to build a propensity model for a client to increase the CTR. Client has the list of people who clicked in the previous campaigns but doesn't have the data on the list of people who didn't ...
Piyush Makhija's user avatar
1 vote
1 answer
158 views

Semi-supervised anomaly detection

I am currently exploring anomaly detection methods for my work and, basically I have gone through Local Oulier Factor and Isolation Forests, both unsupervised methods. Now, the thing is, there might ...
user avatar
2 votes
1 answer
168 views

What is the difference between all the different types of learning within machine learning?

This is a question that is really hard to google, and the differences are confusing. Does anyone have good examples of the differences between them all? Supervised Learning Semi-Supervised Learning ...
A.White's user avatar
  • 57
1 vote
1 answer
83 views

Validity of PU learning while using character-level encoding using CNNs for classifying text data

I'm trying to classify a large set of documents (~100M) as valid or invalid, based upon a small given set of labeled valid documents (~3k). I'd like to know if the PU learning approach described in ...
Siddhant Kundu's user avatar
2 votes
4 answers
1k views

Supervised clustering

I'm working on a clustering problem. I have a training set composed of sets of points where the clusters are known and I want to find the good clusters on a testing dataset. It's a kind of supervised ...
Rodolphe LAMPE's user avatar
2 votes
0 answers
402 views

Inductive vs Transductive Learning

I am reading about Inductive and Transductive Learning. Some of the questions that come to mind are the following: What is the difference between these two? Which algorithms are usually employed for ...
Outcast's user avatar
  • 1,037
0 votes
0 answers
30 views

using dataset to classifying and labelling another unlabeded dataset

I collect a collection of posts from Facebook and I use a published sentiment datset to labeling my collected dataset. is this a right technique and what its name is this transfer-learning ?
mtesta010's user avatar
0 votes
1 answer
44 views

Is there an algorithm for categorizing unlabeled samples into K classes? [closed]

I am not sure if this would be considered unsupervised, or semi-supervised learning. I am looking for an algorithm that will take N input arrays of features, and then cluster samples(not features) ...
Travis Black's user avatar
0 votes
0 answers
38 views

Ignoring unlabeled data for a single class

I have a data set of transactions with a binary flag labeling each as fraud or not fraud. However, it can take up to 90 days for a transaction to reveal itself as fraudulent. Sometimes it happens in a ...
Stu's user avatar
  • 101
0 votes
3 answers
1k views

What kind of learning is needed for anomaly detection? Supervised learning, semi-supervised learning or unsupervised learning?

I am doing anomaly detection recently, one of the methods is using AEs model to learn the pattern of normal samples. Determine it as an abnormal sample if it doesn’t match the pattern of normal ...
disney82231's user avatar
0 votes
1 answer
273 views

What is the convergence criteria of a semi-supervised learning algorithm?

I would like to know when to stop doing semi supervision? For example, if I learn a classifier from a small dataset and then use it to label a pool of unlabelled dataset. I then use the newly labelled ...
N. F.'s user avatar
  • 131
2 votes
1 answer
46 views

Accuracy after selftraining didn't change

I used Decisiton Tree Classifier which I trained with 50 000 samples. I have also set with unlabeled samples, so I decided to use self training algorithm. Unlabeled set has 10 000 samples. I would ...
SMI9's user avatar
  • 21
1 vote
1 answer
1k views

How to get probability of classification

I have the binary classification, I tried several models KNN, SVM, decision tree, and random forest. I have 50 000 samples, X_train has 50 000 rows and 2300 columns....
Max's user avatar
  • 113
1 vote
0 answers
27 views

General way of constructing adjacency matrix in Laplacian SVM semi-supervised technique

I am trying to implement a Laplacian SVM classifier (trained in primal) using algorithm from this paper. I would like to know what is the most common way of constructing adjacency matrix and the most ...
Nicolas Scotto Di Perto's user avatar
2 votes
0 answers
21 views

Neural Network for detecting/checking for requirements in diagrams

My question is more about what approach is a good/the best approach for my problem: THE PROBLEM - I'm an (mechanical/software) engineer and we take extensive amount of time to review technical ...
amlwwalker's user avatar
1 vote
0 answers
58 views

Improving automated ingestion system using Machine Learning and/or NLP

I'm working on a automated ingestion system which takes a PDF or doc file or a URL. It then parses the file and get me the required text in a json format but there are some error and there are few ...
Khushhal's user avatar
  • 111
0 votes
1 answer
36 views

Adapting Neural Network to new domain without labels

Is there an approach for the following problem: Lets say, I trained a neural network on a big dataset for categorizing different fruits in $k$ classes. Afterwards I got a nice model, which performs ...
Andreas Look's user avatar
1 vote
1 answer
343 views

Semi-supervised learning for regression

It is mentioned on this page that Label Propagation of scikit-learn can be used for regression also. However, nothing is ...
rnso's user avatar
  • 1,558
0 votes
1 answer
435 views

how to build a predictive model without training data neither historical data

I m trying to score "how much a product is expected in the market". I created some features: How much this product is used each year. Where was it used . how many product for each country. the main ...
Lizou's user avatar
  • 215
2 votes
1 answer
566 views

Semi Supervised Learning without label propagation

I am trying to cluster some words by affinity. Using Word2Vec I obtained vector representation of every word that I can cluster with a normal unsupervised method. Of these words, though, I know the ...
Nicolò Gasparini's user avatar
3 votes
2 answers
442 views

Time series binary classificaiton with labelling issues

My situation is quite complicated so I will give a similar example from a simpler domain. Suppose we want to try to predict WHEN a mobile game users will make a purchase if given a sale. Almost every ...
Keith's user avatar
  • 326
0 votes
1 answer
533 views

suggest ingredients based on recipe title [closed]

I would like to construct system that would suggest user ingredients once he/she inputs title of the recipe. I think that this is the task of machine learning or AI, but on the other hand I am pretty ...
Giorgi Jambazishvili's user avatar
1 vote
1 answer
44 views

Problem faced when collect data randomly from cluster [closed]

I have a semi structured data set. I need to collect some data (unlabeled) randomly for labeling. As initiative at first I separated labeled and unlabeled data. Then I convert those data from string ...
IS2057's user avatar
  • 295
-1 votes
1 answer
1k views

How to do semi-supervised learning for regression

I am doing regression analysis on a data set with over 20000 samples using scikit learn. Trying to use regression models to fit three features to label which is a score ranges from 0 to 10. Problem is ...
ddd's user avatar
  • 203
0 votes
1 answer
105 views

Can You Purposely Bias A Clustering Model?

We have a large amount (Billions) of high cardinality, mixed nominal & numerical data, and are performing some clustering on it as an experiment. There is a small subset of these data, however, ...
TheProletariat's user avatar
5 votes
1 answer
12k views

Custom conditional loss function in Keras

I'm looking for a way to create a conditional loss function that looks like this: there is a vector of labels, say l (l has the same length as the input x), then for a given input (y_true, y_pred, l) ...
Tian's user avatar
  • 51
9 votes
4 answers
12k views

Why positive-unlabeled learning?

Machine learning can be divided into several areas: supervised learning, unsupervised learning, semi-supervised learning, learning to rank, recommendation systems, etc, etc. One such area is PU ...
Ricardo Magalhães Cruz's user avatar
1 vote
1 answer
475 views

How should I construct a binary classifier for thousands of positive data and millions of unlabeled data?

So far, I have stumbled upon many advices and papers on PU Learning and Unary classification. TLDR: Does anyone have suggestions for specific algorithm or implementation for labeled data of only one ...
Flair's user avatar
  • 121
3 votes
1 answer
184 views

Probability for label correctness in semi-supervised learning

I am aware of the existence of semi-supervised learning approaches, such as the Ladder Network, where only a subset of the data is labeled. Are there any methods or papers which consider correctness ...
AlexGuevara's user avatar
5 votes
2 answers
705 views

General strategy for imbalanced, semi-supervised, sparse problem

I am looking for some general advice on where to start with this problem. There are 350 sparse (low positive integer) features. I have 2000 positives, 1000 negatives, and infinite unlabeled data, ...
user27436's user avatar