Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [supervised-learning]

Supervised learning is a type of machine learning algorithm that learns a mapping function y = f(x) between input variables (x) and output variables (y). The two most common supervised learning tasks are classification and regression.

0
votes
0answers
7 views

Which approach/algorithm for supervised topic modeling of a large corpus of short online comments?

I have a corpus of about 1M documents (short comments from a crowdsourcing website); about 5k documents have been manually labeled, each with one of ~20 topics (training data). What topic modeling ...
0
votes
0answers
14 views

Learn a boolean function

My ploblem is as follows: I have a pool of 32-bit physical addresses. Each address maps to a bank in the DRAM (16 bank in total). I can detect subsets of addresses mapping to the same bank. For ...
0
votes
0answers
25 views

How should we classify alphanumeric data using supervised machine learning algorithms such as K-neighbors classifier?

My training data set consists of numbers like Q519596, U4414E, EMI3776438, E80700104. I specifically included these 4 numbers from 4 different classes to give the best idea of what you can expect ...
1
vote
1answer
21 views

Strategies for continuously assessing and improving model performance

I am building a supervised machine learning model to generate forecast. So I would have historic data like this: SKU, Month, .... other features, Actual Volume ...
0
votes
1answer
27 views

Performance of model in production varying greatly from train-test data

I was wondering if anyone has any advice on where to start digging for this problem. I have a model which has gone through development and all train/cv/test data sets now perform above 95% both for ...
0
votes
0answers
7 views

Adaptive Machine Learning in Python

I would like to build a real time adaptive learning algorithm in Python consuming a data stream. What are some Python libraries that include adaptive machine learning algorithms ? As an example, ...
2
votes
0answers
7 views

Neural Network for detecting/checking for requirements in diagrams

My question is more about what approach is a good/the best approach for my problem: THE PROBLEM - I'm an (mechanical/software) engineer and we take extensive amount of time to review technical ...
1
vote
0answers
32 views

Improving automated ingestion system using Machine Learning and/or NLP

I'm working on a automated ingestion system which takes a PDF or doc file or a URL. It then parses the file and get me the required text in a json format but there are some error and there are few ...
0
votes
0answers
13 views

Supervised Text Classification (proportions)

Is there any other algorithm (package for R) than the tool kit ReadMe (Hopkins/King) which can give out estimated proportions of categories? The ReadMe software package for R takes as input a set ...
1
vote
0answers
38 views

What are Supply Chain Management Problem?

Recently when going to data science hackathons, I have found that people mostly ask problem regarding Supply Chain Management problem. Can anybody explain to me what are these problem and how do I ...
1
vote
1answer
42 views

Why am I getting crossvalidation scores of 0 only

I am trying Catboost package with iris dataset with following code: ...
0
votes
0answers
24 views

Applying Label From Supervised Learning to Unlabeled Data- Text Classification

I am wondering if anyone has code to following: 1) Apply labels from a previous text classification dataset like this type of data (https://colab.research.google.com/drive/...
0
votes
0answers
8 views

Supervised training based Tagging/Labelling for entities

Let’s say I have training data tagged/labelled like this: ...
-1
votes
0answers
18 views

Is it better to cluster an image based on a feature vector or logits?

My end goal is to use supervised machine learning to find visually similar images, trained on a data set that I curated. I followed the guide here: https://www.tensorflow.org/hub/tutorials/...
-1
votes
0answers
8 views

working on different size of images for CAD system

Is it possible to work on image dataset of different sizes for CAD system using supervised learning modules, i.e., I have a dataset of brain tumour images with a different size of tumours, they are ...
0
votes
1answer
17 views

Supervised learning for timeseries classification problem

I'm trying to use a supervised classification algorithm on a timeseries problem and my model is performing to well i think. It's a time to failure problem. I have 1000 sensors and have to predict if ...
0
votes
0answers
21 views

support vector machine under noisy labels

I am relatively new to machine learning and had just read the SVM chapter in the introduction to statistical learning book. I am interested in applying SVM to my data. In theory, my data is perfectly ...
1
vote
1answer
66 views

How to visualize image segmentation results

I am using u-net to do semantic segmentation for N>1 classes. The input size is (128,128,3), the output size will be (128,128,N). what is the correct way see the prediction as an image ot size n1 x n2 ...
0
votes
0answers
14 views

Dataset for ML project: Application of Machine Learning to improve breast cancer treatment

My issue in relation to finding the right dataset for my current project. I visited the cancer imaging website to find some data for investigating my hypothesis [which is " denser breast tissue (fibro-...
0
votes
0answers
20 views

How to identify/Analyze HOG feature data is linearly separable or not?

Work Objective: I am working on Object tracking, I have extracted the Feature vector for ROI(Region of Interest)/template from Image, using this features i am looking to identify most probable ...
0
votes
0answers
17 views

Looking for freely available labelled time series data sets for automated feature extraction and selection

I am looking for recommendations of big, labelled time series datasets that are freely available on the net. My aim is to apply and evaluate methods of automatic feature generation and selection, ...
0
votes
2answers
45 views

Is there any tool for data visualization and manipulation?

I have a time series data set that I need to manually label them for supervised learning. What I am doing now is using excel to plot, and when I see the pattern that I want, I hover over the data on ...
0
votes
0answers
15 views

Performance degradation from video compression

I have two datasets. The first are frames saved as pngs (lossless) from a live video feed, and the second are the same frames taken from an mp4 (H.264 compression). Training the same image classifier ...
0
votes
1answer
49 views

how to build a predictive model without training data neither historical data

I m trying to score "how much a product is expected in the market". I created some features: How much this product is used each year. Where was it used . how many product for each country. the main ...
0
votes
1answer
16 views

Compare job ads with a given set of categories (which each consists of terms)

For a recent research paper, I plan to perform the following, for which I'd kindly ask for your advice. I obtained a set of a few thousand job ads. I now want to analyse how and whether these job ads ...
1
vote
2answers
53 views

Can preprocessing the whole population cause data leakage?

Introduction I understand the problem of data leakage that could be caused by the preprocessing step when our training and test sets are just samples of an unknown population. The preprocessing ...
1
vote
0answers
16 views

why does ID3 Decision tree algorithm not give the best decision tree?

I was going through ID3 algorithm, and what I believe is it incorporates Greedy Search rule to get come up with the decision tree. If it gives the best split possible at every stage, how does it not ...
2
votes
1answer
51 views

What are the differences between Reinforcement Learning (RL) and Supervised Learning?

What is the difference between Reinforcement Learning (RL) and Supervised Learning? Does RL hava more difficulty in finding a stable solution? Does Q-learning have more difficulty in finding a ...
4
votes
1answer
90 views

Detecting abnormal 'cat' behaviour via Supervised Learning

A few work colleagues and I were looking through a recently replaced 'cat', we had in the workplace. For those of you which are curious, the 'cat' in this context, refers to a specific type of pump ...
8
votes
1answer
180 views

Is max_depth in scikit the equivalent of pruning in decision trees?

I was analyzing the classifier created using a decision tree. There is a tuning parameter called max_depth in scikit's decision tree. Is this equivalent of pruning a decision tree? If not, how could I ...
0
votes
0answers
49 views

Recommending top answerers for a Question on Quora/Stackexchange sites

I want to make a tool that will tell me who can potentially answer a question on Quora or StackExchange. The tool will take input the text of a question, and output a sorted list of users who can ...
0
votes
1answer
29 views

Which ML algorithm to use if we have categorical data, numeric data, derived data (derived from) other variable in our data set? [closed]

I am a beginner in Data Science. I have a data set which contains numerical data, categorical data and derived data (derived from other columns). The target column (dependent) is binary. Which Machine ...
5
votes
1answer
293 views

Why neural networks do not perform well on structured data?

I was recently working on some classification problem where decision trees performed better than neural networks. I had tried various combinations with neural networks altering the number of neurons / ...
1
vote
1answer
115 views

how to identify the unknown class in machine learning? [closed]

In the problem of multi-label classification how to identify the unknown class which is not in training labels or classes. In the prediction phase, the classifier puts the data in any of the class ...
1
vote
2answers
25 views

How to check if the dataset contains sufficient information to predict a continuous variable

Is there a way to check if a dataset generally contains enough information to predict a target variable? In other words, can you calculate something like a correlation-coefficient between all ...
1
vote
1answer
53 views

bad regression performance on imbalanced dataset

My current dataset has a shape of 5300 rows by 160 columns with a numeric target variable range=[641, 3001]. That’s no big dataset, but should in general be enough for decent regression quality. The ...
2
votes
1answer
86 views

ML Models: How to handle categorical feature with over 1000 unique values

I am trying to build an ML Classification model on a data set that contains quite a few categorical columns. However, few of them have over 1000 unique values. I am concerned that if I run one-hot ...
4
votes
1answer
89 views

How to automatically verify official documents?

I am new to machine learning and data science. I apologise if the question seems very basic. I have a requirement where I need to verify information submitted via a form with the corresponding ...
1
vote
1answer
36 views

Is the neural network in DQN used to learn like a supervised model?

Is the neural network in DQN used to learn like a supervised model?
3
votes
2answers
108 views

Is NN with no hidden layer is behave like a regression?

Is a NN with no hidden layer is behave like a regression? What we could say that NN without hidden layer can say us? ​ If we have for instance 20 input and 4 output and I have no true label, is it ...
1
vote
0answers
14 views

Introducing synthetic training observations based in business knowledge

I work for a supermarkets company. My team is building a supervised model in order to predict a new store sales. The idea of the business team is to use the model prediction during the decision ...
2
votes
2answers
106 views

Taking Neural Network's false positives as the recommendation system result?

I am creating a recommendation system and considering two parallel ways of formalizing the problem. One classical, using proximity (recommend the product to the customer if a majority vote of 2k+1 ...
1
vote
0answers
82 views

Intuition / Importance of intermediate supervision in deep learning

These days, I have seen many papers using intermediate supervision. Single Network When using a single neural network, multiple neurons output predictions, perhaps by processing data in different ...
0
votes
0answers
22 views

How to define an anomaly detection problem?

I defined a supervised machine learning tasks as: Given: $m$ training examples with $n-1$ features: $E\in\mathcal{R}^{m\times (n-1)}$ and labels: $L \in \mathcal{R}^m$, a model $f$ of $d$ ...
0
votes
0answers
27 views

Random Forest for Edge Detection

Background: This project, Fast Edge Detection Using Structured Forests (written in MATLAB and C++), developed by Microsoft Research, applies random forest to detect edges from an image. The ...
0
votes
0answers
38 views

Relation between query id and feature vectors in pointwise and pairwise ranking approach

I am reading about Learning to Rank and I am not sure how is the data treated during training/testing in pointwise, pairwise and listwise approaches. Usually, I am given a data in a form of relevance, ...
1
vote
0answers
21 views

How to classify a dataset into 5 classes even though the performance is low?

I have a dataset of 5 classes with 8 features, say A, B, C, D and E. Now when I try to classify these into individual classes, I get accuracy, specificity and sensitivity of approx 50-60%, which is ...
4
votes
1answer
40 views

4 Class Classification - Machine Learning Model

I have a data set which contains nearly 150 features and 60k data. And my target feature is continuous variable represents hours. I divided this period into 4 categories of user engagement (4 ranges ...
1
vote
0answers
44 views

How to do feature engineering for email cleaning / text extraction?

I have a large batch of email data that I want to analyse. In order to do that, I need to first prepare the data, as the messages are quite often >80% noise. Generally speaking, my dataset's structure ...
1
vote
1answer
839 views

focal loss function help

I am working on a relation extraction and classification problem. The data is in the form of text files. The data is imbalanced. I want to use focal loss function to address class imbalance problem in ...