Questions tagged [machine-learning]

Machine Learning is a subfield of computer science that draws on elements from algorithmic analysis, computational statistics, mathematics, optimization, etc. It is mainly concerned with the use of data to construct models that have high predictive/forecasting ability. Topics include modeling building, applications, theory, etc.

Filter by
Sorted by
Tagged with
1
vote
2answers
2k views

Dealing with multiple distinct-value categorical variables

So, I've got a dataset with almost all of its columns are categorical variables. Problem is that most of the categorical variables have so many distinct values. For instance, one column have more ...
1
vote
1answer
304 views

Implement the following loss function without interrupting the gradient chain registered by the gradient tape

I have spent five days trying to implement the following algorithm as a loss function to use it in my neural network, but it has been impossible for me. Impossible because, when I have finally ...
1
vote
2answers
666 views

Intra-cluster similarity metric

I have some observations belonging to groups and I would like to compute the similarity of them within different groups in order to tell which observations, within specific groups, have similar ...
1
vote
1answer
2k views

What is difference between leave one subject out and leave one out cross validation

What is the difference between leave one subject out cv and leave one out cross validation (loocv)? are they same or different?. I have images of 24 subject and according to literature, leave one ...
1
vote
2answers
62 views

Regression vs. Expected value for campaign results

Let's say that I have 100k customers, and I can only send 10k letters for a loan, and I do have information from past campaigns and I know I can expect about 100 responders. If I want to get in my ...
1
vote
2answers
256 views

Record Linkage problem

I am building Matching Alogoritm using ML.Project is to match Internal customer data with external customer data.Features are names,address,city,state and zip. We create pairs between data sets and ...
1
vote
1answer
547 views

TDIDT Decision Trees algorithm

What is the Difference between TDIDT, ID3, CART, and C4.5? My main concern is about TDIDT, Is it first ever algorithm that came with Decision trees? Is it predecessor or successor of ID3, CART, ...
1
vote
1answer
573 views

When and where dummy.data.frame would be used?

I am learning this post, in which, the author gives the piece of code: ...
1
vote
3answers
228 views

Why would it be bad to fit a regression model to a binary classification problem?

Let's say that we have a binary classification problem. Why would it be bad to fit a linear regression and then classify given a threshold? The output would be continuos and it could be out of range,...
0
votes
1answer
55 views

An example of explainable, but not interpretable ML model

This post attempts to explain the difference between explainability and interpretability of ML models. However, the explanation is somewhat unclear. Can somebody provide specific examples of models ...
0
votes
1answer
20 views

determining size of batch, time of sending and memory in to send from scala to ML section

I have a time series (sampling time: 66.66 micro second, number of samples/sampling time=151), I would like to determine some anomalies in them, the inputs are made by scala customer message bus. ...
0
votes
1answer
297 views

How to change the threshold value in orange?

How can I change the threshold value for each classifier? In the ROC analysis curve we are allowed to remove the tick from "default threshold"
0
votes
2answers
1k views

How to handle non consistent time series( using LSTM )

The time series dataset I am working on has missing samples. I am trying to use keras and LSTM for prediction. How should I handle the missing timestamp samples ( sometimes there are missing weeks ...
0
votes
2answers
245 views

From where should I start Machine Learning? [closed]

I want to know how to start from scratch for Machine Learning. Also which language is best for implementing its algorithms or developing future applications based on it. Thanks!
0
votes
1answer
3k views

Algorithm for classification of words into given categories [closed]

I'm working with textual data from medical field. I have a list of words and I want to build an algorithm that can classify each word into one or more given categories, like Medicine_Name ...
0
votes
2answers
85 views

Which hyperparameters of a neural network can be tunned independently?

The hyperparameter search is computationally expensive. I am wondering if one can tune the hyperparameters independently: tune one hyperparameter for a fixed value of other hyperparameters. For ...
0
votes
1answer
25 views

Understanding neural network probability

I'm training a CNN model with two classes to predict. I know it gives me a probability for one class and for the other one, and I also know I can get the predicted label, but I don't the results given....
0
votes
1answer
147 views

Can we have a dataset with slight difference in target values for same value of feature variable?

I am trying to generate a dataset which involves 1 feature variable(X) and 1 target variable(y). The feature variable ...
0
votes
2answers
98 views

Theoretical treatment of unlabeled samples

In a typical supervised learning setting with a few positive and a few negative examples, it is clear that unlabeled data carries some information that can benefit learning and that is not captured in ...
0
votes
1answer
105 views

Is it possible to use Recurrent NN (LSTM) for classification?

I have a dataset C of 50,000 (binary) samples each of 128 features. The class label is also binary either 1 or -1. For instance, a sample would look like this [1,0,0,0,1,0, .... , 0,1] [-1]. My goal ...
0
votes
3answers
227 views

What is the difference between filling missing values with 0 or any othe constant term like -999?

Most of the text book says to fill missing values use mean/median(numerical) and most frequent(categorical) but I working on a data set which has too many missing values and I can't remove those ...
0
votes
2answers
2k views

Binary Classification - One Hot Encoding preventing me using Test Set [duplicate]

I have a preprocessing pipeline that includes replacing missing values and onehotencoding for the categorical variables. When I try to use my model on the test set, it explains that the number of ...
0
votes
3answers
907 views

Is it a good practice to evaluate a model on the training set

Is it a good practice to evaluate a model on the training set (i.e. train a model on training set and evaluate the regression error/accuracy on the same training set) and compare the evaluation result ...
0
votes
0answers
21 views

My validation set losses are static

My dataset looks something like this: ...
0
votes
2answers
518 views

How to learn Machine Learning [closed]

I want to get into machine learning. I've been in information security for the last 10 years so i have an IT background. Where is the best place to start: Can anyone recommend a good book? And also a ...
0
votes
0answers
96 views

Convert time series data to supervised learning problem

I have a similar dataset like the one below. Each row represents a person and there are 3 different variables m1,m2,m3 with 3 measurements each. I am trying to frame this time series problem as a ...
0
votes
1answer
79 views

How can I use data science / machine learning / statistics / data analytics techniques to find better customers in the future? [closed]

I work for a business to business company with a data set containing approximately 2700 businesses as customers. For each business customer I have approx number of staff, location, industry, the sales ...
0
votes
1answer
2k views

Accuracy keep changing by changing randomState of classifier

I try to classify car sound samples. Using MLPClassifier from Scikit. I'm getting very different and confusing test results between 2 different test sets, and I am stuck: Training is done with the ...
0
votes
1answer
24 views

AutoML for categorical feature encoding

I have an input dataset with more than 100 variables where around 80% of the variables are categorical in nature. While some variables like gender, country etc can be one-hot encoded but I also have ...
0
votes
1answer
51 views

Compare cross validation and test set results

I am having a hard time understanding the results of a cross validation test and a test run on a test set. First I made the following pipeline: ...
-1
votes
2answers
246 views

How to plot High Dimensional supervised K-means on a 2D plot chart

I'm Having a ML problem where my data set contains 80 features labelled into 3 groups (0, 1, -1). I want to plot the data on a 2D surface to see how "close" (similar) data with ...

1
8 9 10 11
12