Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

0
votes
0answers
16 views

How to make the model use the data structure as a valuable information? How to help the ML model know that some variables should be used togheter?

I trained some simple sklearn machine learning models that use X (100 values) to predict Y (1 value). (detail: It works fine, but I think we can improve using more dimensions.) Here is a sample: <...
0
votes
0answers
5 views

With two deep learning models, how do I perform Bayesian Model Averaging for better prediction on a test set?

Given two deep learning models that can predict on a test set, what I want to do is use BMA (Bayesian Model Averaging) to average the models to better predict? What exactly is the procedure for this?...
0
votes
0answers
20 views

LSTM predictions only above or below mean value

I have an interesting problem with the predictions of my keras LSTM model. The goal of my model is to predict the changes in high and low prices for a selected FX rate pair based on the following ...
0
votes
1answer
20 views

Signature verification - machine learning

I have to do a project on signature verification. My goal is having a program with two images as inupt (one is a genuine signature of a selected subject and the other one is the one that I want to ...
0
votes
0answers
16 views

Applying Label From Supervised Learning to Unlabeled Data- Text Classification

I am wondering if anyone has code to following: 1) Apply labels from a previous text classification dataset like this type of data (https://colab.research.google.com/drive/...
0
votes
1answer
26 views

Do I need to convert booleans to ints to enter them in a machine learning algorithm?

My dataset contains a lot of columns with booleans do I really need to change them so I can insert them into the algorithm? I'm gonna use KNN right now but will test other algorithms later so I'm ...
0
votes
0answers
13 views

How to select Cut off value for binary classification? [on hold]

I am a newbie in machine learning, and this question have been asked in an interview . How will you select cut off value for binary classification using KS Score, ROC Curve, Precision recall curve. ...
1
vote
3answers
31 views

How to create clusters based on sentence similarity?

I have data which looks like following. Data is a group of sentences which are similar, but have few unique words in between like TABLEA, TABLEB etc. ...
2
votes
3answers
42 views

ML algorithm for Music Features

I am a newbie in machine learning topic and I need to create model from music data. It contains features of the songs but it is not labeled. How can I create a model from that ? Do I need to use ...
1
vote
1answer
27 views

MR images segmentation for feature extraction

I have datasets of brain MR images with tumours, the tumours are already selected manually by a physicist using Image J. I have read about segmentation, but I still couldn't understand how do they ...
0
votes
0answers
10 views

A* route algorithm [closed]

I have data.csv. data have start node and end node. but I so confused about node which is not relation in start node and end node in data. but, if that visualization routes relations. how about it? I ...
3
votes
1answer
29 views

Do CNNs benefit from HDR images?

I have images with 12 bits per color channel which I use for several detection networks (YOLO, RetinaNet, etc.). Can I expect any precision difference between 12 bpp and 8 bpp as network input? Or is ...
0
votes
0answers
10 views

Is employee attrition regression or classification problem?

I'm currently working on employee attrition project. I want to predict the attrition rate of day-n. So, I want to give a report such that probability of an employee to stay in company at day-m, day-m+...
0
votes
1answer
41 views

Datascience ML Guide

I have started learning ML and I am stuck at finding a problem solution. I need the steps to follow up: Below are the formats of data sets: cust_Demographics ...
0
votes
0answers
12 views

GAN learning problem

I have a question regarding my GAN training. At first, ihe training output looks like this: And converges to this: The first and second columns are the Wasserstein error for the true and generated ...
0
votes
3answers
32 views

Meaning of variance in machine learning models

I know that high variance cause overfitting, and high variance is that the model is sensitive to outliers. But can I say Variance is that when the predicted points are too prolonged lead to high ...
0
votes
0answers
10 views

Data Science - Estimating the cost of an error in classification problem [on hold]

I am a self-taught person and have been working with a heavily imbalanced dataset. I have been using different metrics to train the model, but I read around that it is possible to estimate the cost ...
0
votes
0answers
6 views

How to smoothen array of samples?

I am implementing a Genetic Algorithm library. However, on Roulette Wheel Selection algorithm sometimes one or two chromosomes dominate he roulette wheel with their relatively large fitness scores. I ...
1
vote
1answer
21 views

RBF neural network python library/implementation

I want to use a Radial Basis Function Neural Network for my thesis. Is there any library that implements it? And in the negative case, which is the best library to implement it?
0
votes
0answers
13 views

Maximizing Spearman coefficient correlation under ML algorithm [on hold]

I have anonymus date (with unknown variable names) X (the amount of data is very large). The task is to predict the class, which is only 5. The main problem is that Spirman’s correlation coefficient ...
0
votes
0answers
6 views

What algorithm should I look into to find right time to prompt the user for something?

I want to make an application that is able to look at historical patient data collected through another app and find the best time to prompt a patient to take their medication, using machine learning? ...
0
votes
1answer
32 views

Cost function in linear regression

Can anyone help me about cost function in linear regression. As from the below plot we have actual values and predicted values and I assumed the answer as zero but it actually is 14/6? Can anyone ...
0
votes
0answers
17 views

Aggregate function for Machine Learning scores

I am trying to find a way to calculate an aggregate score between 0-100 for multiple scores coming from a machine learning logistic regression algorithm. For example, if I have 3 scores: 20, 50 and 60 ...
0
votes
0answers
4 views

Dimentionality reduction with suggestion on logically combining features that are better predictors when combined together?

Anyone knows about a code that performs dimentionality reduction with a suggestion on combining features that are better predictors when combined logically together instead of them being combined ...
0
votes
0answers
14 views

Stacked machine learning models train - test split on time series data

I have a question about the best approach to a problem I am facing. I have time series data, say from day 1 to day 100. I Split the data into a training and test set, 80:20 and apply 3 machine ...
0
votes
1answer
6 views

Best way to narrow down a list and rank based on attributes?

I have a mortgage/credit data set that contains a list of customers (600k rows) and has a 100 columns inclusive of the customer's general info (address, city, zipcode, etc), income, fico scores, ...
1
vote
0answers
21 views

Not sure if over-fitting

I trained the data this way : There are four classes , the data distributed evenly (same amount of labels). Used min_max_scaler Used train_test_split(X,y,test_size=0.3,random_state=42,stratify=y) ...
0
votes
1answer
16 views

How to change the threshold value in orange?

How can I change the threshold value for each classifier? In the ROC analysis curve we are allowed to remove the tick from "default threshold"
0
votes
0answers
12 views

What Is the difference between churn analysis, churn prediction and user retention analysis?

I have never learnt these concepts in machine learning study. When I apply for data scientist jobs, there are these concepts/fields: churn analysis churn prediction user retention analysis What ...
0
votes
0answers
9 views

R - What's the machine learning/non-machine learning way to identify points from intersecting lines in an image?

Let's say I have a image of several intersecting lines (left). Is there a way for R to detect where the lines intersect and overlay points on them (right)?: The goal is to import an image of fish ...
0
votes
1answer
14 views

Feature Scaling and normalization in cross-validation set

I have a question that normally, when we are making a training set and a final test set, we would compute the mean and standard deviation for preprocessing using the training data and use it to ...
0
votes
1answer
31 views

Unsupervised learning from images [on hold]

I want to design a model that can detect the different feature in the images, let's consider we have ~100000 images of cows. when I give this images to the model it has to identify different parts of ...
0
votes
0answers
12 views

How to calculate Bias and Standard deviation given the true versus predicted values of ML model?

I am looking to calculate Bias and Standard deviation given the true versus predicted values of ML model. Am I correct in saying: Bias = (average difference between true values and predicted values)/...
0
votes
0answers
25 views

Which machine learning/deep learning model can I apply to a mix on textual, categorical and numerical data for a binary classification

I have a project based on tweets wherein I am trying to build a binary classifier, I am aware that I can use a contextual LSTM model which takes the metadata of a tweet as an auxiliary input within ...
0
votes
1answer
14 views

In Reinforcement Learning can I randomly assign next_states from the state space to my agent while creating transition set?

In Reinforcement Learning, while creating transition samples (state, action, next_state, reward), where: Agent: The learning agent Environment: The trainer The environment gives two feedback to the ...
0
votes
1answer
12 views

How can i use Hellinger Distance on array of different length?

I have to use Hellinger distance to compare arrays that are not of the same length. Is there a way to do it correctly? Put zero in the missing fields of the shorter array doesn't sound that good to me ...
1
vote
1answer
10 views

Automatic legal document reviewing advice

I am lawyer from SK. I also like programming and Maths. Which technology should i use for this task? Automatic legal document reviewing. I have a big data set of specific contracts in slovak. Now I ...
0
votes
0answers
7 views

Manual Input Increase Probability In Machine Learning

I have been building a neural network using Tensorflow to predict the location of flying object. I have been able to successfully run the data through and get a predicted output, but I want to include ...
1
vote
2answers
23 views

Continous bag of words claimed to be unsupervised, how is it working?

I'm following these two lectures on CBOW and skip-gram word2vec models. The first is lec 12 and the next lec 13 of a deep learning series https://www.youtube.com/watch?v=syWB-YMYZvI https://www....
1
vote
0answers
12 views

How do I perform Leave One Out Cross Validation For Top n Recommendation Sytems?

I am new in making recommendation systems . I am using the surpriselib library to evaluate my recommendations. All the Accuracy Metrics are well supported in this library. But I also want to compute ...
0
votes
1answer
25 views

find the values of theta in a cost function from andrew ng course

I was following Andrew NG ML course on coursera. I was stuck at cost function. How can I find values for Theta-0 and Theta-1 ? ...
0
votes
1answer
14 views

Feature selection/reduction techinique for combination of features in image processing

I have a combination of features extracted from 3 descriptors, namely GLCM based feaures(correlation, homogeneity,energy and contrast ), Local binary patterns (256) and discrete wavelet transform ...
0
votes
1answer
29 views

Random Forest, Duplicating Data increases Accuracy. Why? [closed]

I duplicated my training data for the random forest classifier (Sklearn) and the accuracy of the prediction increased by about 3%. Why?
0
votes
0answers
7 views

add a constraint to a DQN

I have a DQN (with 5 state variables) but I want to add a constraint to it such as (p<10), which p is a parameter which is not one of the state variables. However, there is a hide relation between ...
0
votes
0answers
19 views

How is Universal Sentence Encoder trained using Deep Averaging Network (DAN)?

In the paper of Universal Sentence Encoder (USE), the author mentions it to be trained using transfer learning in an unsupervised manner in two forms: 1. Using Deep Averaging Network (DAN) 2. Using ...
0
votes
1answer
10 views

How to get the formulas used by seasonal_decompose for Trend and Seasonality

I'm trying to use decomposition to forecast into the future. From my reading I understand that I can do this by adding a trend formula to a seasonality formula. I know that I can decompose a time ...
0
votes
0answers
16 views

Titanic Disaster Problem in Kaggle: distribution of numerical feature values across the samples

I'm still a newbie in Data Science and I found the Titanic question and solution here in Kaggle. I've been trying to understand the solution yet I still can't grasp why he used those percentiles for ...
1
vote
0answers
19 views

segmentation of brain tumor in MRI images

I have a dataset of brain tumours images. and I have to build a model to classify the malignancy grade of these tumours. The size of the tumours varies from small to large. The ROI are already ...
1
vote
1answer
42 views

cross validation for small dataset

I have a dataset of 39 medical MR images, and I have to build a model to classify the tumor type. so is it suitable to use k-fold cross validation for validating the model? if so, what would be the ...
1
vote
1answer
25 views

RNN package and problems with “Predictr”

I have two questions about how to use R's RNN package, specifically the trainr and predictr functions. Let's suppose I have a time series of 4000 steps for 5 different variables. How should this be ...