Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

1
vote
0answers
12 views

Python Text Classification : How to add a labeled specific wordlist to influence the model?

I've been working on Python Text Classification the past 3 weeks, and i already have a pretty good model but i would like to enhance it. A way to do it would be to add a wordlist that could tilt the ...
0
votes
0answers
14 views

What does “large sparse” and “small dense” means?

In a paper I'm reading today it's written : For a fixed parameter count, we discover that large sparse WaveRNNs significantly outperform small dense WaveRNNs and that this relationship holds up ...
1
vote
2answers
40 views

What exactly is A dataset? is a database contain more than 2 tables counted as 1 or 2 datasets?

A data set (or dataset) is a collection of data. Most commonly a data set corresponds to the contents of a single database table, or a single statistical data matrix, where every column of the table ...
1
vote
1answer
43 views

Prove GDA decision boundary is linear

My attempt: (a) I solved that $a=\ln{\frac{P(X|C_0)P(C_0)}{P(X|C_1)P(C_1)}}$ (b) Here is where I'm running into trouble. I'm plugging the distributions into $\ln{\frac{P(X|C_0)P(C_0)}{P(X|C_1)P(C_1)...
1
vote
0answers
22 views

How to create a person-specific (personalized) classification model using machine learning

I have labeled datasets for 10 subjects that contain photoplethysmogram (PPG) signal value and the affective state as a label. How can I create a person-specific(Personalized) classification model to ...
0
votes
1answer
29 views

How to deal with Logistic Regression warning: division by zero

I'm currently doing my first multiclass logistic regression. Along the way, I encountered this "warning: division by zero". I knew that it caused by log with value 0 since my features contain a value ...
2
votes
3answers
56 views

How to select features when performing classification with a dataframe of multiple columns?

I have a dataframe of 50000 observations and I want to perform a classification task. But I'm struggling with features selection. I have 89 columns, which after getting rid of some redundant features, ...
1
vote
1answer
23 views

TDIDT Decision Trees algorithm

What is the Difference between TDIDT, ID3, CART, and C4.5? My main concern is about TDIDT, Is it first ever algorithm that came with Decision trees? Is it predecessor or successor of ID3, CART, ...
0
votes
0answers
10 views

Caffe CNN prediction gives poor accuracy on validation set despite success during training

I am new to Machine Learning, CNN and Caffe and I have an issue I would be very happy to solve. As part of a University project I must use a Machine Learning method to classify images into 3 classes. ...
0
votes
1answer
19 views

What is Difference Between np.zeros() and np.empty() [duplicate]

Can Anyone Please Explain me the Difference Between them In Terms Of Any Operation or Computation and Values Stored in them
1
vote
1answer
17 views

Logistic Regression Cost Plot Train, Cost Validation & Test

I run logistic regression using kaggle data (pima-indians-diabetes). And I also run a diagnostics to know if my model trained parameters are underfit (high bias) or overfit (high variance) and below ...
1
vote
2answers
169 views

Neural network for linear regression?

In this example: https://www.tensorflow.org/tutorials/keras/basic_regression I was surprised to see a neural network's predicted values graph as a straight line. Isn't the purpose of neural networks ...
0
votes
1answer
12 views

np.empty() Returns some Numbers Rather than Empty Values [closed]

I Wonder, Why the Np.Empty() Method returns some Arbitrary Values in the Array Rather than Empty Array with Zero Filled Here is My Code ...
0
votes
1answer
11 views

How can you build a model based on non-independent imbalance data?

I am trying to predict customer churn based on the data that I have. I am defining churn as an activity that is not followed by another activity within a week. The customer might come back in two ...
-1
votes
2answers
21 views

How do I fix space allocation error on a machine with plenty of space?

I'd like to run a model on RStudio Server, but I'm getting this error. Error: cannot allocate vector of size 57.8 Gb This is what my data looks like and it has 10,000 rows. ...
4
votes
2answers
174 views

Why do we have to divide by 2 in the ML squared error cost function? [duplicate]

I'm not sure why you need to multiply by $\frac1{2m}$ in the beginning. I understand that you would have to divide the whole sum by $\frac1{m}$, but why do we have to multiply $m$ by two? Is it ...
-1
votes
0answers
21 views

How to interpret a multi-label learning prediction

I am using a multi-label learning technique that takes into account the correlation between labels. Some lines( labels) are well predicted while others are not. I know that the performance of a multi-...
0
votes
0answers
4 views

Number of capsules in the Primary Capsule Layer of Capsule networks

What is the Number of capsules in the Primary Capsule Layer of Capsule networks? In many articles, it is written that the number of Capsules is 32 but in the paper, by Hinton - Dynamic Routing ...
0
votes
0answers
18 views

How to improve NN model results? [closed]

I have a dataset for binary classification that has 1613 discrete features (f0, f1, ... f1612) and 1095 samples. I must solve it using neural network. Values have a big variance. I normalized ((x - ...
0
votes
0answers
13 views

Practical interpretation of Precision-Recall AUC

I have a classifier with an AUC (PR) of 0.06 which I will use for a practical interpretation. My test set consists of three months of data with a total of 2,200,000 observations of which 0.03 are ...
0
votes
0answers
27 views

Negative range for binary cross entropy loss?

So based on the website: https://towardsdatascience.com/understanding-binary-cross-entropy-log-loss-a-visual-explanation-a3ac6025181a The binary cross entropy loss is defined as: Which is ...
3
votes
3answers
55 views

k-means classifies one data point as a group

I have 1000 sets of one dimensional data (360 each in length), and I want k means to classify what is a small/medium/large value (n_clusters=3) for each set of data, but I'm getting a lot of instances ...
1
vote
2answers
41 views

Do precision-recall curves have a constant shape/pattern?

I know ROC curve always looks like a stair shape and that I can evaluate AUC of ROC. And I know I can compute AUC of ROC curve to compare which model is better. What I wonder is: Does precision-...
0
votes
0answers
9 views

Removing ambiguous data: Same input variables with different class labels

Background: I'm working with a tree-based ensemble model on a large data set. The target variable y is a binary attribute that have two classes (True and False). I noticed that some of the ...
1
vote
1answer
29 views

Use machine learning to predict next schedule meeting for sales officers

I have a project with data of sales field officers who visit their customers and enter the progress details. Visit can be an order or any kind of customer interaction. Let's say one sales guy has ...
1
vote
3answers
41 views

How to predict product price range using machine learning algorithms

I would like to run thru regression algorithms(linear, SVM, Random forest, Xgboost) thru historical data to predict the price range of a product. To get the price range am going to use top predict ...
0
votes
1answer
21 views

Regression vs Classification to rank by profit

Say that I have a population of 10k customers, for which I expect 100 responders in my next campaign and have budget to send a letter to 5k. I have past data of how much those who respond spent, and ...
0
votes
0answers
8 views

Methodologies and Trends for Sequence Anomaly Detection

I recently started to approach the issue of detecting deviating behavior from rule-based sequences. Basically the task is to spot any difference from "normal running" of processes that are defined as ...
2
votes
4answers
64 views

Why decision tree needs categorical variable to be encoded?

As per my intuition, decision trees should work better with categorical variables than with continuous variables. If this is the case, why is encoding needed on categorical variables? Can someone give ...
1
vote
2answers
53 views

Outlier detection for Disk Space Usage

I would like to do outlier or anomaly detection on the disk free space data. Sample dataset as below (I don't have any label dataset): ...
0
votes
0answers
17 views

How to check quality of latent space like in β-VAE article?

There is a nice plot in the β-VAE article that shows quality of latent space code: Is there a general way to visualize or analyze latent space code dimensions so that is would be clear if they are ...
0
votes
0answers
11 views

What will go wrong if we apply linear or other types of regression to translate sentences between two languages?

Disclaimer: I asked the question at https://stats.stackexchange.com/questions/408463/what-will-go-wrong-if-we-apply-linear-or-other-types-of-regression-to-translate, but didn't get any response, so I'...
1
vote
1answer
12 views

xgboostclassifier prediction error after saving the model and restoring it

I have trained a xgboost model and during training, the prediction works fine. But if I stop the script and start a restoring script to restore and predict, then for the same test dataset I get every ...
1
vote
0answers
42 views

Variable Importance changes with oversampling

I am currently using Xgboost for a binary classification problem with highly imbalanced data in R. I have used oversampling to train the model. This worked well, now however it comes to measuring ...
0
votes
0answers
5 views

Attention Mechanism: Why use context vector instead of attention weights?

In attention, the context vector ($c$) is derived from the sum of the attention weights ($\alpha$) multiplied by the encoder hidden states ($h$), where the weights are obtained by multiplying the ...
1
vote
2answers
33 views

Estimating effort of building machine learning model

I know it depends on the problem and various other factors like data availability, the complexity of the use case, the workload of developer ..etc, but can someone suggest effort estimation of ...
1
vote
0answers
28 views

Is it possible to somehow improve the prediction?

I have a set of points, which is represented on the chart in black. I take the first 978 points and I want to predict the remaining 22. Blue indicates prediction using a recurrent neural network. ...
2
votes
0answers
16 views

Best learning automata reinforcement schema for solving grid world,help me [closed]

I have a gridworld puzzel , an agent and Target , I want find best path for reaching Target by agent. gridworld example(with S as start point, G as goal point and black cells as cliffs):
1
vote
1answer
19 views

Using the Iris Flower dataset, why does my classifier classify any data inputted as “Iris - Virginica”?

I'm a high school senior who is very new to making neural networks. I've been using the Iris Flower dataset (https://www.kaggle.com/arshid/iris-flower-dataset) to build my neural network. My model ...
0
votes
1answer
13 views

Applying Hold-out and CV technique

I have a methodology question: are hold-out and CV generalization-optimization techniques mutually exclusive? It gets really confusing to me at times, because in the most recent project I have been ...
0
votes
4answers
95 views
+50

is it possible to output more than 2 nodes away from a node in a decision tree? if yes, how to do that with sklearn?

usually a decision tree has one root node, some nodes, and some leaves. lots tutorial illustrate this as something like binary tree. is it possible more than 2 nodes away from a node in a decision ...
0
votes
1answer
49 views

naive bayes classifier for non-binary feature values

Given a training set $\{{(x^{(i)},y^{(i)});i=\{1,...,m}\}\}$ where $x^{(i)}\in\{1,2,...s\}^n$ and $y^{(i)}\in{0,1}$. We model the label as a biased coin with $\theta_0=P(y^{(i)}=0)$ and $1-\theta_0=P(...
4
votes
1answer
48 views

Is it possible to use deep learning on small number of samples but each sample has a large amount data?

I have around 50 subjects and each subject has weeks worth of time series data. The task is to identify whether a subject has as specific condition. We have been running wavelet transformations in ...
0
votes
0answers
21 views

De-trending for forecasting

I use De-trending (pandas) to get a stationary dataset, it works, but how can I get the normal values back? ...
2
votes
0answers
27 views
1
vote
1answer
24 views

How to replace words in a sentence with their POS tag generated with SpaCy efficiently?

How is it possible to replace words in a sentence with their respective PoS tags generated with SpaCy in an efficient way?
0
votes
0answers
13 views

Make use of multiple labels in doc2vec: Setting up the data

I am trying to implement the doc2vec algorithm with a rather small sample size: ca. 120 documents with a total of 25000 unique words. My ...
1
vote
0answers
17 views

Time Series Forecasting for Multiple Customers using one RNN

I have a product which has univariate and also multivariate time series data from multiple customers. I have variable amount of data available. Ranging between couple of years to couple of months. ...
2
votes
0answers
29 views

Train ML algorithm to find edges

I have input RGB images as follows: I have a dataset of manually annotated images highlighting the outline(edges) from the input images I am attaching an example. My aim is to train a ML algorithm ...