Questions tagged [machine-learning-model]

A machine learning model is a simplified representation of a dataset, derived from statistics in the data, used to make predictions. It can represent patterns, behaviours or features within this dataset which have been learnt by the algorithm during training.

Filter by
Sorted by
Tagged with
0 votes
3 answers
4k views

How to add noise to supervised (binary-classifier)?

Note: The question is not about validating/testing a trained model. Say i have an unlabeled features set, I want to approximate the true labels (for the sake of argument lets assume it's a binary ...
0 votes
1 answer
37 views

Linear regression, R²?

When I do a linear regression, R²: 0.90, but the estimates are not correct, why is this happening? (Deep Not : Adjusted R-squared: -0.3872)
  • 1,039
3 votes
2 answers
2k views

Python OneHotEncoder Using Many Dummy Variables or better practice?

I am building a neural network and am at the point of using OneHotEncoder on many independent(categorical) variables. I would like to know if I am approaching this properly with dummy variables or if ...
8 votes
3 answers
637 views

Chi-square as evaluation metrics for nonlinear machine learning regression models

I am using machine learning models to predict an ordinal variable (values: 1,2,3,4, and 5) using 7 different features. I posed this as a regression problem, so the final outputs of a model are ...
  • 181
10 votes
7 answers
39k views

I got 100% accuracy on my test set,is there something wrong?

I got 100% accuracy on my test set when trained using decision tree algorithm.but only got 85% accuracy on random forest Is there something wrong with my model or is decision tree best suited for the ...
2 votes
1 answer
1k views

can accuracy rise while precision and recall drop?

I am working on a model and running some experiments, I see that under some configurations, The accuracy rises while the recall and precision are much lower, what is the mathematical explanation? is ...
1 vote
1 answer
35 views

How to show value of a classification model even though it doesn't get the desired performance?

I developed a classification model for a telecom client. Where we classify between Dual-sim and non-Dual-Sim clients. After many iteration the best precision we can get is 60%. The contract says that ...
  • 13
3 votes
1 answer
100 views

Need help on Time Series ARIMA Model

I'm working on forecasting daily volumes and have used time series model to check for data stationarity. However, I'm strugging at forecasting data with 90% accuracy. Right now variation is extremely ...
  • 31
1 vote
1 answer
38 views

How to train and validate a model continously which affects its own future data?

We are working with a online marketplace. Our problem is to predict whether certain products are profitable or not for our marketplace in near future(next one month horizon). For example: Consider 2 ...
  • 125
3 votes
1 answer
564 views

Churn definition for non-contractual services

I am computing churn definition i.e, the number of days after which we will say a customer has churned in fashion retail, etc. Currently, I am using the transaction dates to get the average days ...
  • 357
1 vote
0 answers
54 views

Monitor Model Training Progress over HPC Clusters

As a part of my research in Deep Learning, I have to frequently train models which require a lot of computing power. As such, I use my university's HPC environment to submit my jobs and to train my ...
5 votes
2 answers
9k views

How would I apply anomaly detection to time series data in LSTM?

I am using a LSTM RNN in Python and have successfully completed the prediction phase. My ultimate goal is anomaly detection. I'm hoping to have something like what you could see on Facebook Prophet, ...
  • 51
2 votes
1 answer
191 views

How to model a Machine learning problem considering links between features

Context: To predict employee turnover ( will an employee leave? ), I have used one of the classification algorithms (LDA) to train my dataset, and then make predictions. The dataset is quite small (...
  • 21
1 vote
3 answers
381 views

Predicting number of cars

I am predicting the number of cars from a traffic dataset. Here is my data dictionary: The ‘Traffic-Major-Roads(kilometres)’ file contains the following variables (variable names are in bold): Year - ...
  • 561
2 votes
3 answers
1k views

Why replacing null values with outliers?

I have been watching a tutorial on stock price prediction with multivariate linear regression and the tutor replaces missing value data, NaN, with the outlier -99999. Why and how do replacements like ...
  • 121
1 vote
1 answer
263 views

Algorithms, techniques, papers for regression with vector output

I have a regression problem that has relatively low dimensional input (say 8 initial relevant features, without the engineered ones), but very high dimensional output vector (not a single value for ...
  • 111
1 vote
1 answer
95 views

Are there any methods of supervised learning that return a bitmap instead of a set of parameters?

For example, the SVM or ANN methods perform search of a surface which would separate the data points in a best way. This surface is returned in the vector or parametric form. Are there methods ...
  • 11
1 vote
1 answer
410 views

When is feature transformation required?

I was fitting machine learning models to clean data(Imputed missing values, removed unnecessary features etc). I didn't transform the features that are skewed. Before moving forward, I want to ...
1 vote
2 answers
12k views

How to apply machine learning model to new dataset

I'm very new to machine learning & python in general and I'm trying to apply a Decision Tree Classifier to my dataset that I'm working on. I would like to use this model to predict the outcome ...
  • 11
1 vote
1 answer
81 views

How much neural network theory required to design one? [closed]

So I have looked at some of the literature on neural networks and read some chapters, but the learning curve is so steep that I have had trouble even getting started on designing the neural network to ...
2 votes
1 answer
988 views

Create Custom Python Model in Azure ML Studio?

I came across this article on how to create a Custom R Model and use it in Azure ML studio https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/create-r-model Can we ...
  • 93
1 vote
0 answers
334 views

Classification using Orange 3

In Orange3 while only using its widgets, without writing Python code, I’ve implemented the following typical machine learning processes Train a training set, (1 file) Validating a validation set (e.g....
2 votes
0 answers
88 views

Image resizing to be done programatically or taken care by model config file in tensorflow?

For Deep Learning using Tensorflow, is it necessary to resize the images to a predefined width and height before before training using a model? OR In model configuration file , I noticed this ...
  • 173
1 vote
2 answers
653 views

What is the best references / books to get familiar with machine learning algorithms? [duplicate]

I'm just starting off as a data scientist and i need to understand how regression, random forest and much more.. algorithms function under the hood, the maths behind them and when to use them. I ...
  • 21
2 votes
2 answers
84 views

Which machine learning algorithm to choose?

I want to choose an unsupervised algorithm which learns to predict $n$ outputs from the data, for eg. 4 coordinates (pixels) in an image. What algorithm should I choose? I think it's a 2-class ...
  • 205
1 vote
1 answer
738 views

Iterative Machine Learning

I was wondering what percentage of Machine Learning Algorithms are iterative in nature; i.e. I can run them sequentially, on different set of data and the model refines itself. Are there any ...
5 votes
0 answers
54 views

Choosing the right model to learn [closed]

I'm new to the data science world, and I hope to solve a problem using deep learning methods, I started learning how FNN and CNN work and when I saw how many models and methods are the I got a bit ...
3 votes
1 answer
6k views

Query data dimension

...
3 votes
1 answer
558 views

How to properly represent a tic tac toe board to a CNN?

I'm figuring out how to manipulate convolutional neural networks (CNN) in python and I want to apply this kind of NN to an agent player that plays tic tac toe. I know that's weird and the problem ...
1 vote
0 answers
35 views

modeling binary classification data

I am new to Machine learning. While reading SparkMLLib java code, I found Binary_classification dataset. But I am not able to understand how this data is modeled and if I want to model same type of ...
  • 111
3 votes
1 answer
25 views

What could be some Classification techniques to classify a tree of webpages given the category of each webpage

I want to perform a website classification task where I have modeled a website as a tree of webpages. I already have a model which can assign categories to the nodes in the tree (webpages). I need ...
1 vote
1 answer
97 views

Build a predictive model for number of hockey goals in a season for an individual player

I'm looking to build a predictive model for hockey players individual statistics. My goal is to predict how many points a player can be expected to have at the end of the season. To do so, I thought ...
1 vote
1 answer
42 views

Model selection for a "set of linear models"?

I would appreciate your input on which predictive ML model(s) could fit our dataset the best. The primary features of the dataset are x,y (continous) and c (factor with around L=500 unordered levels)....
5 votes
1 answer
224 views

When to use Multinomial Naive Bayes?

I am working on a text classification problem, and plan on using Naive Bayes based model. In which cases should I consider using Multinomial Naive Bayes?
0 votes
2 answers
722 views

Different Values in Training and Testing set

If I am trying to build a classification model where Values for columns have different ranges: For Example: Column A in training set ranges from 0 - 30 but for testing set it ranges from 0 - 80. ...
  • 243
1 vote
1 answer
44 views

Is it possible to make an machine learning algorithm, that can outperform humans in complex games with current technology?

Would a company like OpenAi, it the "average" person be able to make a bot, using machine learning, that can outperform the best e-sport players in complex games, like PubG, with the technology we ...
  • 111
2 votes
0 answers
52 views

Split large dataset for predictive modeling using rsparkling -sparklyr

I am trying to build machine learning models (GBM, RF, Staking) on top of a dataset that is about 3G in size on my local computer. However, I only have 4G memory (only 2G are available). My question ...
  • 21
6 votes
3 answers
287 views

What are the individual models within a machine learning ensemble called?

I am aware that an ensemble machine learning model is a stack of two or more machine learning models. Is there a word to refer to those individual models that go into the ensemble model? (i.e. a ...
  • 211
5 votes
1 answer
257 views

Temporal Aspects in Machine Learning

Concept drift means that the statistical properties of the target variable, which the model is trying to predict, change over time in unforeseen ways. With reference to the classic house price ...
1 vote
2 answers
428 views

Confused about the different aspects in Machine Learning [closed]

After reading different articles about ML and algorithms, scientist tends to use different words when describing the different aspects in ML. So now I'm a bit confused myself and I hope you can ...
1 vote
0 answers
242 views

Performance Evaluation Metrics used in Training, Validation and Testing [closed]

Which specific performance evaluation metrics are used in training, validation and testing and why? I am thinking error metrics (RMSE, MAE, MSE) are used in validation, and testing should use a wide ...
6 votes
4 answers
2k views

Alternatives to Logistic Regression

I have age, gender, height, weight and some other similar parameters of 15000 subjects. I also have one column showing if they had a medical condition (present in about 20% subjects). I now want to ...
  • 1,536
5 votes
2 answers
645 views

How to continue incremental learning when a categorical variable has been assigned additional category labels?

Please help answer this question or point me to any resource. There is a model in an environment where training happens with new data and the data is discarded after training is completed. This keeps ...
0 votes
1 answer
20 views

Feature has a pattern in relation to class but does not enhance classifier to predict class

I have a feature x that when I plot it again my class variable y it shows some sort of pattern, i.e. it is obvious that x has a relation with y, but when I add the x to my logistic model it reduce the ...
  • 214
1 vote
1 answer
165 views

Deciding Initial Weights In A Linear Classifier For Sentiment Analysis

I would like to build a simple sentiment analysis classifier using logistic regression. I downloaded a list of positive and negative words from cs.uic.edu. There are more than 6000 words both positive ...
0 votes
2 answers
2k views

Encoding continuous values

I've been reading about one-hot encoding for categorical values. Could similar mechanism make sense for continuous values? I'm looking at a problem, where I try to predict the volume of product X, ...
  • 101
0 votes
1 answer
948 views

How to bypass ID column without being used in the training model but have it as output - Azure ML

The input data in the model includes column ControlNo. But I don't want this column being part of learning process so I'm using Select Columns in Dataset to ...
  • 115
1 vote
3 answers
281 views

Using Machine Learning techniques for text-analysis

I am analysing a bunch of tweets and I want to understand which political party the authors support. I am using Mathematica but I am thinking to re-write my code in Python. If you have any suggestion,...
  • 111
0 votes
3 answers
2k views

Predicting best time to send email

I have a dataset of past emails sent, when they were sent and if they were opened. What would be the best model to predict the best time to send email? I was thinking of modeling it as time series ...
  • 51
1 vote
0 answers
85 views

Design language or artifact for data science model

Inspired from this question, given that there is no standard definition of a data-science model, is there a way to standardize the communication about any data-science model? Just like material ...