Questions tagged [data-science-model]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
22 views

How do we decide on the classification algorithm to use with huge training size?

I am solving a questions binary classification problem and the training size for this is huge(291 billion). The data has bloated because of using tfidfvectorizerfor ...
-1
votes
0answers
7 views

What is the best method for classification of time series data Using RNN GRU

Data which has a few input signals which are numeric and output signal which are Categorical, like, Rainy , Sunny, Snow . So its a multi category classification. If I am using RNN GRU , what would ...
2
votes
2answers
41 views

Procedure for selecting optimal number of features with Python's Scikit-Learn

I have a dataset with 130 features (1000 rows) . I want to select the best features for my classifier. I started with RFE but Its taking too long, i done this: <...
-1
votes
1answer
22 views

How Retail Analytics Project Can Be Done?

I have a project and I couldn't understand what I have to do because I am new with retail analytics. They said "Our goal is to measure the effects of promotion on sales" and "Your goal is to model ...
1
vote
1answer
8 views

SMOTE for multi-instance learning i.e num_rows(x_train) > num_rows(y_train)

I have an imbalanced dataset and I wish to predict classes(0 or 1). Sample x_train: ...
-1
votes
0answers
7 views

Interpreting Aaalen Additive Regression and Covariate Over Time Plots

Came across this tutorial for survival analysis in R here: https://rviews.rstudio.com/2017/09/25/survival-analysis-with-r/ I am not sure how to interpret the summary output or graphs related to the ...
0
votes
0answers
8 views

Python and CPLEX [on hold]

I am working with a project is about Software Defined networking. We consider for optimization problem. I use python programming language with mathematical optimization solver CPLEX. We use k mean ...
0
votes
4answers
30 views

How to know if my Decision tree model is good or bad?

I have built a decision tree model. I am not sure if it is good or bad as i am new comer in ML. Kindly help to evaluate my model" Here is my code which i used, ...
0
votes
1answer
28 views

Number of filters in Convolutional Neural Networks

How do I know how many filters to choose? And how does the neural network learn and adjust the filters? Thanks!
1
vote
1answer
25 views

Feature selection filter methods

I am confused about when to use which filter methods for feature selection. I tried to learn them through online resources and found methods like chi-square, variance threshold, F-test, Mutual ...
0
votes
0answers
12 views

Dimensionality Reduction. How to explain dynamics of feature subset based on all features data?

I have features: f1..f1000. I want to explain dynamics of particular features subset: f1-f5 based on all features data (based on ...
0
votes
0answers
20 views

How to convert score to probability [closed]

we have 1000 clients and 10 marketing compaings. we can send each person only one sms with one offer. Each offer should not be more then 100 sms. So we use Xgboost to score whether this compaing will ...
-1
votes
0answers
13 views

List of Machine Learning Algorithms for analyzing continuous variables? [closed]

If I had a set of parameters/variables and a set of output values. How could I know which parameters are actually contributing to the cause of the output values? Could I use feature selection methods ...
0
votes
0answers
17 views

How to load model using Microsoft.ML.Tensorflow?

I'm trying to load model using tensorflow. The model is converted from .h5 to .pb using this method: ...
0
votes
0answers
12 views

How to convert model.h5 to model.pb?

I wrote in google-collab to get the model using keras, but I have to do predictions in Visual Studio using tensorflow I've search for a method converting models from keras .h5 to tensorflow .pb, but ...
0
votes
0answers
19 views

Getting Different Class output and Probability when predicting from model.predict and after deploying model with flask

For Binary classification problem,I am getting Different Class output and Probability for test data when predicting from model.predict and with deployed model with flask. In model.predict I am getting ...
0
votes
1answer
62 views

How to predict whether the client will renew the subscription or not based on given data structure

I have a requirement where I want to predict whether the client will renew the subscription or not. And the data is something like below. Basically client's subscription end date can be anything. ...
0
votes
0answers
19 views

Feature Engineering in Multi-class Classification

I am working on a 3 class classification problem. I am curious on what is the best way to bin continuous variables for this problem. When I worked previously on 2 class problems, for examples sale ...
0
votes
1answer
32 views

what should i learn for deep learning [closed]

i have studied the basic of machine learning ,algebra ,statics and probability.now i want start with deep learning for field of image recognition,classification. i don't know where to start deep ...
2
votes
0answers
26 views

How to cluster a set of objects each with its' own set of data?

I have a problem where I have a set of objects (say smartphones for ease of explanation). For each phone, we collected several characteristic features (such as duration of calls, how many calls made, ...
2
votes
1answer
28 views

Can a Logsitic Regression model continue making predictions after removing predictions from the data set?

I have a logistic regression model that predicts churn (0 vs. 1). I was asked to use the model to predict on a historical group of non-churners, remove anyone who was marked as a churner, and then ...
1
vote
1answer
40 views

Random Forest Prediction

Let's say I want to classify if the employee will churn or not. In my random forest, I have 6 estimators where 3 of them predict the employee to churn and the other estimators predict the employee to ...
0
votes
0answers
8 views

Is it possible to map micro clusters in density based stream clustering into the grid in grid based stream clustering?

In hybrid micro-cluster and grid based stream clustering, the incoming data points are first map in the micro cluster and if it do not fit in any cluster then it is mapped to the grid. Upon reaching a ...
0
votes
0answers
22 views

The Difference between One Hot Encoding and LabelEncoder? [duplicate]

I am working on a ML problem to predict house prices and Zip Code is one feature which will be useful. I am also trying to use ...
0
votes
0answers
16 views

At what value of Accuracy of train and test we can say Model is overfitting and Underfitting? [duplicate]

At what value of Accuracy of train and test we can say Model is overfitting and Under-fitting?
1
vote
1answer
11 views

Keras: Misunderstanding what Keras does when invoking a Model, providing an Input?

In a class named Generator, I have defined a model with the below method define_model: ...
4
votes
1answer
54 views

Understanding why shuffling reduces weirdly the overfit

I am a student currently trying to create a classification model, however I am having difficulty understanding a weird overfitting problem. A dataset of about 30 000 entries, 30 features. The data is ...
0
votes
1answer
18 views

Using strong predictor in Model training?

I am trying to build a Disease predictor based on symptoms. I am using data scraped from Symcat website. After sampling the data we have symptoms to disease mapped for training purpose.Data looks like ...
0
votes
1answer
28 views

Is a new datapoint similar to my reference set?

I have a large reference data set and everyday I get new data points. I would like to know how can I test if those new data points are similar to the reference set? Thanks in advance. Maria
1
vote
1answer
27 views

Repeated training and testing in Weka?

I am using one file for training (e.g train.arff) and another for testing (e.g test.atff) with the 70-30 ratio in Weka. I want to ask how can I use the repeated training/testing in Weka when I have ...
0
votes
0answers
48 views

Handling different length string features and prediction of these based on other features

I am currently working on a problem where the dataset contains 200+ features (Let's call them the code features, e.g no.of.loops, memoryInst, loadInst, etc and Flags that are used to compile code ...
0
votes
1answer
29 views

Why we add a constant value column in our DataFrame sometimes?

Currently I'm learning data science and I'm in the beginners stage. I have seen many times we add a "constant" column in our data frame with all row cells of that column having value 1. I need to ...
2
votes
2answers
26 views

SMOTE on training data

The SMOTE could only be performed on the training data, so how can we do it using Weka? It means we have to put the training and test data in two separate files and run the SMOTE on the training file, ...
0
votes
0answers
28 views

How to test model accuracy on new vs. historical data?

I created an XG Boost model to predict churn using a dataset of customers who were sold during 2018. The accuracy of the model is 89%. Does it make more sense to re-pull the 2018 dataset, where more ...
0
votes
1answer
32 views

PicklingError: Could not serialize object: TypeError: can't pickle fasttext_pybind.fasttext objects

I built a fasttext classification model in order to do sentiment analysis for facebook comments (using pyspark 2.4.1 on windows). When I use the prediction model function to predict the class of a ...
1
vote
1answer
30 views

Inputs required for Random Forest Regressor and ways to improve performance

I am using Random Forest Regressor to predict inventory needs. The data I am using to train the model lists the total quantity picked for each product per date, but does not include rows where total ...
0
votes
1answer
18 views

Learn the evaluation matrix for hire a job candidate

Let us assume that we have a certain number of features that are weighted with some parameters . The features could be the different skills that belongs to a job candidate applying for a job ...
0
votes
2answers
38 views

How do you apply hypothesis testing to your features?

How do you apply hypothesis testing to your features in a ML model? Let say for example that I am doing a regression task and I want to cut some features (once I have trained my model) to increase ...
0
votes
2answers
20 views

How to display the entire output and not shortened versions

I'm trying to display all the columns in my dataset that have NaN values: print(train.isnull().sum()) The output that I get is ...
0
votes
0answers
9 views

H2o Flow Model creation Notification for external application

I have a requirement.I would like to trigger an event from h2o flow (through RESTful API preferably) whenever I create a model in h2o flow webUI - for.e.g ,the moment I create model M1,I would like my ...
0
votes
0answers
17 views

hardware configuration for data science

I would like to know what type of computer configuration to use to perform datascience on medium to low quantity of data (< 100 000 matrix line x 50 parameters). I have read some blog on people ...
0
votes
0answers
16 views

How to use ML in improving cv search experience?

Need your recommendation to start the followings- I am working on a case study where I need to improve search experience in a job portal using Data Science/Machine Learning. I have two types of ...
2
votes
0answers
54 views

Can we use log transformation for outliers?

I am doing analysis on telecom churn dataset. I have 4617 observations and 17 variables. I am using Python. I have the following questions, 1) When I skewness and kurtosis for the normality test, two ...
0
votes
1answer
25 views

Making Inference from a Correlation Heatmap

I have constructed a Heatmap of my dataset for visualization. I have searched on various sites regarding what can I infer from the heatmap and I am unable to get any clear understanding from them. I ...
0
votes
1answer
39 views

Dataset columns throwing KeyError

For some reason, the columns in my dataset are throwing the following KeyError: ...
0
votes
1answer
34 views

Effect of skewness in data

I am preparing classification model. Many of numeric variables are positives skewed. Should I change a distribution of variables to be more Gaussian?
0
votes
0answers
10 views

What are the pros and cons of using Azure ML studio in developing ML algorithms compared to native python development approach?

What are the pros and cons of using Azure ML studio in developing ML algorithms compared to native python development approach ?
0
votes
3answers
22 views

How to find the driver features towards a particular result in Classification problems

In a classifier model, we can predict the outcome class, but here I need to find out the features that drive towards a particular result in a classification problem, that are a strong indicator of a ...