Questions tagged [data-science-model]
The data-science-model tag has no usage guidance.
197
questions
0
votes
0answers
9 views
1
vote
1answer
22 views
How do we decide on the classification algorithm to use with huge training size?
I am solving a questions binary classification problem and the training size for this is huge(291 billion). The data has bloated because of using tfidfvectorizerfor ...
-1
votes
0answers
7 views
What is the best method for classification of time series data Using RNN GRU
Data which has a few input signals which are numeric and output signal which are Categorical, like, Rainy , Sunny, Snow . So its a multi category classification.
If I am using RNN GRU , what would ...
2
votes
2answers
41 views
Procedure for selecting optimal number of features with Python's Scikit-Learn
I have a dataset with 130 features (1000 rows) . I want to select the best features for my classifier. I started with RFE but Its taking too long, i done this:
<...
-1
votes
1answer
22 views
How Retail Analytics Project Can Be Done?
I have a project and I couldn't understand what I have to do because I am new with retail analytics.
They said "Our goal is to measure the effects of promotion on sales" and "Your goal is to model ...
1
vote
1answer
8 views
SMOTE for multi-instance learning i.e num_rows(x_train) > num_rows(y_train)
I have an imbalanced dataset and I wish to predict classes(0 or 1).
Sample x_train:
...
-1
votes
0answers
7 views
Interpreting Aaalen Additive Regression and Covariate Over Time Plots
Came across this tutorial for survival analysis in R here: https://rviews.rstudio.com/2017/09/25/survival-analysis-with-r/
I am not sure how to interpret the summary output or graphs related to the ...
0
votes
0answers
8 views
Python and CPLEX [on hold]
I am working with a project is about Software Defined networking.
We consider for optimization problem. I use python programming language with mathematical optimization solver CPLEX. We use k mean ...
0
votes
4answers
30 views
How to know if my Decision tree model is good or bad?
I have built a decision tree model. I am not sure if it is good or bad as i am new comer in ML. Kindly help to evaluate my model"
Here is my code which i used,
...
0
votes
1answer
28 views
Number of filters in Convolutional Neural Networks
How do I know how many filters to choose? And how does the neural network learn and adjust the filters?
Thanks!
1
vote
1answer
25 views
Feature selection filter methods
I am confused about when to use which filter methods for feature selection. I tried to learn them through online resources and found methods like chi-square, variance threshold, F-test, Mutual ...
0
votes
0answers
12 views
Dimensionality Reduction. How to explain dynamics of feature subset based on all features data?
I have features: f1..f1000. I want to explain dynamics of particular features subset: f1-f5 based on all features data (based on ...
0
votes
0answers
20 views
How to convert score to probability [closed]
we have 1000 clients and 10 marketing compaings. we can send each person only one sms with one offer. Each offer should not be more then 100 sms. So we use Xgboost to score whether this compaing will ...
-1
votes
0answers
13 views
List of Machine Learning Algorithms for analyzing continuous variables? [closed]
If I had a set of parameters/variables and a set of output values. How could I know which parameters are actually contributing to the cause of the output values? Could I use feature selection methods ...
0
votes
0answers
17 views
How to load model using Microsoft.ML.Tensorflow?
I'm trying to load model using tensorflow. The model is converted from .h5 to .pb using this method:
...
0
votes
0answers
12 views
How to convert model.h5 to model.pb?
I wrote in google-collab to get the model using keras, but I have to do predictions in Visual Studio using tensorflow
I've search for a method converting models from keras .h5 to tensorflow .pb, but ...
0
votes
0answers
19 views
Getting Different Class output and Probability when predicting from model.predict and after deploying model with flask
For Binary classification problem,I am getting Different Class output and Probability for test data when predicting from model.predict and with deployed model with flask. In model.predict I am getting ...
0
votes
1answer
62 views
How to predict whether the client will renew the subscription or not based on given data structure
I have a requirement where I want to predict whether the client will renew the subscription or not.
And the data is something like below.
Basically client's subscription end date can be anything. ...
0
votes
0answers
19 views
Feature Engineering in Multi-class Classification
I am working on a 3 class classification problem. I am curious on what is the best way to bin continuous variables for this problem.
When I worked previously on 2 class problems, for examples sale ...
0
votes
1answer
32 views
what should i learn for deep learning [closed]
i have studied the basic of machine learning ,algebra ,statics and probability.now i want start with deep learning for field of image recognition,classification.
i don't know where to start deep ...
2
votes
0answers
26 views
How to cluster a set of objects each with its' own set of data?
I have a problem where I have a set of objects (say smartphones for ease of explanation). For each phone, we collected several characteristic features (such as duration of calls, how many calls made, ...
2
votes
1answer
28 views
Can a Logsitic Regression model continue making predictions after removing predictions from the data set?
I have a logistic regression model that predicts churn (0 vs. 1). I was asked to use the model to predict on a historical group of non-churners, remove anyone who was marked as a churner, and then ...
1
vote
1answer
40 views
Random Forest Prediction
Let's say I want to classify if the employee will churn or not. In my random forest, I have 6 estimators where 3 of them predict the employee to churn and the other estimators predict the employee to ...
0
votes
0answers
8 views
Is it possible to map micro clusters in density based stream clustering into the grid in grid based stream clustering?
In hybrid micro-cluster and grid based stream clustering, the incoming data points are first map in the micro cluster and if it do not fit in any cluster then it is mapped to the grid. Upon reaching a ...
0
votes
0answers
22 views
The Difference between One Hot Encoding and LabelEncoder? [duplicate]
I am working on a ML problem to predict house prices and Zip Code is one feature which will be useful. I am also trying to use ...
0
votes
0answers
16 views
At what value of Accuracy of train and test we can say Model is overfitting and Underfitting? [duplicate]
At what value of Accuracy of train and test we can say Model is overfitting and Under-fitting?
1
vote
1answer
11 views
Keras: Misunderstanding what Keras does when invoking a Model, providing an Input?
In a class named Generator, I have defined a model with the below method define_model:
...
4
votes
1answer
54 views
Understanding why shuffling reduces weirdly the overfit
I am a student currently trying to create a classification model, however I am having difficulty understanding a weird overfitting problem.
A dataset of about 30 000 entries, 30 features. The data is ...
0
votes
1answer
18 views
Using strong predictor in Model training?
I am trying to build a Disease predictor based on symptoms. I am using data scraped from Symcat website. After sampling the data we have symptoms to disease mapped for training purpose.Data looks like ...
0
votes
1answer
28 views
Is a new datapoint similar to my reference set?
I have a large reference data set and everyday I get new data points.
I would like to know how can I test if those new data points are similar to the reference set?
Thanks in advance.
Maria
1
vote
1answer
27 views
Repeated training and testing in Weka?
I am using one file for training (e.g train.arff) and another for testing (e.g test.atff) with the 70-30 ratio in Weka. I want to ask how can I use the repeated training/testing in Weka when I have ...
1
vote
0answers
14 views
0
votes
0answers
48 views
Handling different length string features and prediction of these based on other features
I am currently working on a problem where the dataset contains 200+ features (Let's call them the code features, e.g no.of.loops, memoryInst, loadInst, etc and Flags that are used to compile code ...
0
votes
1answer
29 views
Why we add a constant value column in our DataFrame sometimes?
Currently I'm learning data science and I'm in the beginners stage. I have seen many times we add a "constant" column in our data frame with all row cells of that column having value 1.
I need to ...
2
votes
2answers
26 views
SMOTE on training data
The SMOTE could only be performed on the training data, so how can we do it using Weka? It means we have to put the training and test data in two separate files and run the SMOTE on the training file, ...
0
votes
0answers
28 views
How to test model accuracy on new vs. historical data?
I created an XG Boost model to predict churn using a dataset of customers who were sold during 2018. The accuracy of the model is 89%. Does it make more sense to re-pull the 2018 dataset, where more ...
0
votes
1answer
32 views
PicklingError: Could not serialize object: TypeError: can't pickle fasttext_pybind.fasttext objects
I built a fasttext classification model in order to do sentiment analysis for facebook comments (using pyspark 2.4.1 on windows). When I use the prediction model function to predict the class of a ...
1
vote
1answer
30 views
Inputs required for Random Forest Regressor and ways to improve performance
I am using Random Forest Regressor to predict inventory needs. The data I am using to train the model lists the total quantity picked for each product per date, but does not include rows where total ...
0
votes
1answer
18 views
Learn the evaluation matrix for hire a job candidate
Let us assume that we have a certain number of features that are weighted with some parameters . The features could be the different skills that belongs to a job candidate applying for a job ...
0
votes
2answers
38 views
How do you apply hypothesis testing to your features?
How do you apply hypothesis testing to your features in a ML model? Let say for example that I am doing a regression task and I want to cut some features (once I have trained my model) to increase ...
0
votes
2answers
20 views
How to display the entire output and not shortened versions
I'm trying to display all the columns in my dataset that have NaN values:
print(train.isnull().sum())
The output that I get is ...
0
votes
0answers
9 views
H2o Flow Model creation Notification for external application
I have a requirement.I would like to trigger an event from h2o flow (through RESTful API preferably) whenever I create a model in h2o flow webUI - for.e.g ,the moment I create model M1,I would like my ...
0
votes
0answers
17 views
hardware configuration for data science
I would like to know what type of computer configuration to use to perform datascience on medium to low quantity of data (< 100 000 matrix line x 50 parameters).
I have read some blog on people ...
0
votes
0answers
16 views
How to use ML in improving cv search experience?
Need your recommendation to start the followings-
I am working on a case study where I need to improve search experience in a job portal using Data Science/Machine Learning.
I have two types of ...
2
votes
0answers
54 views
Can we use log transformation for outliers?
I am doing analysis on telecom churn dataset. I have 4617 observations and 17 variables. I am using Python. I have the following questions,
1) When I skewness and kurtosis for the normality test, two ...
0
votes
1answer
25 views
Making Inference from a Correlation Heatmap
I have constructed a Heatmap of my dataset for visualization. I have searched on various sites regarding what can I infer from the heatmap and I am unable to get any clear understanding from them. I ...
0
votes
1answer
39 views
Dataset columns throwing KeyError
For some reason, the columns in my dataset are throwing the following KeyError:
...
0
votes
1answer
34 views
Effect of skewness in data
I am preparing classification model. Many of numeric variables are positives skewed. Should I change a distribution of variables to be more Gaussian?
0
votes
0answers
10 views
What are the pros and cons of using Azure ML studio in developing ML algorithms compared to native python development approach?
What are the pros and cons of using Azure ML studio in developing ML algorithms compared to native python development approach ?
0
votes
3answers
22 views
How to find the driver features towards a particular result in Classification problems
In a classifier model, we can predict the outcome class, but here I need to find out the features that drive towards a particular result in a classification problem, that are a strong indicator of a ...
