What's the deal with Deno? We talk with a major contributor to find out. Listen now.

Questions tagged [data-science-model]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
94 views

Number of filters in Convolutional Neural Networks

How do I know how many filters to choose? And how does the neural network learn and adjust the filters? Thanks!
1
vote
2answers
64 views

Feature selection filter methods

I am confused about when to use which filter methods for feature selection. I tried to learn them through online resources and found methods like chi-square, variance threshold, F-test, Mutual ...
0
votes
0answers
14 views

Dimensionality Reduction. How to explain dynamics of feature subset based on all features data?

I have features: f1..f1000. I want to explain dynamics of particular features subset: f1-f5 based on all features data (based on ...
2
votes
3answers
5k views

How to convert model.h5 to model.pb?

I wrote in google-collab to get the model using keras, but I have to do predictions in Visual Studio using tensorflow I've search for a method converting models from keras .h5 to tensorflow .pb, but ...
0
votes
0answers
42 views

Getting Different Class output and Probability when predicting from model.predict and after deploying model with flask

For Binary classification problem,I am getting Different Class output and Probability for test data when predicting from model.predict and with deployed model with flask. In model.predict I am getting ...
1
vote
1answer
107 views

How to predict whether the client will renew the subscription or not based on given data structure

I have a requirement where I want to predict whether the client will renew the subscription or not. And the data is something like below. Basically client's subscription end date can be anything. And ...
0
votes
1answer
147 views

Feature Engineering in Multi-class Classification

I am working on a 3 class classification problem. I am curious on what is the best way to bin continuous variables for this problem. When I worked previously on 2 class problems, for examples sale ...
0
votes
1answer
40 views

what should i learn for deep learning [closed]

i have studied the basic of machine learning ,algebra ,statics and probability.now i want start with deep learning for field of image recognition,classification. i don't know where to start deep ...
2
votes
0answers
31 views

How to cluster a set of objects each with its' own set of data?

I have a problem where I have a set of objects (say smartphones for ease of explanation). For each phone, we collected several characteristic features (such as duration of calls, how many calls made, ...
2
votes
1answer
38 views

Can a Logsitic Regression model continue making predictions after removing predictions from the data set?

I have a logistic regression model that predicts churn (0 vs. 1). I was asked to use the model to predict on a historical group of non-churners, remove anyone who was marked as a churner, and then ...
1
vote
1answer
62 views

Random Forest Prediction

Let's say I want to classify if the employee will churn or not. In my random forest, I have 6 estimators where 3 of them predict the employee to churn and the other estimators predict the employee to ...
0
votes
0answers
30 views

The Difference between One Hot Encoding and LabelEncoder? [duplicate]

I am working on a ML problem to predict house prices and Zip Code is one feature which will be useful. I am also trying to use ...
1
vote
1answer
32 views

Keras: Misunderstanding what Keras does when invoking a Model, providing an Input?

In a class named Generator, I have defined a model with the below method define_model: ...
4
votes
1answer
397 views

Understanding why shuffling reduces weirdly the overfit

I am a student currently trying to create a classification model, however I am having difficulty understanding a weird overfitting problem. A dataset of about 30 000 entries, 30 features. The data is ...
0
votes
1answer
36 views

Using strong predictor in Model training?

I am trying to build a Disease predictor based on symptoms. I am using data scraped from Symcat website. After sampling the data we have symptoms to disease mapped for training purpose.Data looks like ...
0
votes
1answer
35 views

Is a new datapoint similar to my reference set?

I have a large reference data set and everyday I get new data points. I would like to know how can I test if those new data points are similar to the reference set? Thanks in advance. Maria
1
vote
1answer
92 views

Repeated training and testing in Weka?

I am using one file for training (e.g train.arff) and another for testing (e.g test.atff) with the 70-30 ratio in Weka. I want to ask how can I use the repeated training/testing in Weka when I have ...
0
votes
0answers
54 views

Handling different length string features and prediction of these based on other features

I am currently working on a problem where the dataset contains 200+ features (Let's call them the code features, e.g no.of.loops, memoryInst, loadInst, etc and Flags that are used to compile code ...
0
votes
1answer
276 views

Why we add a constant value column in our DataFrame sometimes?

Currently I'm learning data science and I'm in the beginners stage. I have seen many times we add a "constant" column in our data frame with all row cells of that column having value 1. I need to ...
2
votes
2answers
64 views

SMOTE on training data

The SMOTE could only be performed on the training data, so how can we do it using Weka? It means we have to put the training and test data in two separate files and run the SMOTE on the training file, ...
0
votes
0answers
45 views

How to test model accuracy on new vs. historical data?

I created an XG Boost model to predict churn using a dataset of customers who were sold during 2018. The accuracy of the model is 89%. Does it make more sense to re-pull the 2018 dataset, where more ...
1
vote
1answer
2k views

PicklingError: Could not serialize object: TypeError: can't pickle fasttext_pybind.fasttext objects

I built a fasttext classification model in order to do sentiment analysis for facebook comments (using pyspark 2.4.1 on windows). When I use the prediction model function to predict the class of a ...
1
vote
1answer
37 views

Inputs required for Random Forest Regressor and ways to improve performance

I am using Random Forest Regressor to predict inventory needs. The data I am using to train the model lists the total quantity picked for each product per date, but does not include rows where total ...
0
votes
1answer
32 views

Learn the evaluation matrix for hire a job candidate

Let us assume that we have a certain number of features that are weighted with some parameters . The features could be the different skills that belongs to a job candidate applying for a job ...
0
votes
2answers
216 views

How do you apply hypothesis testing to your features?

How do you apply hypothesis testing to your features in a ML model? Let say for example that I am doing a regression task and I want to cut some features (once I have trained my model) to increase ...
0
votes
2answers
37 views

How to display the entire output and not shortened versions

I'm trying to display all the columns in my dataset that have NaN values: print(train.isnull().sum()) The output that I get is ...
0
votes
0answers
56 views

hardware configuration for data science

I would like to know what type of computer configuration to use to perform datascience on medium to low quantity of data (< 100 000 matrix line x 50 parameters). I have read some blog on people ...
2
votes
1answer
1k views

Tips on how to preprocess data and outliers for churn analysis

I am doing analysis on telecom churn dataset. I have 4617 observations and 17 variables. I am using Python. I have the following questions, 1) When I skewness and kurtosis for the normality test, two ...
1
vote
1answer
437 views

Making Inference from a Correlation Heatmap

I have constructed a Heatmap of my dataset for visualization. I have searched on various sites regarding what can I infer from the heatmap and I am unable to get any clear understanding from them. I ...
0
votes
1answer
4k views

Dataset columns throwing KeyError

For some reason, the columns in my dataset are throwing the following KeyError: ...
0
votes
2answers
97 views

Effect of skewness in data

I am preparing classification model. Many of numeric variables are positives skewed. Should I change a distribution of variables to be more Gaussian?
0
votes
3answers
30 views

How to find the driver features towards a particular result in Classification problems

In a classifier model, we can predict the outcome class, but here I need to find out the features that drive towards a particular result in a classification problem, that are a strong indicator of a ...
2
votes
2answers
87 views

Supervised learning approach - creating my own labels

Scenario - I have data that does not have labels but I can create a function to label the data based on behavior and deploy the model so I don't have to keep labeling the data. Is this considered ...
0
votes
2answers
46 views

How to fit a model to the V-shaped data?

I have a dataset of chromatic and monochromatic galaxy fluxes which looks like inverted V shape as follows: ...
1
vote
2answers
262 views

Where to store dataset when creating neural network models and using github?

I have been recommended to use GitHub for all my coding projects as it is a great way to demonstrate to employers what you have been working on as well as just sharing anything you have created that ...
0
votes
1answer
153 views

How to predict number of orders for coming weeks using previous week's data?

I'm getting confused as how to proceed for this problem: I need to predict a city's food supply, for number of orders, for the upcoming weeks based on previous weeks' data. What should I do? Do I ...
1
vote
1answer
61 views

If the entire production dataset is known is advance, should I use it when fitting normalization parameters?

I found in multiple sources the recommendation not to fit the normalization parameters on the combined train/test dataset when evaluating the model, to prevent data leakage. I presume this ...
1
vote
0answers
17 views

Prediction that a Employee can take a leave or not based on his previous track record

which prediction algorithm should I use to find the probability that an employee takes leave and come back on the specified period(i.e.does does not extend his leave). Thank You.
2
votes
0answers
20 views

Best practices for scaling data science / engineering teams

I am trying to find best practices for scaling data science teams, i.e find an efficient workflow/methodology to divide work between Software Engineers and Researchers working on a same product. I’...
1
vote
0answers
23 views

What approach should I take to model forecasting problem in machine learning?

I have a dataset which contains 4000k rows and 6 columns. The goal is to predict travel time demand of a taxi. I have read many articles regarding how to approach the problem. So, every writer tell ...
0
votes
1answer
568 views

Predicting future automobile sales

I am new to Machine Learning. Recently I am trying to build a model to predict the sales of a particular automobile make and model of a dealership and to which location. The data given to me has ...
1
vote
1answer
52 views

How to create feature representation?

Let's say I've a dataset with 800 rows(40 entries for each of 20 users). The entries are user session log ( columns are - browser, os, time, date etc for a specific session). Now each user has unique ...
2
votes
1answer
61 views

B.Tech Project for final year of College

I am an Engineering student in NSIT, Delhi, India. In our last year of B.Tech degree we have a B.Tech project, aka, BTP. I am in ECE(Electronics and Communication Engineering) dept. Usually, my ECE ...
0
votes
0answers
86 views

How to plot a wordCloud for essay text from a confusion matrix false positive rate count?

I have an essay of text(BOW) and I have modelled it using let's say any model and plotted the confusion matrix and that I have got FPR, I need to plot a word cloud which shows the words due to which ...
0
votes
1answer
77 views

What is the standard model for CNN to compare against other classifier technique?

I have created a new method to do binary image classification. I think it would be interesting to compare it to the convolutional neural network that would do the same binary classification given the ...
3
votes
1answer
3k views

How to Use Shap Kernal Explainer with Pipeline models?

I have a pandas DataFrame X. I would like to find the prediction explanation of a a particular model. My model is given below: ...
1
vote
2answers
132 views

What should I check if model accuracy is no better than baseline level(random guess)

I have a data with only 8 columns: id created_time employee_id rank position hourly price num_work_completed work_category hired Hired is the target variable with 1 representing hired and 0 ...
0
votes
3answers
67 views

How to approach this data set for linear regression?

I am new to data science and am currently working on a data science project and have to answer a few questions about the following data set with 18k data points: https://www.kaggle.com/karangadiya/...
0
votes
1answer
2k views

What is Difference Between np.zeros() and np.empty() [duplicate]

Can Anyone Please Explain me the Difference Between them In Terms Of Any Operation or Computation and Values Stored in them

1
4
5
6 7 8