Questions tagged [data-science-model]
The data-science-model tag has no usage guidance.
226
questions
0
votes
1answer
8 views
Where to get the Datascience Use cases for practice [duplicate]
I just started learning data science. I have gone through some of the courses in coursera & udemy, now i want to practice what i have learned. What i want to know is from where can i get the Use ...
0
votes
0answers
33 views
'Age' categorical (years -months -days ) to numeric and add a column to say which age group it belongs to [on hold]
I have a dataset with Age column which has data as follows:
df_s7['Age'].unique()
array(['28 Years', '10 Month(s) 15 Day(s)', '46 Years', '65 Years',
'...
0
votes
0answers
20 views
“ValueError: Index contains duplicate entries, cannot reshape” error when I try to use pd.MultiIndex.arrays
I have data which includes id , gender , collected time test name and Test values , Units of measurement
Test Names will include all tests that a patient taken and Value col will have its ...
0
votes
1answer
23 views
Is there room to improve the model? if the train data accuracy is 99.8% but test data accuracy is 90%?
I understand this is a wide question.
But there can be some suggestions.
I can try some methods which I do not know.
I think the model is already prefect on train data. But the test accuracy is a ...
0
votes
1answer
46 views
Tensorflow error: Input signature not matching inputs
I have been stuck on this one for awhile and I hate this website so I wouldn't post here unless I've tried everything else but I've been following Sentdex's tutorials on Youtube about Deep Learning ...
0
votes
0answers
11 views
Data Preprocessing in Python [closed]
1.) Please how can I use the rank transformation as a data Preprocessing technique? And what's it's effect?
2.) How is the np.log(1+x) also used in data Preprocessing and what's it's effect?
0
votes
1answer
14 views
Forecasting Consumption for Multiple Products for Multiple Regions
Came across a very interesting Real-World Time Series Forecast Problem.
Can you please help me understand the right track to resolve the below Time Series problem:
Input Data Sample:
and we want to ...
0
votes
0answers
4 views
Pandas dataframe manipulation [migrated]
I am working on cleaning a huge dataset using python. I have a data frame with 20,000 rows that looks like this:
...
0
votes
1answer
25 views
-1
votes
1answer
28 views
0
votes
0answers
8 views
How to estimate claims for warranty analytics where continuous improvement reduces warranty claims?
I have a situation where a company who has warranty claims on its product and they want to know that is it possible for them to extend that. Now the case is that they do improvement on the existing ...
1
vote
2answers
29 views
What is the difference between a data-driven model and an empirical model?
Are they the same?
Empirical models, per Wikipedia, are
any kind of (computer) modelling based on empirical observations rather than on mathematically describable relationships of the system ...
-1
votes
1answer
14 views
How to interact two variables in python?
I have about 8 features as my predictors in a logistic model I am trying to fit in python. One of the features is TotalAward (Financial Aid) and the second is NEED. I am attempting to predict the ...
1
vote
0answers
19 views
What is the best approach to train a multi-category regression model?
What is the best approach to train a multi-category regression model (using XBoost decision trees ensemble)? What are the ups and downs of each one? For example, if I want to train a model to predict ...
1
vote
0answers
19 views
ValueError: Error when checking input: expected input_5 to have 4 dimensions, but got array with shape ()
I am trying to load a densenet-121 model pretrained on imagenet weights and train on my dataset. I have two files namely train.csv and validation.csv and I have splitted the train.csv file into 80-20 ...
0
votes
1answer
12 views
Best practice on count of manual annotations for building criminal detection from news articles?
We have 7 million news articles corpus, which we want to classify into crimes or non-crimes and further identify criminals by using NERs/annotating criminals, crime manually. For creating a model that ...
0
votes
1answer
27 views
Clustering stores based on weekly data
I have 1 year transaction level data aggregated at a weekly level for 1000 different stores. I want to cluster similar stores based on 8 variables such as sales, customer count etc. The concern is ...
0
votes
1answer
20 views
Aggregate Categorical Data
I have a scenario in which I'm required to run my analysis at the Account level. One of the features that I'd like to look at is the no. of subscriptions against an account. There can be multiple ...
1
vote
1answer
17 views
Unsupervised Algorithm for hybrid data [duplicate]
I have a hybrid data that contains 15 categorical data and 4 continuous data.
I need to implement a prediction on the data. So as I don't have any labeled data, I need to implement the unsupervised ...
1
vote
1answer
27 views
Checking if ML model is possible
How can I check if a machine learning model is feasible on a given dataset? What techniques like EDA, correlation etc. can be used to judge if a model is possible i.e. data and predictor variables ...
0
votes
0answers
6 views
Determining the number of Gaussian components in a mixture of Gaussians
Shown here is a Gaussian mixture. Would like to know how to best determine the number of Gaussian components that produce this data? This is not a simulated dataset, so the small components that are ...
0
votes
1answer
23 views
Counting the transition in a dataframe overtime
I am stuck at a problem and am thinking how to come out of it. I want to write a code in python with dataframe as below:
data = {'Id':['a', 'a', 'b', 'b', 'c', 'c'],
'value':['Active', '...
1
vote
1answer
29 views
Gaussian Mixture Models Clustering
When using the EM algorithm in Gaussian Mixture Models (GMM), in the E-step, we take each x set in the training dataset to calculate and update the "weight" and parameters of each Gaussian ...
0
votes
0answers
7 views
Sequence prediction model choice
I am working on log data. I extract each user's history usage, and get his sessions into a file containing all the pages visited during all his sessions (each session in a line), sequences have ...
2
votes
0answers
16 views
Step extraction from a paragraph
Came across an interesting problem:
Given a paragraph describing how to do a process, need to break it down to various steps. Basically, need to determine for each sentence in the paragraph, if this ...
0
votes
0answers
15 views
Finding features that influence net revenue
Using machine learning I would like to identify features that influence net revenue and make conclusions from data based on that. The data set is a car sharing ...
0
votes
0answers
50 views
Inconsistent inference results in deeplab v3+
I trained and exported the model as suggested in :https://github.com/tensorflow/models/tree/master/research/deeplab.
The validation results saved using vis.py are fine but when I apply demo code for ...
0
votes
1answer
27 views
How to use a a trained model
I just trained my first model in Python 3.7/scikitlearn (Linear Regression) (well I copied most of the code but its something ^^).
Now I want to actually Use the model. Specifically its about sons ...
0
votes
0answers
10 views
Is it possible to build an intelligent lead classifier with just a few training units
I want to build a lead classifier for my Master Thesis and wanted to ask for an assessment of feasibility.
Here are the key points:
(1) We have 15 customers and about 100 opportunities of which we ...
0
votes
1answer
15 views
How to split the data as per the label name count using sklearn
Before training a model, I would like to split the data in a 80/20 ratio.
For example, in my dataset of 3000 rows, I have different labels. Out of which A is one label name, has 100 records in the ...
0
votes
0answers
7 views
Soft Margin SVM kernels
Kernels are used to map datasets into higher dimensions so that they could be linearly separable. However, if we introduce the slack variable in the soft margin SVM, we are allowing some mistakes, and ...
0
votes
0answers
10 views
Support Vector Machine (SVM) kernels
I learned that Kernels in SVMs are used to map the datasets into a higher dimension to make it more linearly separable, and the kernels will produce only the result, so we don't even have to know what ...
0
votes
0answers
21 views
Recommendation system without user data
I have a recommendation project to build without user data.
Suppose I am building a initial recommendation system with the initial dataset with me only consisting of
...
0
votes
1answer
19 views
Can we Create Neural network(Simple one such as Multi Layer perceptron) that only contains positive weights only?
I was wondering if there is a specific method to create a well performing neural network with only positive weights (I already tried clipping the weight before training or so and initializing the ...
0
votes
1answer
35 views
Error using decision tree regressor [closed]
I'm new to data science , while i'm implementing decision tree. I'm facing the following error. Where i went wrong;
Sample data in csv is:
...
2
votes
1answer
95 views
How to correctly set a target for a time series based model?
I need help determining the best way to go about creating the target variable for a machine learning model that is trading a financial instrument (stocks, foreign currencies, crpyto, etc).
Below is ...
0
votes
1answer
38 views
GPS generate street [closed]
I am working on GPS tracking with a huge data from vehicle.
Dataset have: vehicleId, speed, orientation(0-360), coordinate (x,y) and timestamp.
Can you recommend me how to clean data and model to ...
1
vote
1answer
24 views
How do we decide on the classification algorithm to use with huge training size?
I am solving a questions binary classification problem and the training size for this is huge(291 billion). The data has bloated because of using tfidfvectorizerfor ...
2
votes
2answers
67 views
Procedure for selecting optimal number of features with Python's Scikit-Learn
I have a dataset with 130 features (1000 rows) . I want to select the best features for my classifier. I started with RFE but Its taking too long, i done this:
<...
-1
votes
1answer
57 views
How Retail Analytics Project Can Be Done?
I have a project and I couldn't understand what I have to do because I am new with retail analytics.
They said "Our goal is to measure the effects of promotion on sales" and "Your goal is to model ...
1
vote
1answer
9 views
SMOTE for multi-instance learning i.e num_rows(x_train) > num_rows(y_train)
I have an imbalanced dataset and I wish to predict classes(0 or 1).
Sample x_train:
...
0
votes
4answers
41 views
How to know if my Decision tree model is good or bad?
I built a decision tree model and am not sure if it is good or bad. Could you help to evaluate my model?
My code:
...
0
votes
1answer
34 views
Number of filters in Convolutional Neural Networks
How do I know how many filters to choose? And how does the neural network learn and adjust the filters?
Thanks!
1
vote
2answers
33 views
Feature selection filter methods
I am confused about when to use which filter methods for feature selection. I tried to learn them through online resources and found methods like chi-square, variance threshold, F-test, Mutual ...
0
votes
0answers
12 views
Dimensionality Reduction. How to explain dynamics of feature subset based on all features data?
I have features: f1..f1000. I want to explain dynamics of particular features subset: f1-f5 based on all features data (based on ...
0
votes
0answers
43 views
How to load model using Microsoft.ML.Tensorflow?
I'm trying to load model using tensorflow. The model is converted from .h5 to .pb using this method:
...
0
votes
0answers
70 views
How to convert model.h5 to model.pb?
I wrote in google-collab to get the model using keras, but I have to do predictions in Visual Studio using tensorflow
I've search for a method converting models from keras .h5 to tensorflow .pb, but ...
0
votes
0answers
19 views
Getting Different Class output and Probability when predicting from model.predict and after deploying model with flask
For Binary classification problem,I am getting Different Class output and Probability for test data when predicting from model.predict and with deployed model with flask. In model.predict I am getting ...
1
vote
1answer
75 views
How to predict whether the client will renew the subscription or not based on given data structure
I have a requirement where I want to predict whether the client will renew the subscription or not.
And the data is something like below.
Basically client's subscription end date can be anything. ...
0
votes
1answer
24 views
Feature Engineering in Multi-class Classification
I am working on a 3 class classification problem. I am curious on what is the best way to bin continuous variables for this problem.
When I worked previously on 2 class problems, for examples sale ...
