Questions tagged [data-science-model]
The data-science-model tag has no usage guidance.
239
questions
0
votes
2answers
14 views
How to reduce the Root mean square error
I have dataset which describe "how many passenger arriving in some airport " and I would like to predict how many passenger arriving in monthly bases for next year. The features that I have is the ...
1
vote
0answers
21 views
Hypothesis Testing- Independent variable Importance
I am learning Data Science and I have a confusion in one topic. I would like to describe my approach.
I have understood the problem statement.
I have used snowflake schema to join tables that have ...
0
votes
0answers
5 views
Many to One LSTM; scientific Term
What is the Scientific Term for a Many to One LSTM ?
Picture from here
0
votes
2answers
33 views
How to handle “year” variable for Machine Learning models
I have a "year" variable but I don't know which is the best way to handle it for a ML model, as it is a numerical variable, giving some sequence. Should I treat it as a categorical variable?
Thanks ...
4
votes
1answer
56 views
SHAP value can explain right?
I face a problem with using SHAP value to interpret the Tree-based model.
(https://github.com/slundberg/shapsd)
First, I have input around 30 features and I have 2 features that have high positive ...
1
vote
0answers
20 views
types of metrics to evaluate the performance of regression models?
I have a conceptual question related to types of performance analysis of regression models.
In general we have -
R Square, Root Mean Squared Error and Mean squared Error to evaluate Regression ...
0
votes
1answer
26 views
Neural network is not giving the expected output after training in Python
My neural network is not giving the expected output after training in Python. Is there any error in the code? Is there any way to reduce the mean squared error (MSE)?
I tried to train (Run the ...
0
votes
1answer
14 views
What are the steps and correct order of the operations in Machine Learning? [from Getting data to optimising models]
I've followed lots of tutorials on Machine Learning but in each of these, they go for a different strategy so it's quite confusing for me. I want to Know that what are the operations involved and what ...
-1
votes
2answers
39 views
Activation Functions in Neural network
I have a set of questions related to the usage of various activation functions used in neural networks. I would highly appreciate if someone could give explanatory answers.
Why is ReLU is used only ...
0
votes
2answers
60 views
ML, Statistics and Mathematics
I have just started getting my hands wet in ML and every time I try delving deeper into the concepts/code, I face the challenges of the mathematics and its cryptic notations.
Coming from a Computer ...
0
votes
2answers
28 views
How to get an intution for generating Keras CNN layers for a model
I am going through tutorial for handwritten text recognition. And to do hand written digit recognition the author has constructed a Keras model as follows:
...
1
vote
2answers
27 views
Does the predict function in machine learning understand categorical data
I understand that before feature engineering one has to split the dataset into train and test data, so as to avoid bias in the analysis. I also understand that the machine learning model does not ...
0
votes
1answer
40 views
Binary classification: is there a tradeoff between predicting class 1 vs 0?
I have been digging much more in detail into classification performance metrics lately to get my head around the 'dynamics' of classification algorithms. What I have noticed is that in binary ...
1
vote
1answer
34 views
Scikit model is not able to predict sequence correctly
I am trying to create a regression model using scikit-learn for predicting car price. The input data are, car model(trim), kilometers used, past resale price of similar car and age of used car. I am ...
1
vote
1answer
10 views
suggestion for good online source according to Syllabus
Hi, are there some online courses e.g. some classes in Coursera?
I have difficulty in following the professor's teaching because I have a weak statistics background. I want to catch up by reading ...
0
votes
0answers
20 views
Best Method for Data Analysis on a 100 numerical IVs and 200 numerical DVs
I think I might need the help of this valuable community for a task. I have been given a dataset for 100 numerical independent variables (IVs) that predict output for 200 numerical values (from monte ...
1
vote
1answer
17 views
How to deal with annotation errors?
I know my annotators are not perfect, sometimes making mistakes. What would be the best way to deal with the annotation errors for my training data? Thanks!
0
votes
1answer
19 views
Where to get the Datascience Use cases for practice [duplicate]
I just started learning data science. I have gone through some of the courses in coursera & udemy, now i want to practice what i have learned. What i want to know is from where can i get the Use ...
0
votes
1answer
55 views
“ValueError: Index contains duplicate entries, cannot reshape” error when I try to use pd.MultiIndex.arrays
I have data which includes id , gender , collected time test name and Test values , Units of measurement
Test Names will include all tests that a patient taken and Value col will have its ...
0
votes
1answer
35 views
Is there room to improve the model? if the train data accuracy is 99.8% but test data accuracy is 90%?
I understand this is a wide question.
But there can be some suggestions.
I can try some methods which I do not know.
I think the model is already prefect on train data. But the test accuracy is a ...
1
vote
1answer
381 views
Tensorflow error: Input signature not matching inputs
I have been stuck on this one for awhile and I hate this website so I wouldn't post here unless I've tried everything else but I've been following Sentdex's tutorials on Youtube about Deep Learning ...
0
votes
1answer
24 views
Forecasting Consumption for Multiple Products for Multiple Regions
Came across a very interesting Real-World Time Series Forecast Problem.
Can you please help me understand the right track to resolve the below Time Series problem:
Input Data Sample:
and we want to ...
0
votes
1answer
30 views
-1
votes
1answer
29 views
0
votes
0answers
9 views
How to estimate claims for warranty analytics where continuous improvement reduces warranty claims?
I have a situation where a company who has warranty claims on its product and they want to know that is it possible for them to extend that. Now the case is that they do improvement on the existing ...
1
vote
2answers
71 views
What is the difference between a data-driven model and an empirical model?
Are they the same?
Empirical models, per Wikipedia, are
any kind of (computer) modelling based on empirical observations rather than on mathematically describable relationships of the system ...
-1
votes
1answer
18 views
How to interact two variables in python?
I have about 8 features as my predictors in a logistic model I am trying to fit in python. One of the features is TotalAward (Financial Aid) and the second is NEED. I am attempting to predict the ...
1
vote
0answers
19 views
What is the best approach to train a multi-category regression model?
What is the best approach to train a multi-category regression model (using XBoost decision trees ensemble)? What are the ups and downs of each one? For example, if I want to train a model to predict ...
1
vote
0answers
35 views
ValueError: Error when checking input: expected input_5 to have 4 dimensions, but got array with shape ()
I am trying to load a densenet-121 model pretrained on imagenet weights and train on my dataset. I have two files namely train.csv and validation.csv and I have splitted the train.csv file into 80-20 ...
0
votes
1answer
14 views
Best practice on count of manual annotations for building criminal detection from news articles?
We have 7 million news articles corpus, which we want to classify into crimes or non-crimes and further identify criminals by using NERs/annotating criminals, crime manually. For creating a model that ...
0
votes
1answer
28 views
Clustering stores based on weekly data
I have 1 year transaction level data aggregated at a weekly level for 1000 different stores. I want to cluster similar stores based on 8 variables such as sales, customer count etc. The concern is ...
0
votes
1answer
32 views
Aggregate Categorical Data
I have a scenario in which I'm required to run my analysis at the Account level. One of the features that I'd like to look at is the no. of subscriptions against an account. There can be multiple ...
1
vote
1answer
20 views
Unsupervised Algorithm for hybrid data [duplicate]
I have a hybrid data that contains 15 categorical data and 4 continuous data.
I need to implement a prediction on the data. So as I don't have any labeled data, I need to implement the unsupervised ...
1
vote
1answer
27 views
Checking if ML model is possible
How can I check if a machine learning model is feasible on a given dataset? What techniques like EDA, correlation etc. can be used to judge if a model is possible i.e. data and predictor variables ...
0
votes
0answers
7 views
Determining the number of Gaussian components in a mixture of Gaussians
Shown here is a Gaussian mixture. Would like to know how to best determine the number of Gaussian components that produce this data? This is not a simulated dataset, so the small components that are ...
0
votes
1answer
24 views
Counting the transition in a dataframe overtime
I am stuck at a problem and am thinking how to come out of it. I want to write a code in python with dataframe as below:
data = {'Id':['a', 'a', 'b', 'b', 'c', 'c'],
'value':['Active', '...
1
vote
1answer
33 views
Gaussian Mixture Models Clustering
When using the EM algorithm in Gaussian Mixture Models (GMM), in the E-step, we take each x set in the training dataset to calculate and update the "weight" and parameters of each Gaussian ...
0
votes
0answers
7 views
Sequence prediction model choice
I am working on log data. I extract each user's history usage, and get his sessions into a file containing all the pages visited during all his sessions (each session in a line), sequences have ...
2
votes
0answers
16 views
Step extraction from a paragraph
Came across an interesting problem:
Given a paragraph describing how to do a process, need to break it down to various steps. Basically, need to determine for each sentence in the paragraph, if this ...
0
votes
0answers
16 views
Finding features that influence net revenue
Using machine learning I would like to identify features that influence net revenue and make conclusions from data based on that. The data set is a car sharing ...
0
votes
0answers
65 views
Inconsistent inference results in deeplab v3+
I trained and exported the model as suggested in :https://github.com/tensorflow/models/tree/master/research/deeplab.
The validation results saved using vis.py are fine but when I apply demo code for ...
0
votes
1answer
33 views
How to use a a trained model
I just trained my first model in Python 3.7/scikitlearn (Linear Regression) (well I copied most of the code but its something ^^).
Now I want to actually Use the model. Specifically its about sons ...
0
votes
0answers
11 views
Is it possible to build an intelligent lead classifier with just a few training units
I want to build a lead classifier for my Master Thesis and wanted to ask for an assessment of feasibility.
Here are the key points:
(1) We have 15 customers and about 100 opportunities of which we ...
0
votes
1answer
20 views
How to split the data as per the label name count using sklearn
Before training a model, I would like to split the data in a 80/20 ratio.
For example, in my dataset of 3000 rows, I have different labels. Out of which A is one label name, has 100 records in the ...
1
vote
0answers
8 views
Soft Margin SVM kernels
Kernels are used to map datasets into higher dimensions so that they could be linearly separable. However, if we introduce the slack variable in the soft margin SVM, we are allowing some mistakes, and ...
0
votes
0answers
10 views
Support Vector Machine (SVM) kernels
I learned that Kernels in SVMs are used to map the datasets into a higher dimension to make it more linearly separable, and the kernels will produce only the result, so we don't even have to know what ...
0
votes
0answers
22 views
Recommendation system without user data
I have a recommendation project to build without user data.
Suppose I am building a initial recommendation system with the initial dataset with me only consisting of
...
0
votes
1answer
19 views
Can we Create Neural network(Simple one such as Multi Layer perceptron) that only contains positive weights only?
I was wondering if there is a specific method to create a well performing neural network with only positive weights (I already tried clipping the weight before training or so and initializing the ...
0
votes
1answer
40 views
Error using decision tree regressor [closed]
I'm new to data science , while i'm implementing decision tree. I'm facing the following error. Where i went wrong;
Sample data in csv is:
...
2
votes
1answer
102 views
How to correctly set a target for a time series based model?
I need help determining the best way to go about creating the target variable for a machine learning model that is trading a financial instrument (stocks, foreign currencies, crpyto, etc).
Below is ...
