Questions tagged [data-science-model]
The data-science-model tag has no usage guidance.
260
questions
0
votes
0answers
15 views
How to validate regex based Resume parser efficiently
I am using rule based logic to extract features from resume. Basically I am trying to find if the candidate switched the company in less than 1 year. So I have the code in place to find it using ...
1
vote
1answer
17 views
Feature extraction from Resume using Python without rule based logic
I am working on Resume parser project. Currently I am using rule based regex to extract features like University, Experience, Large Companies etc.
So Basically I have a set of Universities name in a ...
0
votes
0answers
26 views
What is the difference between “fit_transform” and “transform” methods when using “SimpleImputer”? [duplicate]
I have following code, I am not able to understand the difference between use of fit_transform() and transform() method in this ...
1
vote
0answers
10 views
Using Kfold on a facial landmarks model
i am currently working with helen dataset to predict facial landmarks. Currently running the program on a Geforce 1070. The highest batch size i can give is 230 and i am getting a loss of 3 and ...
2
votes
1answer
26 views
Multiclassification Error: NotFittedError: This MultiLabelBinarizer instance is not fitted yet
After picking the model, when I try to use it, I am getting error -
"NotFittedError: This MultiLabelBinarizer instance is not fitted yet.
Call 'fit' with appropriate arguments before using this ...
1
vote
1answer
30 views
what are the steps in adaboosting?
I went through adaboost tutorial and below are my simplified understanding:
Sample weight of equal value is given to all sample in dataset.
Stumps are created which uses only one feature from data ...
1
vote
0answers
20 views
How to calculate precision and recall?
There is a class-imbalanced labeled dataset with 100'000 samples. 90'000 is "0" and 10'000 is "1". There is a model that predicts the labels. It was runned on the class-balanced (10'000 of "0" and 10'...
5
votes
3answers
30 views
How does one define the possibility space of valid priors (models)?
When one trains a model on data of any complexity one inevitably ends up with a one particular model among a vast many possible models that would make similar (or even, the same) predictions.
For ...
1
vote
0answers
13 views
Correct interpretation of summary_plot shap graph
While through the various resources online to understand the shap plots, I ended up slightly confused. Find below my interpretation of the overall plot given in examples -
Shap value 0 for a feature ...
1
vote
0answers
14 views
regression model assumption [migrated]
I try to check whether my regression model is follow regression assumption or not? for that I did below python code but response is error. can someone explain how it wrong
...
1
vote
1answer
34 views
Differences between normalization and standarization in multiple regression
Consider the following question regarding multiple regression
1) Can someone explain why we have to transform dependent variable using log-transformation (Normalization) when appear positive skewed y ...
2
votes
1answer
30 views
how to determine percentage below which a feature can be removed from a model
Let feature $feat$ contain one value $A$ that occurs 5% of the time, while 95% of the time it is empty.
Instead of arbitrary saying features that have less than 5% should not be included into the ...
0
votes
0answers
14 views
0
votes
0answers
14 views
how to log transformation works, In what case we need to do log transformation
I am a newbie to machine learning, I am doing binary classification problem, I have some data, IN that data one of the columns having some float data. I plot data, The Data looks like this
My column ...
0
votes
0answers
11 views
Bayesian/Frequentist “philosophies” in relation to common ML models
Starting to think about questions tout could come up in a data science job interview, there is this one question that is bugging me since i don't have a deep background in statistics.
I have a ...
0
votes
0answers
23 views
Help required for medical imaging research | Deep Learning Project
I am a cs student currently working on Brain tumour segmentation using cascading of two U-Net research project. I have researched over the internet about the cascading of CNN but I found nothing about ...
0
votes
1answer
22 views
NLP: Getting the top 5 or top 10 predictions
I am working on a social networking application and I have to make its news feed better. For example: If someone searches for 'suggest me some good books', it should yield some names.
Now, I have ...
1
vote
1answer
29 views
How to use weights from our data set properly? Should we use them at all?
The census data set I'm using: https://archive.ics.uci.edu/ml/datasets/Adult
So, I'm currently using this census data to make observations and predict whether someone is married or not. However, when ...
0
votes
0answers
10 views
How far I can apply ARIMA forecast algorithm to my model?
I created a ARIMA model with 1224 month wise data (102 years - From Jan 1900 to Dec 2002), totalling to 1224 data items. How far I can forecast. Typically i got some pattern in forecast only for 36 ...
1
vote
1answer
14 views
Error while using predict [closed]
After splitting into test and train the glm function is used on train set. For example
m1 = glm(target ~ ., data = train, family="binomial")
Then
...
0
votes
2answers
30 views
Logistic regression threshold value
How can i set the threshold value for the target variable. For example if a target variable is chance_of_admit and it has values from 0 to 1, how can I pick a value and so that I can convert it to 0's ...
0
votes
2answers
26 views
How to reduce the Root mean square error
I have dataset which describe "how many passenger arriving in some airport " and I would like to predict how many passenger arriving in monthly bases for next year. The features that I have is the ...
1
vote
0answers
21 views
Hypothesis Testing- Independent variable Importance
I am learning Data Science and I have a confusion in one topic. I would like to describe my approach.
I have understood the problem statement.
I have used snowflake schema to join tables that have ...
0
votes
0answers
9 views
Many to One LSTM; scientific Term
What is the Scientific Term for a Many to One LSTM ?
Picture from here
1
vote
3answers
52 views
How to handle “year” variable for Machine Learning models
I have a "year" variable but I don't know which is the best way to handle it for a ML model, as it is a numerical variable, giving some sequence. Should I treat it as a categorical variable?
Thanks ...
4
votes
1answer
68 views
SHAP value can explain right?
I face a problem with using SHAP value to interpret the Tree-based model.
(https://github.com/slundberg/shapsd)
First, I have input around 30 features and I have 2 features that have high positive ...
1
vote
0answers
26 views
types of metrics to evaluate the performance of regression models?
I have a conceptual question related to types of performance analysis of regression models.
In general we have -
R Square, Root Mean Squared Error and Mean squared Error to evaluate Regression ...
0
votes
1answer
28 views
Neural network is not giving the expected output after training in Python
My neural network is not giving the expected output after training in Python. Is there any error in the code? Is there any way to reduce the mean squared error (MSE)?
I tried to train (Run the ...
0
votes
1answer
15 views
What are the steps and correct order of the operations in Machine Learning? [from Getting data to optimising models]
I've followed lots of tutorials on Machine Learning but in each of these, they go for a different strategy so it's quite confusing for me. I want to Know that what are the operations involved and what ...
-1
votes
2answers
42 views
Activation Functions in Neural network
I have a set of questions related to the usage of various activation functions used in neural networks. I would highly appreciate if someone could give explanatory answers.
Why is ReLU is used only ...
0
votes
2answers
74 views
ML, Statistics and Mathematics
I have just started getting my hands wet in ML and every time I try delving deeper into the concepts/code, I face the challenges of the mathematics and its cryptic notations.
Coming from a Computer ...
0
votes
2answers
29 views
How to get an intution for generating Keras CNN layers for a model
I am going through tutorial for handwritten text recognition. And to do hand written digit recognition the author has constructed a Keras model as follows:
...
1
vote
2answers
27 views
Does the predict function in machine learning understand categorical data
I understand that before feature engineering one has to split the dataset into train and test data, so as to avoid bias in the analysis. I also understand that the machine learning model does not ...
0
votes
1answer
42 views
Binary classification: is there a tradeoff between predicting class 1 vs 0?
I have been digging much more in detail into classification performance metrics lately to get my head around the 'dynamics' of classification algorithms. What I have noticed is that in binary ...
1
vote
1answer
36 views
Scikit model is not able to predict sequence correctly
I am trying to create a regression model using scikit-learn for predicting car price. The input data are, car model(trim), kilometers used, past resale price of similar car and age of used car. I am ...
1
vote
1answer
10 views
suggestion for good online source according to Syllabus
Hi, are there some online courses e.g. some classes in Coursera?
I have difficulty in following the professor's teaching because I have a weak statistics background. I want to catch up by reading ...
0
votes
0answers
20 views
Best Method for Data Analysis on a 100 numerical IVs and 200 numerical DVs
I think I might need the help of this valuable community for a task. I have been given a dataset for 100 numerical independent variables (IVs) that predict output for 200 numerical values (from monte ...
1
vote
1answer
21 views
How to deal with annotation errors?
I know my annotators are not perfect, sometimes making mistakes. What would be the best way to deal with the annotation errors for my training data? Thanks!
0
votes
1answer
20 views
Where to get the Datascience Use cases for practice [duplicate]
I just started learning data science. I have gone through some of the courses in coursera & udemy, now i want to practice what i have learned. What i want to know is from where can i get the Use ...
0
votes
1answer
216 views
“ValueError: Index contains duplicate entries, cannot reshape” error when I try to use pd.MultiIndex.arrays
I have data which includes id , gender , collected time test name and Test values , Units of measurement
Test Names will include all tests that a patient taken and Value col will have its ...
0
votes
1answer
37 views
Is there room to improve the model? if the train data accuracy is 99.8% but test data accuracy is 90%?
I understand this is a wide question.
But there can be some suggestions.
I can try some methods which I do not know.
I think the model is already prefect on train data. But the test accuracy is a ...
1
vote
1answer
809 views
Tensorflow error: Input signature not matching inputs
I've been following Sentdex's tutorials on YouTube about Deep Learning and I've encountered and error while trying to load an image and run it through the model. The error says that the inputs do not ...
0
votes
1answer
28 views
Forecasting Consumption for Multiple Products for Multiple Regions
Came across a very interesting Real-World Time Series Forecast Problem.
Can you please help me understand the right track to resolve the below Time Series problem:
Input Data Sample:
and we want to ...
0
votes
1answer
31 views
-1
votes
1answer
29 views
0
votes
0answers
9 views
How to estimate claims for warranty analytics where continuous improvement reduces warranty claims?
I have a situation where a company who has warranty claims on its product and they want to know that is it possible for them to extend that. Now the case is that they do improvement on the existing ...
1
vote
2answers
140 views
What is the difference between a data-driven model and an empirical model?
Are they the same?
Empirical models, per Wikipedia, are
any kind of (computer) modelling based on empirical observations rather than on mathematically describable relationships of the system ...
-1
votes
1answer
25 views
How to interact two variables in python?
I have about 8 features as my predictors in a logistic model I am trying to fit in python. One of the features is TotalAward (Financial Aid) and the second is NEED. I am attempting to predict the ...
1
vote
0answers
19 views
What is the best approach to train a multi-category regression model?
What is the best approach to train a multi-category regression model (using XBoost decision trees ensemble)? What are the ups and downs of each one? For example, if I want to train a model to predict ...
1
vote
0answers
54 views
ValueError: Error when checking input: expected input_5 to have 4 dimensions, but got array with shape ()
I am trying to load a densenet-121 model pretrained on imagenet weights and train on my dataset. I have two files namely train.csv and validation.csv and I have splitted the train.csv file into 80-20 ...
