Questions tagged [data-science-model]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
15 views

How to validate regex based Resume parser efficiently

I am using rule based logic to extract features from resume. Basically I am trying to find if the candidate switched the company in less than 1 year. So I have the code in place to find it using ...
1
vote
1answer
17 views

Feature extraction from Resume using Python without rule based logic

I am working on Resume parser project. Currently I am using rule based regex to extract features like University, Experience, Large Companies etc. So Basically I have a set of Universities name in a ...
0
votes
0answers
26 views

What is the difference between “fit_transform” and “transform” methods when using “SimpleImputer”? [duplicate]

I have following code, I am not able to understand the difference between use of fit_transform() and transform() method in this ...
1
vote
0answers
10 views

Using Kfold on a facial landmarks model

i am currently working with helen dataset to predict facial landmarks. Currently running the program on a Geforce 1070. The highest batch size i can give is 230 and i am getting a loss of 3 and ...
2
votes
1answer
26 views

Multiclassification Error: NotFittedError: This MultiLabelBinarizer instance is not fitted yet

After picking the model, when I try to use it, I am getting error - "NotFittedError: This MultiLabelBinarizer instance is not fitted yet. Call 'fit' with appropriate arguments before using this ...
1
vote
1answer
30 views

what are the steps in adaboosting?

I went through adaboost tutorial and below are my simplified understanding: Sample weight of equal value is given to all sample in dataset. Stumps are created which uses only one feature from data ...
1
vote
0answers
20 views

How to calculate precision and recall?

There is a class-imbalanced labeled dataset with 100'000 samples. 90'000 is "0" and 10'000 is "1". There is a model that predicts the labels. It was runned on the class-balanced (10'000 of "0" and 10'...
5
votes
3answers
30 views

How does one define the possibility space of valid priors (models)?

When one trains a model on data of any complexity one inevitably ends up with a one particular model among a vast many possible models that would make similar (or even, the same) predictions. For ...
1
vote
0answers
13 views

Correct interpretation of summary_plot shap graph

While through the various resources online to understand the shap plots, I ended up slightly confused. Find below my interpretation of the overall plot given in examples - Shap value 0 for a feature ...
1
vote
0answers
14 views

regression model assumption [migrated]

I try to check whether my regression model is follow regression assumption or not? for that I did below python code but response is error. can someone explain how it wrong ...
1
vote
1answer
34 views

Differences between normalization and standarization in multiple regression

Consider the following question regarding multiple regression 1) Can someone explain why we have to transform dependent variable using log-transformation (Normalization) when appear positive skewed y ...
2
votes
1answer
30 views

how to determine percentage below which a feature can be removed from a model

Let feature $feat$ contain one value $A$ that occurs 5% of the time, while 95% of the time it is empty. Instead of arbitrary saying features that have less than 5% should not be included into the ...
0
votes
0answers
14 views
0
votes
0answers
14 views

how to log transformation works, In what case we need to do log transformation

I am a newbie to machine learning, I am doing binary classification problem, I have some data, IN that data one of the columns having some float data. I plot data, The Data looks like this My column ...
0
votes
0answers
11 views

Bayesian/Frequentist “philosophies” in relation to common ML models

Starting to think about questions tout could come up in a data science job interview, there is this one question that is bugging me since i don't have a deep background in statistics. I have a ...
0
votes
0answers
23 views

Help required for medical imaging research | Deep Learning Project

I am a cs student currently working on Brain tumour segmentation using cascading of two U-Net research project. I have researched over the internet about the cascading of CNN but I found nothing about ...
0
votes
1answer
22 views

NLP: Getting the top 5 or top 10 predictions

I am working on a social networking application and I have to make its news feed better. For example: If someone searches for 'suggest me some good books', it should yield some names. Now, I have ...
1
vote
1answer
29 views

How to use weights from our data set properly? Should we use them at all?

The census data set I'm using: https://archive.ics.uci.edu/ml/datasets/Adult So, I'm currently using this census data to make observations and predict whether someone is married or not. However, when ...
0
votes
0answers
10 views

How far I can apply ARIMA forecast algorithm to my model?

I created a ARIMA model with 1224 month wise data (102 years - From Jan 1900 to Dec 2002), totalling to 1224 data items. How far I can forecast. Typically i got some pattern in forecast only for 36 ...
1
vote
1answer
14 views

Error while using predict [closed]

After splitting into test and train the glm function is used on train set. For example m1 = glm(target ~ ., data = train, family="binomial") Then ...
0
votes
2answers
30 views

Logistic regression threshold value

How can i set the threshold value for the target variable. For example if a target variable is chance_of_admit and it has values from 0 to 1, how can I pick a value and so that I can convert it to 0's ...
0
votes
2answers
26 views

How to reduce the Root mean square error

I have dataset which describe "how many passenger arriving in some airport " and I would like to predict how many passenger arriving in monthly bases for next year. The features that I have is the ...
1
vote
0answers
21 views

Hypothesis Testing- Independent variable Importance

I am learning Data Science and I have a confusion in one topic. I would like to describe my approach. I have understood the problem statement. I have used snowflake schema to join tables that have ...
0
votes
0answers
9 views

Many to One LSTM; scientific Term

What is the Scientific Term for a Many to One LSTM ? Picture from here
1
vote
3answers
52 views

How to handle “year” variable for Machine Learning models

I have a "year" variable but I don't know which is the best way to handle it for a ML model, as it is a numerical variable, giving some sequence. Should I treat it as a categorical variable? Thanks ...
4
votes
1answer
68 views

SHAP value can explain right?

I face a problem with using SHAP value to interpret the Tree-based model. (https://github.com/slundberg/shapsd) First, I have input around 30 features and I have 2 features that have high positive ...
1
vote
0answers
26 views

types of metrics to evaluate the performance of regression models?

I have a conceptual question related to types of performance analysis of regression models. In general we have - R Square, Root Mean Squared Error and Mean squared Error to evaluate Regression ...
0
votes
1answer
28 views

Neural network is not giving the expected output after training in Python

My neural network is not giving the expected output after training in Python. Is there any error in the code? Is there any way to reduce the mean squared error (MSE)? I tried to train (Run the ...
0
votes
1answer
15 views

What are the steps and correct order of the operations in Machine Learning? [from Getting data to optimising models]

I've followed lots of tutorials on Machine Learning but in each of these, they go for a different strategy so it's quite confusing for me. I want to Know that what are the operations involved and what ...
-1
votes
2answers
42 views

Activation Functions in Neural network

I have a set of questions related to the usage of various activation functions used in neural networks. I would highly appreciate if someone could give explanatory answers. Why is ReLU is used only ...
0
votes
2answers
74 views

ML, Statistics and Mathematics

I have just started getting my hands wet in ML and every time I try delving deeper into the concepts/code, I face the challenges of the mathematics and its cryptic notations. Coming from a Computer ...
0
votes
2answers
29 views

How to get an intution for generating Keras CNN layers for a model

I am going through tutorial for handwritten text recognition. And to do hand written digit recognition the author has constructed a Keras model as follows: ...
1
vote
2answers
27 views

Does the predict function in machine learning understand categorical data

I understand that before feature engineering one has to split the dataset into train and test data, so as to avoid bias in the analysis. I also understand that the machine learning model does not ...
0
votes
1answer
42 views

Binary classification: is there a tradeoff between predicting class 1 vs 0?

I have been digging much more in detail into classification performance metrics lately to get my head around the 'dynamics' of classification algorithms. What I have noticed is that in binary ...
1
vote
1answer
36 views

Scikit model is not able to predict sequence correctly

I am trying to create a regression model using scikit-learn for predicting car price. The input data are, car model(trim), kilometers used, past resale price of similar car and age of used car. I am ...
1
vote
1answer
10 views

suggestion for good online source according to Syllabus

Hi, are there some online courses e.g. some classes in Coursera? I have difficulty in following the professor's teaching because I have a weak statistics background. I want to catch up by reading ...
0
votes
0answers
20 views

Best Method for Data Analysis on a 100 numerical IVs and 200 numerical DVs

I think I might need the help of this valuable community for a task. I have been given a dataset for 100 numerical independent variables (IVs) that predict output for 200 numerical values (from monte ...
1
vote
1answer
21 views

How to deal with annotation errors?

I know my annotators are not perfect, sometimes making mistakes. What would be the best way to deal with the annotation errors for my training data? Thanks!
0
votes
1answer
20 views

Where to get the Datascience Use cases for practice [duplicate]

I just started learning data science. I have gone through some of the courses in coursera & udemy, now i want to practice what i have learned. What i want to know is from where can i get the Use ...
0
votes
1answer
216 views

“ValueError: Index contains duplicate entries, cannot reshape” error when I try to use pd.MultiIndex.arrays

I have data which includes id , gender , collected time test name and Test values , Units of measurement Test Names will include all tests that a patient taken and Value col will have its ...
0
votes
1answer
37 views

Is there room to improve the model? if the train data accuracy is 99.8% but test data accuracy is 90%?

I understand this is a wide question. But there can be some suggestions. I can try some methods which I do not know. I think the model is already prefect on train data. But the test accuracy is a ...
1
vote
1answer
809 views

Tensorflow error: Input signature not matching inputs

I've been following Sentdex's tutorials on YouTube about Deep Learning and I've encountered and error while trying to load an image and run it through the model. The error says that the inputs do not ...
0
votes
1answer
28 views

Forecasting Consumption for Multiple Products for Multiple Regions

Came across a very interesting Real-World Time Series Forecast Problem. Can you please help me understand the right track to resolve the below Time Series problem: Input Data Sample: and we want to ...
0
votes
1answer
31 views
-1
votes
1answer
29 views

Finding most selling item everyday from dataset [closed]

Given a dataset: ...
0
votes
0answers
9 views

How to estimate claims for warranty analytics where continuous improvement reduces warranty claims?

I have a situation where a company who has warranty claims on its product and they want to know that is it possible for them to extend that. Now the case is that they do improvement on the existing ...
1
vote
2answers
140 views

What is the difference between a data-driven model and an empirical model?

Are they the same? Empirical models, per Wikipedia, are any kind of (computer) modelling based on empirical observations rather than on mathematically describable relationships of the system ...
-1
votes
1answer
25 views

How to interact two variables in python?

I have about 8 features as my predictors in a logistic model I am trying to fit in python. One of the features is TotalAward (Financial Aid) and the second is NEED. I am attempting to predict the ...
1
vote
0answers
19 views

What is the best approach to train a multi-category regression model?

What is the best approach to train a multi-category regression model (using XBoost decision trees ensemble)? What are the ups and downs of each one? For example, if I want to train a model to predict ...
1
vote
0answers
54 views

ValueError: Error when checking input: expected input_5 to have 4 dimensions, but got array with shape ()

I am trying to load a densenet-121 model pretrained on imagenet weights and train on my dataset. I have two files namely train.csv and validation.csv and I have splitted the train.csv file into 80-20 ...