Questions tagged [data-science-model]
The data-science-model tag has no usage guidance.
366
questions
0
votes
2answers
25 views
What is the value of AIC criterion if RSS is 0? [closed]
The AIC formula is :
$AIC = 2k + n Log(RSS/n)$
So if RSS is equal to 0, it is undefined. How do I deal with this? What value should it take?
4
votes
2answers
34 views
Sklearn: applying cost complexity pruning along with pipeline
I have a data set with categorical variables. I have defined a decision tree algorithm and transformed these columns to numerical equivalent using one hot encoding functionality in sklearn:
Create ...
0
votes
0answers
15 views
Getting different results on the same notebook ran on the Kaggle platform vs on google colab [closed]
Why am I getting different results on the same notebook ran on the Kaggle platform vs on google colab?
* Note: I am using lightgbm (version 2.3.0)regressor based on decision tree on both the platforms
...
0
votes
0answers
13 views
Variational Autoencoder with custom loss in Keras giving “nan” loss while training
I am trying to write a simple Variational Autoencoder for a numerical dataset as opposed to images such as MNIST etc. I am basically replicating the keras blog post on this subject (with obvious ...
0
votes
1answer
35 views
Understanding Confidence Interval
I am trying to understand the concept of Confidence Intervals. What is the meaning of point estimates and confidence intervals? What I understood is the point estimate in confidence interval is ...
0
votes
0answers
23 views
How can I make a better unsupervised text classifier model? Is POS tagging part of Machine Learning and Data science?
I have got complaints data, which is not good, and often contains less than 3 words in every complaint (sometimes so short that only one word of them makes sense). The objective is to find what's ...
2
votes
0answers
22 views
How to improve model performace when model shows a systemic pattern in residues
I'm working on a regression model using Boosting algorithms (CatBoost, XGBoost, and LightGBM). All models give similar accuracy of 0.2 RMSE (Target varies from 0 to 1). I obtained the following plots ...
1
vote
0answers
11 views
Are there different types of confidence values?
Query related to apriori association in ML. I am learning apriori association from a teacher. I have a simple dataset of five transactions as follows.
T1: {Milk, bread}
T2: {Milk, bread}
T3: {Milk, ...
0
votes
0answers
29 views
What algorithmic solution would you use for this scenario?
The Project In a Nutshell
Use an algorithmic solution to predict with 70%+ accuracy in as close to real-time as possible the increase and decrease of at least three numeric incremental movements for a ...
0
votes
0answers
35 views
Receiving the ValueError: Expected 2D array, got 1D array instead
I'm trying to use LSTM for time series forecasting but l keep receiving the value error: expected 2D array, got 1D array instead. Can anyone help me figure out what's missing, here is my code:
...
-2
votes
1answer
61 views
Which machine learning model to choose? [closed]
I am a beginner in data science. I am facing the problem of choosing the most appropriate algorithm for my specific problem. I am building a recommendation system that gives students insight into ...
0
votes
0answers
15 views
Error in predictions using glmnet() function in R
I've got a problem with my code, whilst making predictions using glmnet()
Here is my code plus an error which occurs:
...
0
votes
1answer
33 views
How can a ML algorithm learn to classify fake news? [duplicate]
I am new in Machine learning techniques and in fake news detection by using these algorithms (SVM, nn, logistic regression,..).
I would like to understand how an algorithm can learn from a training ...
1
vote
1answer
18 views
How to handle fixed values for variables in pre-processing
I have a dataset which contains few variables whose values do not change. Some of the variables are non-numeric (for example all values for that variable contain the value 5) and few variables are ...
1
vote
1answer
35 views
How to apply multiple filter in Data Frame? [closed]
How to implement multiple filters for checking data cell in a range ?
Suppose, I have a list of numbers like,
...
1
vote
2answers
36 views
What is the purpose of the 'train model' step in data mining?
My understanding is that training a model is something done in machine learning using training data so that the model can predict values when new data is given to it.
Data mining is the process to ...
2
votes
1answer
21 views
How do I deploy a model when using Stratified K fold?
I have used Stratified K fold for learning the model . Below is the python code:
...
0
votes
0answers
17 views
How to validate the model when using Smote technique? [duplicate]
I am using Smote to treat Class Imbalance and I apply Smote only on the train data. I fit a model using balanced data("Smoted" data).
Now I need to check recall and precision for train and ...
0
votes
0answers
18 views
Should the column be kept from which range column was extracted?
I'm creating a Neural Network model to predict the price range of laptop. Input would be the configurations of that laptop. But the price range column was created from the price column. If I keep the ...
1
vote
0answers
32 views
Advantages and disadvantages of using softmax/sigmoid and categorical_crossentropy/binary crossentropy for a binary classification with a CNN
I'm doing a deep learning model using tensorflow and keras. I have a question about the output architecture. I want to classify between two classes, images with defects and images without defects, I'...
1
vote
0answers
16 views
How to calculate cov(e|X) in Generalised linear regression?
This image taken from wiki https://en.wikipedia.org/wiki/Generalized_least_squares. I am not able to calculate Cov(e|X)? Can someone tell me that.And also give me dimesion of cov(E|X)= sigma^2 * rho
0
votes
0answers
29 views
How to compare 2 datasets with machine learning
I have multiple datasets from different sources (multiple cities) but with the same parameters and one output that I want to classify. Each dataset has different number of datapoints (thousands). I am ...
1
vote
0answers
42 views
Find periodicity of a signal using python
I have a dataset that contains occurrences of the Kettle in a single-occupancy house for the duration of a month. In this dataset, ‘ts’ column indicates the unix-timestamp (this can be converted to ...
0
votes
2answers
18 views
When combined correlation of features decreases
I'm building a machine learning model in Python to predict soccer player values. I'm trying to predict a "player_value" column containing the value of a specific player. Consider a sample of ...
1
vote
1answer
14 views
From analysing their previos transactions how can I predict for what type of product is the customer more likely to take take an EMI
So basically I need a kind of product/ category affinity for EMI for all customers eg - Customer A is more likely to take an EMI on her insurance premium.
One approach I had thought was to broadly ...
-1
votes
3answers
69 views
Is it a good practice to evaluate a model on the training set
Is it a good practice to evaluate a model on the training set (i.e. train a model on training set and evaluate the regression error/accuracy on the same training set) and compare the evaluation result ...
0
votes
1answer
37 views
Whether to replace NaN values in result column
I have a training dataset where we have to predict "Result" based on features "A", "B", "C" and "D" using machine learning. For a few rows, the "...
3
votes
3answers
244 views
How to insert two features in a model when a feature only applies to a certain group in the model
I'm building a machine learning model in Python to predict soccer player values. Consider the following feature columns of the dataframe:
...
0
votes
0answers
22 views
Is there a certain threshold over which to accept or reject predictors based on correlation values with the target variable?
I have been working on the Titanic dataset. After some feature manipulation, I printed out the correlation values between my target variable Survived and all the ...
0
votes
0answers
11 views
Getting error while performing late fusion of audio and video feature vectors. Please help me resolve this
I am trying to build Multimodal emotion classifier for which I have created CNN based Audio and Video models separately. Below are the implemented CNNs:
...
0
votes
1answer
19 views
Similarity matching between two distinct datasets (marketing case study)
I am working for a company that sells different products to customers. My objective is to find customers that are likely to purchase product X based on the profiles of customers that already purchased ...
0
votes
1answer
14 views
How to run two different models in single frame?
I have mask_detector.model and yolov3 social distancing weights.
I want to run them simultaneously with a single webcam stream.
how can I run them both i.e. detecting mask and social distancing model ...
0
votes
0answers
11 views
Are there any methods for detecting binary time series periodicity?
I am struggling with finding methods which can be used to detect the periodicity of binary time series.(the binary time series look like 0,0,1,0,0,1,0,0,1... or 1,0,0,0,1,1,0,1,0,0,0,0...)
0
votes
0answers
29 views
Model Deployment
I am trying to work on deploying my first model to Heroku.
So I was referring some videos for it. I saw that some pre-processing like removing stopwords, lemmatizing etc are done while creating the ...
2
votes
3answers
38 views
Combining Two CSV's in Jupyter Notebook
I want to combine both CSV files based on Column1, also when combined each element of Column1 of both csv should match and also each row or Please suggest how to reorder Column1 according to another ...
0
votes
1answer
26 views
How to create a classification model for multi output dataset?
I have a dataset where there are two target variables target-1 and target-2.
Both target variables are ordinal and thus I want ...
0
votes
1answer
31 views
Finding the worst affected industry due to COVID in terms of unemployment
My goal is to find the worst affected industries from COVID—19 in terms unemployment.
In terms of the data I will use for this task, I have a time series county-wise unemployment rate data of each ...
0
votes
1answer
41 views
How do I know what the best number of layers is required to achieve the highest accuracy
I'm learning from Udacity using this video.
I saw this piece of code:
...
0
votes
1answer
57 views
How to use historic data (granularity at day level) for ML modeling?
There is a scenario where I have to use historic data which is at the day level for the past 5 years.Actually it is water flow data, what quantity of water was flown on that particular day. I have to ...
2
votes
1answer
417 views
image_dataset_from_directory VS flow_from_directory
What is the main diffrence between flow_from_directory VS image_dataset_from_directory in keras?
which one should I use?
1
vote
2answers
92 views
Should you use random state or random seed in machine learning models?
I'm starting to study machine learning. All the examples I saw, the person that created the ML model used a random state or a random seed to stop the randomness of the process. But, in real life, when ...
0
votes
3answers
30 views
how to use predictions on a single value?
I am comfortable using Machine learning on my train data and test data and validate it.
But the question here is if I want to predict a single variable how do I do it?
Let's suppose I have done ...
0
votes
1answer
42 views
How should I choose n_features in FeatureHasher in sklearn?
How should I choose n_features in FeatureHasher in sklearn ? assume that I have 1000 categories in feature "case" and I want to hash them
1
vote
1answer
121 views
decision -tree regression to avoid multicollinearity for regression model?
I read in comments a recommendation for decision tree´s instead of linear models like neural network, when the dataset has many correlated features. Because to avoid multicollinearity.
A similar ...
1
vote
2answers
27 views
Train/Test dataset and model [closed]
I would like to ask you how to work on train and test dataset. I have unlabelled data. They are short text (max 100 characters) and I would need to understand their sentiment.
To do this, I am ...
0
votes
1answer
30 views
How to determine sample rate of a time series dataset?
I have a dataset of magnetometer sensor readings which looks like:
...
0
votes
1answer
17 views
How to Transpose dataframe with custom output? [closed]
I have a data like this:
I want to transpose it like this in python:
2
votes
2answers
31 views
Build a sentiment model from scratch
I would like to know how I can create a sentiment model from scratch.
I have my data, list of texts, with no labels about sentiment.
...
0
votes
1answer
17 views
Relationship Between Independent and Dependent variables
I calculated the distance correlation among the independent variables and the dependent variables to verify the nonlinear relationship among the variables and the values I am getting for each ...
1
vote
0answers
13 views
Correcting high AR(1) coefficients in dynamic Gordon model
I have just finished my thesis on a heterogeneous dividend expectations model applied to the COVID-19 crisis! However after receiving some feedback there is one last issue I want to resolve. I'm using ...
