Questions tagged [data-science-model]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
2answers
25 views

What is the value of AIC criterion if RSS is 0? [closed]

The AIC formula is : $AIC = 2k + n Log(RSS/n)$ So if RSS is equal to 0, it is undefined. How do I deal with this? What value should it take?
4
votes
2answers
34 views

Sklearn: applying cost complexity pruning along with pipeline

I have a data set with categorical variables. I have defined a decision tree algorithm and transformed these columns to numerical equivalent using one hot encoding functionality in sklearn: Create ...
0
votes
0answers
15 views

Getting different results on the same notebook ran on the Kaggle platform vs on google colab [closed]

Why am I getting different results on the same notebook ran on the Kaggle platform vs on google colab? * Note: I am using lightgbm (version 2.3.0)regressor based on decision tree on both the platforms ...
0
votes
0answers
13 views

Variational Autoencoder with custom loss in Keras giving “nan” loss while training

I am trying to write a simple Variational Autoencoder for a numerical dataset as opposed to images such as MNIST etc. I am basically replicating the keras blog post on this subject (with obvious ...
0
votes
1answer
35 views

Understanding Confidence Interval

I am trying to understand the concept of Confidence Intervals. What is the meaning of point estimates and confidence intervals? What I understood is the point estimate in confidence interval is ...
0
votes
0answers
23 views

How can I make a better unsupervised text classifier model? Is POS tagging part of Machine Learning and Data science?

I have got complaints data, which is not good, and often contains less than 3 words in every complaint (sometimes so short that only one word of them makes sense). The objective is to find what's ...
2
votes
0answers
22 views

How to improve model performace when model shows a systemic pattern in residues

I'm working on a regression model using Boosting algorithms (CatBoost, XGBoost, and LightGBM). All models give similar accuracy of 0.2 RMSE (Target varies from 0 to 1). I obtained the following plots ...
1
vote
0answers
11 views

Are there different types of confidence values?

Query related to apriori association in ML. I am learning apriori association from a teacher. I have a simple dataset of five transactions as follows. T1: {Milk, bread} T2: {Milk, bread} T3: {Milk, ...
0
votes
0answers
29 views

What algorithmic solution would you use for this scenario?

The Project In a Nutshell Use an algorithmic solution to predict with 70%+ accuracy in as close to real-time as possible the increase and decrease of at least three numeric incremental movements for a ...
0
votes
0answers
35 views

Receiving the ValueError: Expected 2D array, got 1D array instead

I'm trying to use LSTM for time series forecasting but l keep receiving the value error: expected 2D array, got 1D array instead. Can anyone help me figure out what's missing, here is my code: ...
-2
votes
1answer
61 views

Which machine learning model to choose? [closed]

I am a beginner in data science. I am facing the problem of choosing the most appropriate algorithm for my specific problem. I am building a recommendation system that gives students insight into ...
0
votes
0answers
15 views

Error in predictions using glmnet() function in R

I've got a problem with my code, whilst making predictions using glmnet() Here is my code plus an error which occurs: ...
0
votes
1answer
33 views

How can a ML algorithm learn to classify fake news? [duplicate]

I am new in Machine learning techniques and in fake news detection by using these algorithms (SVM, nn, logistic regression,..). I would like to understand how an algorithm can learn from a training ...
1
vote
1answer
18 views

How to handle fixed values for variables in pre-processing

I have a dataset which contains few variables whose values do not change. Some of the variables are non-numeric (for example all values for that variable contain the value 5) and few variables are ...
1
vote
1answer
35 views

How to apply multiple filter in Data Frame? [closed]

How to implement multiple filters for checking data cell in a range ? Suppose, I have a list of numbers like, ...
1
vote
2answers
36 views

What is the purpose of the 'train model' step in data mining?

My understanding is that training a model is something done in machine learning using training data so that the model can predict values when new data is given to it. Data mining is the process to ...
2
votes
1answer
21 views

How do I deploy a model when using Stratified K fold?

I have used Stratified K fold for learning the model . Below is the python code: ...
0
votes
0answers
17 views

How to validate the model when using Smote technique? [duplicate]

I am using Smote to treat Class Imbalance and I apply Smote only on the train data. I fit a model using balanced data("Smoted" data). Now I need to check recall and precision for train and ...
0
votes
0answers
18 views

Should the column be kept from which range column was extracted?

I'm creating a Neural Network model to predict the price range of laptop. Input would be the configurations of that laptop. But the price range column was created from the price column. If I keep the ...
1
vote
0answers
32 views

Advantages and disadvantages of using softmax/sigmoid and categorical_crossentropy/binary crossentropy for a binary classification with a CNN

I'm doing a deep learning model using tensorflow and keras. I have a question about the output architecture. I want to classify between two classes, images with defects and images without defects, I'...
1
vote
0answers
16 views

How to calculate cov(e|X) in Generalised linear regression?

This image taken from wiki https://en.wikipedia.org/wiki/Generalized_least_squares. I am not able to calculate Cov(e|X)? Can someone tell me that.And also give me dimesion of cov(E|X)= sigma^2 * rho
0
votes
0answers
29 views

How to compare 2 datasets with machine learning

I have multiple datasets from different sources (multiple cities) but with the same parameters and one output that I want to classify. Each dataset has different number of datapoints (thousands). I am ...
1
vote
0answers
42 views

Find periodicity of a signal using python

I have a dataset that contains occurrences of the Kettle in a single-occupancy house for the duration of a month. In this dataset, ‘ts’ column indicates the unix-timestamp (this can be converted to ...
0
votes
2answers
18 views

When combined correlation of features decreases

I'm building a machine learning model in Python to predict soccer player values. I'm trying to predict a "player_value" column containing the value of a specific player. Consider a sample of ...
1
vote
1answer
14 views

From analysing their previos transactions how can I predict for what type of product is the customer more likely to take take an EMI

So basically I need a kind of product/ category affinity for EMI for all customers eg - Customer A is more likely to take an EMI on her insurance premium. One approach I had thought was to broadly ...
-1
votes
3answers
69 views

Is it a good practice to evaluate a model on the training set

Is it a good practice to evaluate a model on the training set (i.e. train a model on training set and evaluate the regression error/accuracy on the same training set) and compare the evaluation result ...
0
votes
1answer
37 views

Whether to replace NaN values in result column

I have a training dataset where we have to predict "Result" based on features "A", "B", "C" and "D" using machine learning. For a few rows, the "...
3
votes
3answers
244 views

How to insert two features in a model when a feature only applies to a certain group in the model

I'm building a machine learning model in Python to predict soccer player values. Consider the following feature columns of the dataframe: ...
0
votes
0answers
22 views

Is there a certain threshold over which to accept or reject predictors based on correlation values with the target variable?

I have been working on the Titanic dataset. After some feature manipulation, I printed out the correlation values between my target variable Survived and all the ...
0
votes
0answers
11 views

Getting error while performing late fusion of audio and video feature vectors. Please help me resolve this

I am trying to build Multimodal emotion classifier for which I have created CNN based Audio and Video models separately. Below are the implemented CNNs: ...
0
votes
1answer
19 views

Similarity matching between two distinct datasets (marketing case study)

I am working for a company that sells different products to customers. My objective is to find customers that are likely to purchase product X based on the profiles of customers that already purchased ...
0
votes
1answer
14 views

How to run two different models in single frame?

I have mask_detector.model and yolov3 social distancing weights. I want to run them simultaneously with a single webcam stream. how can I run them both i.e. detecting mask and social distancing model ...
0
votes
0answers
11 views

Are there any methods for detecting binary time series periodicity?

I am struggling with finding methods which can be used to detect the periodicity of binary time series.(the binary time series look like 0,0,1,0,0,1,0,0,1... or 1,0,0,0,1,1,0,1,0,0,0,0...)
0
votes
0answers
29 views

Model Deployment

I am trying to work on deploying my first model to Heroku. So I was referring some videos for it. I saw that some pre-processing like removing stopwords, lemmatizing etc are done while creating the ...
2
votes
3answers
38 views

Combining Two CSV's in Jupyter Notebook

I want to combine both CSV files based on Column1, also when combined each element of Column1 of both csv should match and also each row or Please suggest how to reorder Column1 according to another ...
0
votes
1answer
26 views

How to create a classification model for multi output dataset?

I have a dataset where there are two target variables target-1 and target-2. Both target variables are ordinal and thus I want ...
0
votes
1answer
31 views

Finding the worst affected industry due to COVID in terms of unemployment

My goal is to find the worst affected industries from COVID—19 in terms unemployment. In terms of the data I will use for this task, I have a time series county-wise unemployment rate data of each ...
0
votes
1answer
41 views

How do I know what the best number of layers is required to achieve the highest accuracy

I'm learning from Udacity using this video. I saw this piece of code: ...
0
votes
1answer
57 views

How to use historic data (granularity at day level) for ML modeling?

There is a scenario where I have to use historic data which is at the day level for the past 5 years.Actually it is water flow data, what quantity of water was flown on that particular day. I have to ...
2
votes
1answer
417 views

image_dataset_from_directory VS flow_from_directory

What is the main diffrence between flow_from_directory VS image_dataset_from_directory in keras? which one should I use?
1
vote
2answers
92 views

Should you use random state or random seed in machine learning models?

I'm starting to study machine learning. All the examples I saw, the person that created the ML model used a random state or a random seed to stop the randomness of the process. But, in real life, when ...
0
votes
3answers
30 views

how to use predictions on a single value?

I am comfortable using Machine learning on my train data and test data and validate it. But the question here is if I want to predict a single variable how do I do it? Let's suppose I have done ...
0
votes
1answer
42 views

How should I choose n_features in FeatureHasher in sklearn?

How should I choose n_features in FeatureHasher in sklearn ? assume that I have 1000 categories in feature "case" and I want to hash them
1
vote
1answer
121 views

decision -tree regression to avoid multicollinearity for regression model?

I read in comments a recommendation for decision tree´s instead of linear models like neural network, when the dataset has many correlated features. Because to avoid multicollinearity. A similar ...
1
vote
2answers
27 views

Train/Test dataset and model [closed]

I would like to ask you how to work on train and test dataset. I have unlabelled data. They are short text (max 100 characters) and I would need to understand their sentiment. To do this, I am ...
0
votes
1answer
30 views

How to determine sample rate of a time series dataset?

I have a dataset of magnetometer sensor readings which looks like: ...
0
votes
1answer
17 views

How to Transpose dataframe with custom output? [closed]

I have a data like this: I want to transpose it like this in python:
2
votes
2answers
31 views

Build a sentiment model from scratch

I would like to know how I can create a sentiment model from scratch. I have my data, list of texts, with no labels about sentiment. ...
0
votes
1answer
17 views

Relationship Between Independent and Dependent variables

I calculated the distance correlation among the independent variables and the dependent variables to verify the nonlinear relationship among the variables and the values I am getting for each ...
1
vote
0answers
13 views

Correcting high AR(1) coefficients in dynamic Gordon model

I have just finished my thesis on a heterogeneous dividend expectations model applied to the COVID-19 crisis! However after receiving some feedback there is one last issue I want to resolve. I'm using ...

1
2 3 4 5
8