Questions tagged [data-science-model]
The data-science-model tag has no usage guidance.
435
questions
1
vote
1answer
33 views
The softmax function, why?
We know that Softmax usually applied to multi-class labels with the function of $e^{a}\over \sum e^{a}$.
My question is will a function like $a^{2} \over \sum a^{2}$ mostly work also? If not, why?
...
0
votes
0answers
19 views
What analytics model/classifier should be used to predict price?
I've go dataset with more than 10 features - football skills describing players. There is also price value in each row.
I would like to predict price by specifying ...
0
votes
1answer
12 views
Logistic Regression Model on Test Set - in Titanic Data Showing Error
I have built the model on Titanic Data set , with Logistic Regression Succeffullly and it is giving prediction on training set , but unfortunately I am unable to implement this on test data set.
...
0
votes
1answer
18 views
Can we pull data under different categories related to other column simultaneously in Pandas [closed]
I have the given data as show in the pic, enter image description here
I have all the given data in two columns one is Class and other is Age , in mix format now I need to pull the data as given in ...
0
votes
1answer
24 views
OneHotEncoder Showing error while encoding two columns
I am encoding two columns with index number 1 and 2 that is column number 2 and 3 , using the following code, however I am facing error of invalid syntax : If I am using only 1 in the index value it ...
1
vote
1answer
37 views
What to do when the target variable does not correlate with any of the independent variable in a dataset?
I am quite new to data science. I am trying to use Logistic Regression to predict my target (either 1 or 0).
But the problem is when I use a heatmap to find the correlation between the columns and the ...
0
votes
1answer
16 views
ValueError: Found input variables with inconsistent numbers of samples: [40, 10] [closed]
x_train with shape (40, 6) is as below
...
0
votes
1answer
16 views
Any well documented algorithm/function for previously bought recommendation system
I'm working on a previously bought recommendation system for a project. The list I'm trying to sort is static and does not change over time. Assuming each user purchases different items at different ...
-1
votes
1answer
22 views
how to debug model that why that model prediction goes to a particular label for an incorrect prediction?
Let's say I have implemented a model to predict whether the image is dog, cat, bird, elephant. my model predicts the input dog image as a cat how to interpret the model how/why it goes high prediction ...
0
votes
0answers
14 views
Associate another feature with hierarchical clustering - Patient Health Data
I am trying to learn data science. The tool I have is Orange datamining tool. I have following data set related to patient health. With this data set I can create a dendrogram and find diagnosis ...
1
vote
1answer
16 views
Normalization of production data
When training a model we split the dataset into training set and test set. In case a normalization/standardization is needed on any column then this process is done separately for training set and ...
1
vote
1answer
24 views
Which Data Science book gives complete guideline to data science?
There are many books in the stores on data science. Is there any book that gives complete guideline to data science? Like separately talks about python (not R), statistics, math, data Visualization ...
0
votes
0answers
11 views
Normalize chemical terms
I'm trying to detect text similarity among paragraphs of chemistry related literature. I am facing the problem of the multiplicity of ways to write down a specific compound.
Per example: The compound ...
2
votes
1answer
15 views
My own model trained on the full data is better than the best_estimator I get from GridSearchCV with refit=True?
I am using an XGBoost model to classify some data. I have cv splits (train, val) and a separate test set that I never use until the end.
I have used GridSearchCV to determine the best parameters and ...
0
votes
0answers
13 views
How does L1 normalisation work in Binary Classification?
I was working on a project where I was using TF*IDF algorithm. After applying grid search, I got the tfidf_norm=l1. Can someone explain how L1 normalisation form works in binary classification?(I have ...
0
votes
1answer
15 views
Multivariate time series (many to one relationship)
I am working on a machine learning project for my summer internship and was hoping someone could help. I am new to the field of ML and am still learning so please bear with my attempt for an ...
1
vote
1answer
85 views
Neural network linearity and non linearity
Is it right on my part to call:
A neural network with only input and output layer (sigmoid) as linear (since it is a logistic regression)
A neural network with more than one hidden layer non-linear (...
0
votes
0answers
8 views
how to prevent feedback loop while you can't use another data source
we have a harassment prediction model which trained and deployed many years ago. each day this model predicts some conversation as harassment and annotators label these predictions. (they only label ...
0
votes
0answers
6 views
Alternatives to CRISP-DM for solo projects
I am wondering if there is a data science methodology/model for working that is less prescriptive/detailed than CRISP-DM but still a framework of sorts that is less generic than, say, Agile, or using ...
0
votes
0answers
11 views
How would I perform a regression of this nature?
I have two dataframes. One is a dataframe containing the injury history of all players before 2013, the rows are the names of each player, and the columns in this dataframe are upper leg, lower leg, ...
0
votes
0answers
16 views
Anomaly Detection: LSTM Autoencoder Zero Reconstruction Loss on Anomalies
I am using an LSTM Autoencoder model for time series anomaly detection. None of the anomalies get flagged because the reconstruction loss comes out to be zero for all data points on the clearly ...
1
vote
0answers
26 views
How to compare two one hot encoded data frames based on column names?
I have two datasets with shapes (329, 159) and (26,24). Both of them are one-hot encoded. The columns in the smaller dataset are present in the larger dataset. The smaller dataset has scores that I ...
2
votes
1answer
44 views
Highly correlated features
What are the conditions to remove highly correlated features in a correlation map?
Given the correlation map below, is it OK to remove diagnosis feature and should we remove highly correlated features ...
0
votes
0answers
9 views
Python Matplotlib: Plot epochs value correctly
How can I change the x-as, starting from 1. As the epoch is starting from 1 and not from zero.
I tried to solve it with ticks...
...
0
votes
0answers
9 views
Data Warehouse design schema for sales (items, shopping carts, ..)
I have to design some OLAP-Cubes based on an OLTP database for the sales.
At first, that sounds very basic and common but I struggle with the item <-> shopping cart thing. One cart can contain ...
0
votes
1answer
23 views
Which model is best for object detection which is trained on COCO dataset?
I want to do Object Detection and Segmentation. I want to find out which models are trained on COCO-Dataset eg YOLO etc. But I want to find out which model has the highest accuracy and lowest time. In ...
0
votes
0answers
10 views
Predictions become random after loading a custom saved Keras model?
I did not found a conclusive answer for this problem so I am posting it here. I created a Keras model with custom layers and trained it on a classification task at which it achieves a completely ...
1
vote
0answers
16 views
Iteratively improving ML model on a small dataset
I have a spam classification model which I created using a very small dataset.I have exported it as shown
...
0
votes
2answers
23 views
1
vote
0answers
13 views
Assigning Weight to MultiClass Variable
I am working on an academic project where I go through the bug database and classify the bug (a Multiclass Classification). After this classification, I would like to assign a weight to assign a ...
0
votes
1answer
22 views
Can someone explain to me how to use a predictive model to predict something other than the training set
So let's say I create a logistic model to predict who will open a loan based on a based email list that includes who opened and who didn't that's 90% accurate. The model says age, income, bank ...
0
votes
0answers
13 views
Algorithm to capture maximum number of points spread across the four quadrants
I was preparing for the data science interview questions and encountered the following problem:
You are given some points in four quadrants and the points are fixed. You need to point the camera at an ...
0
votes
1answer
24 views
Which dataset I should use when I am retraining my model?
I trained my deep learning model using x dataset and now I got new dataset and I give it name as y. I want to retrain my model on this new dataset which is y. Do I need to use x+y dataset or just y? ...
2
votes
1answer
33 views
How can I reduce the number of dimensions using a Clustering algorithm in a mixed dataset?
I am working with a mixed data set, corresponding to TV consumption data, with the aim of reducing the number of features to only those relevant to detect TV consumption patterns (or consumption ...
2
votes
0answers
46 views
Creating a new feature from an existing one using decision trees
Is it possible to create a new feature out of two, or more than two existing features using a decision tree?
If so, how, and can it produce features with good information value that can better help ...
0
votes
0answers
31 views
Is there a way to cluster encoded data (encoded with variational autoencoder)?
I have managed to encode data through a variational autoencoder. The difference between an autoencoder and a variational autoencoder is that instead of encoding an input as a single point, we encode ...
0
votes
1answer
11 views
Errors changing column dtype to numeric
I am working with data from the government regarding COVID immunization numbers and would like to convert object columns into numeric. I am using Python in Jupyter Notebook. I tried using ...
0
votes
1answer
12 views
predicted value is more conentrated than actual with DNN
I have created an Deep Neural Network model with keras.
...
0
votes
1answer
16 views
Trying to use different image size to test my trained model
I have built my model using images which are all 512x384, I then exported the model through .pkl and am hosting it on Render, the UI is built on React App where the user will input their chosen image
...
0
votes
0answers
44 views
Divergence of Specificity and Sensitivity
I am working on a ML classification project in healthcare.
The data is imbalanced, and I decided to start modeling with tree-based algorithms such as (Balanced)RandomForest and XGBoost.
While checking ...
1
vote
2answers
42 views
Keras very low accuracy, saturate after few epochs while training
I am very new to the data science domain and directly jumped to TensorFlow models. I've worked on examples provided on the website before. My first time doing any project using it.
I am building a ...
0
votes
0answers
9 views
Difference between Granger causality and VAR(1)?
For my VAR(1) I get that the causal variable in each equation is statistically significant at 10%. But for Granger causality at 10% I only get that 1 variable granger causes the other and not the ...
-1
votes
1answer
77 views
How can I convert a dataframe column of fraction float that is stored as a string into float? [closed]
The df is as follows:
...
4
votes
1answer
99 views
Calculating optimal number of topics for topic modeling (LDA)
am going to do topic modeling via LDA. I run my commands to see the optimal number of topics. The output was as follows: It is a bit different from any other plots that I have ever seen. Do you think ...
0
votes
1answer
15 views
Classification Based Collaborative Filtering Model
I was going through algorithms for collaborative filtering-based prediction. Most of the places, I read about using matrix factorization based on ratings of the likeness of the user. But for my use ...
0
votes
1answer
29 views
Prediction Algorithm for Data with high Randomness
I have data for the orders of the previous year containing the product and the seller who sold the product. I have an information product, product category, seller, delivery address price etc. ...
0
votes
1answer
23 views
Predicting the test data with LinearRegression model gives ValueError: shapes (8523,1606) and (1605,) not aligned: 1606 (dim 1) != 1605 (dim 0)
Fitting the model, testing and getting the score or r2 does not give the error. But when I try to predict the actual data I get this ValueError:
...
1
vote
1answer
39 views
Binary Cross Entropy | Manual scalars [closed]
I am wanting to make print statements "showing my working out" of Binary Cross Entropy loss function, that works with ...
4
votes
1answer
83 views
Can Boosting and Bagging be applied to heterogeneous algorithms?
Stacking can be achieved with heterogeneous algorithms such as RF, SVM and KNN. However, can such heterogeneously be achieved in Bagging or Boosting? For example, in Boosting, instead of using RF in ...
0
votes
0answers
18 views
Keras Reproducibility Problem on Jupyter notebook
I developed a model with Keras. However, every time I run the model from the beginning, I get different score values. I typed the code below to provide "reproducibility" but unfortunately, I'...
