Questions tagged [data-science-model]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

How do I fit a custom curve to a mathematical model using TensorFlow/Keras?

I'm trying to fit a simple S.I.R mathematical model to the U.K. COVID dataset using TensorFlow/Keras. I've spent days looking to no avail. I have the data from a csv file and stored in a tx1 NumPy ...
1
vote
1answer
19 views

Public dataset for news articles with their associated categories for multilabel data classification

I am wondering if there are any public datasets of news, like New York Times (NYT) or similar to various news categories such as politics, entertainment, lifestyle, general news, sports etc. I want to ...
1
vote
2answers
65 views

Extract information using NLP and store it in csv file

I have a text file that stores the pickup, drops, and time. SMS text is a dummy file that is used to train a cab service model. The text is like in this format: ...
0
votes
0answers
12 views

How to predict the number of patients from the number of diagnoses

I have data on the diagnostic measures that individual patients received that year. For that individual data, I would like to make a prediction of how many such patients are in the country. To do so, ...
0
votes
1answer
38 views

Understanding Confidence Interval

I am trying to understand the concept of Confidence Intervals. What is the meaning of point estimates and confidence intervals? What I understood is the point estimate in confidence interval is ...
3
votes
1answer
66 views

Text classification based on n-grams and similarity

I have tried to cluster hundred texts using k-means clustering. I would like to consider other algorithms to group text based on their content and try to spot news not related to other news (topic ...
2
votes
1answer
40 views

Negative loss, 100% accuracy

I have a very small dataset with 567 images. I've used pretrained model resnet50 in transfer learning. But whenever i fit my model it's giving me 100% accuracy , 100% validation accuracy and in per ...
0
votes
2answers
25 views

What is the value of AIC criterion if RSS is 0? [closed]

The AIC formula is : $AIC = 2k + n Log(RSS/n)$ So if RSS is equal to 0, it is undefined. How do I deal with this? What value should it take?
0
votes
1answer
20 views

Similarity matching between two distinct datasets (marketing case study)

I am working for a company that sells different products to customers. My objective is to find customers that are likely to purchase product X based on the profiles of customers that already purchased ...
4
votes
2answers
37 views

Sklearn: applying cost complexity pruning along with pipeline

I have a data set with categorical variables. I have defined a decision tree algorithm and transformed these columns to numerical equivalent using one hot encoding functionality in sklearn: Create ...
0
votes
4answers
437 views

How to know if my Decision tree model is good or bad?

I built a decision tree model and am not sure if it is good or bad. Could you help to evaluate my model? My code: ...
0
votes
0answers
14 views

Variational Autoencoder with custom loss in Keras giving “nan” loss while training

I am trying to write a simple Variational Autoencoder for a numerical dataset as opposed to images such as MNIST etc. I am basically replicating the keras blog post on this subject (with obvious ...
1
vote
1answer
318 views

checking model stability - Performance for different class

I tried to do multi-class classification problem. The goal is to predict whether the match will be won by HomeTeam, AwayTeam or Draw. I did feature engineering from the attributes and finally came up ...
0
votes
1answer
5k views

Pandas to_sql insert only some columns

I am new using pandas. I am asking about how to insert specific columns using to_sql. This is my explanation. I have a database with a table datasiswa with columns: id: as int, with autoincrement,...
1
vote
2answers
36 views

What is the purpose of the 'train model' step in data mining?

My understanding is that training a model is something done in machine learning using training data so that the model can predict values when new data is given to it. Data mining is the process to ...
0
votes
2answers
35 views

NLP: Getting the top 5 or top 10 predictions

I am working on a social networking application and I have to make its news feed better. For example: If someone searches for 'suggest me some good books', it should yield some names. Now, I have ...
4
votes
2answers
106 views

What's a reasonable distribution to model views over time of… this question?

Sorry for the self-referential title ;) I'd be curious to know what's a curve that could be used to model - in the scale of (say) weeks* - the "engagement lifecycle" of a single news page of an ...
1
vote
1answer
78 views

Finding the equation for a multiple and nonlinear regression model?

Regarding nonlinear and multivariable regression, I am using R or Matlab. In the case where I have a regression with just two variables, I simply draw the graph Y with respect to X and look for the ...
3
votes
1answer
155 views

How to correctly set a target for a time series based model?

I need help determining the best way to go about creating the target variable for a machine learning model that is trading a financial instrument (stocks, foreign currencies, crpyto, etc). Below is ...
0
votes
1answer
25 views

Text classification and predictive model

I have collected a lot of data that I would like to analyse and classified. Unfortunately, they are not already labelled, so I am going to do manually. The dataset consists of texts in Italian and I ...
0
votes
1answer
26 views

How to measure Covid impact by analysing credit card transaction of customer

I Want to know how can I identify that is the customer is in financial distress due to the COVID situation using its credit card transactions. I have a daily transaction of customers till current ...
0
votes
0answers
24 views

How can I make a better unsupervised text classifier model? Is POS tagging part of Machine Learning and Data science?

I have got complaints data, which is not good, and often contains less than 3 words in every complaint (sometimes so short that only one word of them makes sense). The objective is to find what's ...
2
votes
0answers
22 views

How to improve model performace when model shows a systemic pattern in residues

I'm working on a regression model using Boosting algorithms (CatBoost, XGBoost, and LightGBM). All models give similar accuracy of 0.2 RMSE (Target varies from 0 to 1). I obtained the following plots ...
1
vote
1answer
16 views

I Have Issues Installing Basemap

I tried to install Basemap and it gives me this: preparing transaction: done verifying transaction: done executing transaction: failed ERROR conda.core.link:_execute(507): An error occurred while ...
1
vote
1answer
15 views

SMOTE for multi-instance learning i.e num_rows(x_train) > num_rows(y_train)

I have an imbalanced dataset and I wish to predict classes(0 or 1). Sample x_train: ...
1
vote
0answers
39 views

SMOTE caused my total nrows in train to fall to a very small proportion

I have a highly skewed dataset with minority class in target being just about 4%. I decided to apply SMOTE using library DMwR in R. Here is my target: ...
3
votes
2answers
70 views

SMOTE on training data

The SMOTE could only be performed on the training data, so how can we do it using Weka? It means we have to put the training and test data in two separate files and run the SMOTE on the training file, ...
1
vote
0answers
11 views

Are there different types of confidence values?

Query related to apriori association in ML. I am learning apriori association from a teacher. I have a simple dataset of five transactions as follows. T1: {Milk, bread} T2: {Milk, bread} T3: {Milk, ...
0
votes
0answers
29 views

What algorithmic solution would you use for this scenario?

The Project In a Nutshell Use an algorithmic solution to predict with 70%+ accuracy in as close to real-time as possible the increase and decrease of at least three numeric incremental movements for a ...
0
votes
1answer
158 views

Feature Engineering in Multi-class Classification

I am working on a 3 class classification problem. I am curious on what is the best way to bin continuous variables for this problem. When I worked previously on 2 class problems, for examples sale ...
1
vote
3answers
47 views

Riskscore creation on Numerical Data

I am working to create a Risk score on a data where I have variables - Invested_amount, Profit Amount, Age of Account in days, Total Trading Transactions,Profit per Transaction & Investment per ...
2
votes
2answers
133 views

Predicting missing data. Looking for good data predicting technique

I am analysing data for Countries Trade GDP. Some of the countries have missing GDP value for given a year. However, I have Grand Total for the entire region for that year. Is there a good data ...
0
votes
2answers
43 views

Neural network is not giving the expected output after training in Python

My neural network is not giving the expected output after training in Python. Is there any error in the code? Is there any way to reduce the mean squared error (MSE)? I tried to train (Run the ...
0
votes
1answer
37 views

Whether to replace NaN values in result column

I have a training dataset where we have to predict "Result" based on features "A", "B", "C" and "D" using machine learning. For a few rows, the "...
-2
votes
1answer
62 views

Which machine learning model to choose? [closed]

I am a beginner in data science. I am facing the problem of choosing the most appropriate algorithm for my specific problem. I am building a recommendation system that gives students insight into ...
0
votes
0answers
35 views

Receiving the ValueError: Expected 2D array, got 1D array instead

I'm trying to use LSTM for time series forecasting but l keep receiving the value error: expected 2D array, got 1D array instead. Can anyone help me figure out what's missing, here is my code: ...
0
votes
3answers
30 views

how to use predictions on a single value?

I am comfortable using Machine learning on my train data and test data and validate it. But the question here is if I want to predict a single variable how do I do it? Let's suppose I have done ...
0
votes
0answers
15 views

Error in predictions using glmnet() function in R

I've got a problem with my code, whilst making predictions using glmnet() Here is my code plus an error which occurs: ...
0
votes
1answer
33 views

How can a ML algorithm learn to classify fake news? [duplicate]

I am new in Machine learning techniques and in fake news detection by using these algorithms (SVM, nn, logistic regression,..). I would like to understand how an algorithm can learn from a training ...
1
vote
1answer
35 views

How to apply multiple filter in Data Frame? [closed]

How to implement multiple filters for checking data cell in a range ? Suppose, I have a list of numbers like, ...
2
votes
3answers
38 views

Combining Two CSV's in Jupyter Notebook

I want to combine both CSV files based on Column1, also when combined each element of Column1 of both csv should match and also each row or Please suggest how to reorder Column1 according to another ...
2
votes
3answers
6k views

How to convert model.h5 to model.pb?

I wrote in google-collab to get the model using keras, but I have to do predictions in Visual Studio using tensorflow I've search for a method converting models from keras .h5 to tensorflow .pb, but ...
0
votes
2answers
233 views

error while running lasso.py

The following is the error code generated while running lasso.py. Can anybody help in fixing the same. Here is the code: ...
1
vote
1answer
22 views

Why gaussian assumption in GMM-HMM ASR?

I am reading a book entitled Speech and Language Processing by Daniel Jurafsky and James. For Acoustic vector, I would like to know why Gaussian assumption is made? I searched over the internet and ...
1
vote
1answer
32 views

How to use weights from our data set properly? Should we use them at all?

The census data set I'm using: https://archive.ics.uci.edu/ml/datasets/Adult So, I'm currently using this census data to make observations and predict whether someone is married or not. However, when ...
1
vote
1answer
18 views

How to handle fixed values for variables in pre-processing

I have a dataset which contains few variables whose values do not change. Some of the variables are non-numeric (for example all values for that variable contain the value 5) and few variables are ...
1
vote
2answers
608 views

What is the difference between a data-driven model and an empirical model?

Are they the same? Empirical models, per Wikipedia, are any kind of (computer) modelling based on empirical observations rather than on mathematically describable relationships of the system ...
1
vote
2answers
95 views
0
votes
1answer
14 views

How to run two different models in single frame?

I have mask_detector.model and yolov3 social distancing weights. I want to run them simultaneously with a single webcam stream. how can I run them both i.e. detecting mask and social distancing model ...
0
votes
2answers
236 views

How to reduce the Root mean square error

I have dataset which describe "how many passenger arriving in some airport " and I would like to predict how many passenger arriving in monthly bases for next year. The features that I have is the ...

1
2 3 4 5
8