Questions tagged [data-science-model]
The data-science-model tag has no usage guidance.
347
questions
0
votes
0answers
8 views
Model Deployment
I am trying to work on deploying my first model to Heroku.
So I was referring some videos for it. I saw that some pre-processing like removing stopwords, lemmatizing etc are done while creating the ...
0
votes
1answer
15 views
Combining Two CSV's in Jupyter Notebook
I want to combine both CSV files based on Column1, also when combined each element of Column1 of both csv should match and also each row or Please suggest how to reorder Column1 according to another ...
0
votes
1answer
18 views
How to create a classification model for multi output dataset?
I have a dataset where there are two target variables target-1 and target-2.
Both target variables are ordinal and thus I want ...
0
votes
1answer
14 views
What is keras tuner?
I have implemented a deep learning model using Keras library. A lot of data scientists said use Keras tuner to increase model performance. I am bit confuse
what is Keras tuner and when should I use ...
0
votes
0answers
12 views
Multi-class classification issue using Keras Found input variables with inconsistent numbers of samples: [20000, 4] [closed]
My goal is to create a model for detecting different brands of beer bottles. I've been following this example/tutorial https://www.kaggle.com/prateek0x/multiclass-image-classification-using-keras for ...
0
votes
1answer
24 views
Finding the worst affected industry due to COVID in terms of unemployment
My goal is to find the worst affected industries from COVID—19 in terms unemployment.
In terms of the data I will use for this task, I have a time series county-wise unemployment rate data of each ...
0
votes
0answers
16 views
Finding the correlation between business distribution and the unemployment rate in COVID times [closed]
I have business distribution data of US counties (i.e. how many establishments exist in each sector in each county) and county wise unemployment rate since January 2020. I want to analyse the impact ...
0
votes
1answer
38 views
How do I know what the best number of layers is required to achieve the highest accuracy
I'm learning from Udacity using this video.
I saw this piece of code:
...
0
votes
0answers
38 views
How to use historic data (granularity at day level) for ML modeling?
There is a scenario where I have to use historic data which is at the day level for the past 5 years.Actually it is water flow data, what quantity of water was flown on that particular day. I have to ...
1
vote
1answer
30 views
image_dataset_from_directory VS flow_from_directory
What is the main diffrence between flow_from_directory VS image_dataset_from_directory in keras?
which one should I use?
1
vote
2answers
43 views
Should you use random state or random seed in machine learning models?
I'm starting to study machine learning. All the examples I saw, the person that created the ML model used a random state or a random seed to stop the randomness of the process. But, in real life, when ...
0
votes
2answers
23 views
how to use predictions on a single value?
I am comfortable using Machine learning on my train data and test data and validate it.
But the question here is if I want to predict a single variable how do I do it?
Let's suppose I have done ...
0
votes
1answer
14 views
How should I choose n_features in FeatureHasher in sklearn?
How should I choose n_features in FeatureHasher in sklearn ? assume that I have 1000 categories in feature "case" and I want to hash them
1
vote
1answer
63 views
decision -tree regression to avoid multicollinearity for regression model?
I read in comments a recommendation for decision tree´s instead of linear models like neural network, when the dataset has many correlated features. Because to avoid multicollinearity.
A similar ...
1
vote
2answers
27 views
Train/Test dataset and model [closed]
I would like to ask you how to work on train and test dataset. I have unlabelled data. They are short text (max 100 characters) and I would need to understand their sentiment.
To do this, I am ...
0
votes
1answer
23 views
How to determine sample rate of a time series dataset?
I have a dataset of magnetometer sensor readings which looks like:
...
0
votes
1answer
15 views
How to Transpose dataframe with custom output? [closed]
I have a data like this:
I want to transpose it like this in python:
2
votes
2answers
28 views
Build a sentiment model from scratch
I would like to know how I can create a sentiment model from scratch.
I have my data, list of texts, with no labels about sentiment.
...
0
votes
1answer
16 views
Relationship Between Independent and Dependent variables
I calculated the distance correlation among the independent variables and the dependent variables to verify the nonlinear relationship among the variables and the values I am getting for each ...
1
vote
0answers
13 views
Correcting high AR(1) coefficients in dynamic Gordon model
I have just finished my thesis on a heterogeneous dividend expectations model applied to the COVID-19 crisis! However after receiving some feedback there is one last issue I want to resolve. I'm using ...
1
vote
1answer
36 views
is it possible get a overfit underfit comparation between models, with this chart? (homework) [closed]
I am trying to interpret this chart.
I am not sure how to interpret this, because, I think that the fact of the for examples LGBM Validation error, is wide and similar to train boxplot, there arent ...
0
votes
0answers
11 views
Are there any techniques to explore the inter - target correlations and the input - output correlations in the Multi Traget Regression Problem
I am working on the Multi target regression problem in which there are 4 target variables and 17 input features.
I tried to use hard parameter sharing method to predict the target variables.
I am ...
0
votes
1answer
16 views
Best Approach to Forecasting Numerical Value Based on time series and categorical data?
Consider a dataset of thousands of car repairs that have been performed. In simplest of terms, the columns to consider are the time of year when it was broken (seasonal changes in demand for car ...
1
vote
0answers
21 views
How to extract embeddings of categorical variables
I am little bit confused about encoding categorical variables. There are other posts/blogposts on this issue but none is talking about the problem I am facing.
I have a dataset with mixed variables (i....
0
votes
0answers
28 views
How to train a recommender system to improve the customer class?
Considering the definition of a recommending system
A recommender system, is a subclass of information filtering system that seeks to predict the "rating" or "preference" a user ...
0
votes
1answer
21 views
Use both differencing and normalization in time series modeling to make it stationary?
I am working on a time series dataset. Should we use both differencing and normalizing or either of the ones to make it stationary?
1
vote
1answer
49 views
How do I predict a set of frequently bought items?
I have a dataset of retail transactions wherein different users buy certain items together. For example, a user A buys a toothpaste, a toothbrush and a floss at the same time, and a user B buys a ...
0
votes
0answers
10 views
Space partitioning to estimate product weight
Looking for some vocabulary to help me refine my research so I can tackle this problem.
Here's an overview of the problem statement I'm working on.
At my company we manufacture various products, ...
1
vote
1answer
28 views
what are the next step after ML prediction and how to proceed?
I have trained an ML model with a good accuracy but what next?
I am facing difficulty in answering this question, how will you present your model.
Which framework do you use
How do you make sure ...
1
vote
2answers
50 views
Where can I get Insurance claim data for practicing NLP(Natural Language) processing?
I am looking for specifically Insurance dataset for practicing Machine Learning & NLP, but unable to find much in kaggle, udemy or other websites. Is there a way to get that dataset or any website ...
0
votes
1answer
21 views
Estimating sales volume of new drugs to a therapeutic class
I work with pharmacy claims data for an insurance company and wish to estimate how many members on existing products in a therapeutic class will shift to the new product in the same class i.e. insulin ...
-1
votes
1answer
31 views
Help for formula for regularized logistic regression?
Can someone help me write the cost function for logistic regression in octave.These are the variables I used...
...
0
votes
0answers
11 views
Build networks to study users’ behaviour
I have a dataset containing a list of users that published tweets through time. I would like to build the network through time. Would it something that I could do with this data?
Sample of Dataset’s ...
1
vote
2answers
54 views
Extract information using NLP and store it in csv file
I have a text file that stores the pickup, drops, and time. SMS text is a dummy file that is used to train a cab service model. The text is like in this format:
...
0
votes
0answers
7 views
Schedule Sagemaker with boto3 comprehend
I have a jupyter notebook running on SageMaker which I have to run daily to output CSV files. I am using boto3 'comprehend' to analyze the text in my workflow. I want to be able to schedule this daily ...
2
votes
3answers
55 views
Continuous VS Categorical variable
In the dataset I have a continuous variable AGE and categorical variable AGE_CATEGORY as well. They are both highly correlated.
...
0
votes
0answers
15 views
Choosing a non-linear regression model and predicting
I'm new to data science and machine learning. I was working on a project and I happened to get this graph.
I want to build a predictive model using this, for each of the boroughs. I do understand ...
0
votes
0answers
10 views
What is the best possible method/methods to determine best possible branch(rule) in a decision tree plot for the positive cases only?
I have a dataset, which I am using for loan prediction. Thus, it is pretty much clear that my dataset is imbalanced. I have used Decision Tree to plot the tree structure. Now, I want to find the ...
1
vote
1answer
27 views
WHY or WHEN to convert numeric data to a categorical data?
This is an open ended WHY TO or WHEN TO question rather than a question on HOW TO encode numeric to categorical data.
I am currently working on Telco Customer Churn dataset from kaggle.
This is ...
0
votes
0answers
9 views
Predict users $ value based on selections
I want to predict the chance of a user becoming a customer, and subsequently predict their customer value based on inputs from a new user onboarding questionnaire.
In the onboarding a new user can ...
1
vote
1answer
25 views
How do I train a model with pre-saved weights?
I need to train a model but the data after preprocessing is too large to fit in the RAM. Is it possible to preprocess the data in batches and train a model for the small data set and then save the ...
1
vote
0answers
55 views
How to group various similar search keywords and find top 100 keywords from big dataset
I have search keywords in one of my database table. These are the keywords searched by users on a website.
My requirement is to find the top 100 search keywords after consolidating various similar ...
2
votes
1answer
33 views
Text classification based on n-grams and similarity
I have tried to cluster hundred texts using k-means clustering. I would like to consider other algorithms to group text based on their content and try to spot news not related to other news (topic ...
1
vote
2answers
39 views
What's my target variable?
I am beginner in data science. I have this "aids" dataset from "mdhglm" package in R.
dataset = aids, info = Repatead Measures on AIDS Data
...
0
votes
0answers
14 views
Variance Inflation Factor or Correlation Coefficient which one to choose?
In a machine learning model, while removing the correlated variables, which one is better whether we have to go with Variance Inflation Factor(VIF) or Correlation Coefficient like Pearson or spearmans ...
0
votes
4answers
56 views
How to view entire 5788 rows and 7 columns.?
I want to see entire 5788 rows and 7 columns of my CSV data. I used below code and it is giving little data by stating [5788 rows x 7 columns] but showing only 10 rows and 5 columns in python prompt. ...
0
votes
1answer
46 views
Can we use one hot encoding instead of for loops?
I have an anomaly detection model, that I run per store with a bunch of features.
I intend to run this code, everyday, per store. Now, lets say I have 8000 stores, I would imagine, I should write a ...
1
vote
1answer
24 views
Model assessment for EXTREMELY imbalanced dataset
I am dealing with an extremely imbalanced dataset, with about 10,000 negative samples for each positive sample.
I am now trying to come up with an adequate measurement of model accuracy but none seem ...
1
vote
2answers
114 views
What are advantages or disadvantages of training deep learning model from scratch? [closed]
I want to know advantages and disadvantages.Also, What are advantages and disadvantages of transfer leraning?
1
vote
1answer
39 views
what is the difference between Bias and overfilling and under fitting? [closed]
I am confused about Bias and overfitting as I see it sounds similar but not able to explain differene?
