Questions tagged [data-science-model]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
2answers
204 views

How to reduce the Root mean square error

I have dataset which describe "how many passenger arriving in some airport " and I would like to predict how many passenger arriving in monthly bases for next year. The features that I have is the ...
1
vote
0answers
37 views

Hypothesis Testing and Independent variables Importance

I am learning Data Science and I have a confusion in one topic. I would like to describe my approach. I have understood the problem statement. I have used snowflake schema to join tables that have ...
0
votes
0answers
20 views

Many to One LSTM; scientific Term

What is the Scientific Term for a Many to One LSTM ? Picture from here
1
vote
3answers
194 views

How to handle “year” variable for Machine Learning models

I have a "year" variable but I don't know which is the best way to handle it for a ML model, as it is a numerical variable, giving some sequence. Should I treat it as a categorical variable? Thanks ...
4
votes
2answers
517 views

SHAP value can explain right?

I face a problem with using SHAP value to interpret the Tree-based model. (https://github.com/slundberg/shapsd) First, I have input around 30 features and I have 2 features that have high positive ...
1
vote
0answers
29 views

types of metrics to evaluate the performance of regression models?

I have a conceptual question related to types of performance analysis of regression models. In general we have - R Square, Root Mean Squared Error and Mean squared Error to evaluate Regression ...
0
votes
2answers
35 views

Neural network is not giving the expected output after training in Python

My neural network is not giving the expected output after training in Python. Is there any error in the code? Is there any way to reduce the mean squared error (MSE)? I tried to train (Run the ...
1
vote
2answers
80 views

What are the steps and correct order of the operations in Machine Learning? [from Getting data to optimising models]

I've followed lots of tutorials on Machine Learning but in each of these, they go for a different strategy so it's quite confusing for me. I want to Know that what are the operations involved and what ...
-1
votes
2answers
53 views

Activation Functions in Neural network

I have a set of questions related to the usage of various activation functions used in neural networks. I would highly appreciate if someone could give explanatory answers. Why is ReLU is used only ...
0
votes
2answers
88 views

ML, Statistics and Mathematics

I have just started getting my hands wet in ML and every time I try delving deeper into the concepts/code, I face the challenges of the mathematics and its cryptic notations. Coming from a Computer ...
0
votes
2answers
36 views

How to get an intution for generating Keras CNN layers for a model

I am going through tutorial for handwritten text recognition. And to do hand written digit recognition the author has constructed a Keras model as follows: ...
1
vote
2answers
40 views

Does the predict function in machine learning understand categorical data

I understand that before feature engineering one has to split the dataset into train and test data, so as to avoid bias in the analysis. I also understand that the machine learning model does not ...
0
votes
1answer
53 views

Binary classification: is there a tradeoff between predicting class 1 vs 0?

I have been digging much more in detail into classification performance metrics lately to get my head around the 'dynamics' of classification algorithms. What I have noticed is that in binary ...
2
votes
1answer
43 views

Scikit model is not able to predict sequence correctly

I am trying to create a regression model using scikit-learn for predicting car price. The input data are, car model(trim), kilometers used, past resale price of similar car and age of used car. I am ...
1
vote
1answer
13 views

suggestion for good online source according to Syllabus

Hi, are there some online courses e.g. some classes in Coursera? I have difficulty in following the professor's teaching because I have a weak statistics background. I want to catch up by reading ...
0
votes
0answers
20 views

Best Method for Data Analysis on a 100 numerical IVs and 200 numerical DVs

I think I might need the help of this valuable community for a task. I have been given a dataset for 100 numerical independent variables (IVs) that predict output for 200 numerical values (from monte ...
2
votes
1answer
53 views

How to deal with annotation errors?

I know my annotators are not perfect, sometimes making mistakes. What would be the best way to deal with the annotation errors for my training data? Thanks!
0
votes
1answer
24 views

Where to get the Datascience Use cases for practice [duplicate]

I just started learning data science. I have gone through some of the courses in coursera & udemy, now i want to practice what i have learned. What i want to know is from where can i get the Use ...
1
vote
1answer
4k views

“ValueError: Index contains duplicate entries, cannot reshape” error when I try to use pd.MultiIndex.arrays

I have data which includes id , gender , collected time test name and Test values , Units of measurement Test Names will include all tests that a patient taken and Value col will have its ...
0
votes
1answer
43 views

Is there room to improve the model? if the train data accuracy is 99.8% but test data accuracy is 90%?

I understand this is a wide question. But there can be some suggestions. I can try some methods which I do not know. I think the model is already prefect on train data. But the test accuracy is a ...
1
vote
1answer
3k views

Tensorflow error: Input signature not matching inputs

I've been following Sentdex's tutorials on YouTube about Deep Learning and I've encountered and error while trying to load an image and run it through the model. The error says that the inputs do not ...
0
votes
1answer
110 views

Forecasting Consumption for Multiple Products for Multiple Regions

Came across a very interesting Real-World Time Series Forecast Problem. Can you please help me understand the right track to resolve the below Time Series problem: Input Data Sample: and we want to ...
0
votes
1answer
50 views
0
votes
0answers
10 views

How to estimate claims for warranty analytics where continuous improvement reduces warranty claims?

I have a situation where a company who has warranty claims on its product and they want to know that is it possible for them to extend that. Now the case is that they do improvement on the existing ...
1
vote
2answers
537 views

What is the difference between a data-driven model and an empirical model?

Are they the same? Empirical models, per Wikipedia, are any kind of (computer) modelling based on empirical observations rather than on mathematically describable relationships of the system ...
-1
votes
1answer
48 views

How to interact two variables in python?

I have about 8 features as my predictors in a logistic model I am trying to fit in python. One of the features is TotalAward (Financial Aid) and the second is NEED. I am attempting to predict the ...
0
votes
0answers
20 views

What is the best approach to train a multi-category regression model?

What is the best approach to train a multi-category regression model (using XBoost decision trees ensemble)? What are the ups and downs of each one? For example, if I want to train a model to predict ...
1
vote
0answers
182 views

ValueError: Error when checking input: expected input_5 to have 4 dimensions, but got array with shape ()

I am trying to load a densenet-121 model pretrained on imagenet weights and train on my dataset. I have two files namely train.csv and validation.csv and I have splitted the train.csv file into 80-20 ...
0
votes
1answer
16 views

Best practice on count of manual annotations for building criminal detection from news articles?

We have 7 million news articles corpus, which we want to classify into crimes or non-crimes and further identify criminals by using NERs/annotating criminals, crime manually. For creating a model that ...
0
votes
1answer
66 views

Clustering stores based on weekly data

I have 1 year transaction level data aggregated at a weekly level for 1000 different stores. I want to cluster similar stores based on 8 variables such as sales, customer count etc. The concern is ...
0
votes
2answers
176 views

Aggregate Categorical Data

I have a scenario in which I'm required to run my analysis at the Account level. One of the features that I'd like to look at is the no. of subscriptions against an account. There can be multiple ...
1
vote
1answer
24 views

Unsupervised Algorithm for hybrid data [duplicate]

I have a hybrid data that contains 15 categorical data and 4 continuous data. I need to implement a prediction on the data. So as I don't have any labeled data, I need to implement the unsupervised ...
1
vote
1answer
45 views

Checking if ML model is possible

How can I check if a machine learning model is feasible on a given dataset? What techniques like EDA, correlation etc. can be used to judge if a model is possible i.e. data and predictor variables ...
0
votes
0answers
16 views

Determining the number of Gaussian components in a mixture of Gaussians

Shown here is a Gaussian mixture. Would like to know how to best determine the number of Gaussian components that produce this data? This is not a simulated dataset, so the small components that are ...
0
votes
1answer
49 views

Counting the transition in a dataframe overtime

I am stuck at a problem and am thinking how to come out of it. I want to write a code in python with dataframe as below: data = {'Id':['a', 'a', 'b', 'b', 'c', 'c'], 'value':['Active', '...
1
vote
1answer
41 views

Gaussian Mixture Models Clustering

When using the EM algorithm in Gaussian Mixture Models (GMM), in the E-step, we take each x set in the training dataset to calculate and update the "weight" and parameters of each Gaussian ...
2
votes
0answers
22 views

Step extraction from a paragraph

Came across an interesting problem: Given a paragraph describing how to do a process, need to break it down to various steps. Basically, need to determine for each sentence in the paragraph, if this ...
0
votes
1answer
54 views

How to use a a trained model

I just trained my first model in Python 3.7/scikitlearn (Linear Regression) (well I copied most of the code but its something ^^). Now I want to actually Use the model. Specifically its about sons ...
0
votes
1answer
239 views

How to split the data as per the label name count using sklearn

Before training a model, I would like to split the data in a 80/20 ratio. For example, in my dataset of 3000 rows, I have different labels. Out of which A is one label name, has 100 records in the ...
1
vote
0answers
11 views

Soft Margin SVM kernels

Kernels are used to map datasets into higher dimensions so that they could be linearly separable. However, if we introduce the slack variable in the soft margin SVM, we are allowing some mistakes, and ...
0
votes
1answer
28 views

Can we Create Neural network(Simple one such as Multi Layer perceptron) that only contains positive weights only?

I was wondering if there is a specific method to create a well performing neural network with only positive weights (I already tried clipping the weight before training or so and initializing the ...
0
votes
1answer
71 views

Error using decision tree regressor [closed]

I'm new to data science , while i'm implementing decision tree. I'm facing the following error. Where i went wrong; Sample data in csv is: ...
2
votes
1answer
147 views

How to correctly set a target for a time series based model?

I need help determining the best way to go about creating the target variable for a machine learning model that is trading a financial instrument (stocks, foreign currencies, crpyto, etc). Below is ...
0
votes
1answer
72 views

GPS generate street [closed]

I am working on GPS tracking with a huge data from vehicle. Dataset have: vehicleId, speed, orientation(0-360), coordinate (x,y) and timestamp. Can you recommend me how to clean data and model to ...
1
vote
1answer
26 views

How do we decide on the classification algorithm to use with huge training size?

I am solving a questions binary classification problem and the training size for this is huge(291 billion). The data has bloated because of using tfidfvectorizerfor ...
2
votes
2answers
394 views

Procedure for selecting optimal number of features with Python's Scikit-Learn

I have a dataset with 130 features (1000 rows) . I want to select the best features for my classifier. I started with RFE but Its taking too long, i done this: <...
-1
votes
1answer
178 views

How Retail Analytics Project Can Be Done?

I have a project and I couldn't understand what I have to do because I am new with retail analytics. They said "Our goal is to measure the effects of promotion on sales" and "Your goal is to model ...
1
vote
1answer
13 views

SMOTE for multi-instance learning i.e num_rows(x_train) > num_rows(y_train)

I have an imbalanced dataset and I wish to predict classes(0 or 1). Sample x_train: ...
0
votes
4answers
359 views

How to know if my Decision tree model is good or bad?

I built a decision tree model and am not sure if it is good or bad. Could you help to evaluate my model? My code: ...
0
votes
1answer
93 views

Number of filters in Convolutional Neural Networks

How do I know how many filters to choose? And how does the neural network learn and adjust the filters? Thanks!

1 2 3
4
5
8