Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-science-model]

The tag has no usage guidance.

0
votes
1answer
11 views
0
votes
1answer
12 views

What is the standard model for CNN to compare against other classifier technique?

I have created a new method to do binary image classification. I think it would be interesting to compare it to the convolutional neural network that would do the same binary classification given the ...
0
votes
0answers
30 views

train_test_split() error: ValueError: Found input variables with inconsistent numbers of samples: [10015, 7]

I get this for x.shape and y.shape (7, 1, 10015) (10015, 28, 28, 1) How can I get the train test to work? ...
1
vote
1answer
20 views

How to Use Shap Kernal Explainer with Pipeline models?

I've a pandas DataFrame X. I needed to find prediction explanation of a a particular model. My model is given below: ...
1
vote
2answers
15 views

What should I check if model accuracy is no better than baseline level(random guess)

I have a data with only 8 columns: id created_time employee_id rank position hourly price num_work_completed work_category hired Hired is the target variable with 1 representing hired and 0 ...
0
votes
3answers
31 views

How to approach this data set for linear regression?

I am new to data science and am currently working on a data science project and have to answer a few questions about the following data set with 18k data points: https://www.kaggle.com/karangadiya/...
0
votes
0answers
7 views

Connecting R to OMBD [closed]

Can anyone guide me for the two questions 1) How to connect R with ombd API? 2) How to deal with English text having hindi words in it? Thanks in advance.
0
votes
1answer
19 views

What is Difference Between np.zeros() and np.empty() [duplicate]

Can Anyone Please Explain me the Difference Between them In Terms Of Any Operation or Computation and Values Stored in them
0
votes
1answer
12 views

np.empty() Returns some Numbers Rather than Empty Values [closed]

I Wonder, Why the Np.Empty() Method returns some Arbitrary Values in the Array Rather than Empty Array with Zero Filled Here is My Code ...
-1
votes
0answers
12 views

Extract the unique genres and its count and store in data frame with index key in python [closed]

I am using this, not sure how to take index. df_genre=pd.DataFrame(df_csv['Genre'].value_counts())
1
vote
1answer
12 views

xgboostclassifier prediction error after saving the model and restoring it

I have trained a xgboost model and during training, the prediction works fine. But if I stop the script and start a restoring script to restore and predict, then for the same test dataset I get every ...
2
votes
0answers
17 views

Natural language Generator using Data from table

I am working on some natural language generator part. eg.1 Input to it will be Col1 Col2 Col3 A B 13 X Y 14 Output should be two sentence, one ...
-1
votes
0answers
21 views

Dynamic discounts e-commerce

I am working for an e-commerce platform that offers discounts to specific merchants or for specific products (sort of affiliate marketing). I would like to implement a dynamic discount algorithm so ...
1
vote
0answers
25 views

What is the name of the prediction method?

Suppose, I have a data set: ix m_t1 m_t2 1 42 84 2 12 12 3 100 50 then, we can calculate the difference between ...
0
votes
0answers
8 views

How to forecast the next 3 months values, when you dont have supporting feature data

I have dataset of retail store, where I have values for customer contacted and purchase value. Now I want to forecast values of purchased(yellow zone) where I also want to use contacted values in ...
0
votes
0answers
5 views
0
votes
0answers
23 views

Time series output of LSTM network has a much lower scale than the input scale

I'm trying to use an LSTM network to predict a sequence of a time series variable. I'm trying to predict a sequence of 3 elements based on the sequence of the previous 6 elements. The Keras code that ...
0
votes
1answer
19 views

Is my iPython Installation Valid?

I just want to know if my ipython is properly installed. I have both Python and Anaconda installed on my Windows. I entered the "pip3 install ipython" command on the Command Prompt and it downloaded ...
0
votes
0answers
11 views

Why do we negate entropy in decision trees

\begin{equation} i(N) = - \sum_{j=1}^{c} P_jlogP_j \end{equation} Why don't we calculate Impurity simply without negation and then decide descendent node variable on minimum impurity based?
0
votes
2answers
32 views

Prediction interval for general non-linear regression

I have been working on a predictive model. With each prediction, we need to provide a score to express the confidence about our prediction. So I am looking at prediction interval (PI). In linear ...
1
vote
1answer
32 views

Gradient Descent

Can we use Gradient descent to find Global/local maxima? What types of problem needed to maximize the function? Can we do it with GD? Can anybody explain my question with an example relevant to ...
-1
votes
0answers
20 views

I have a million records of duty trades between two users, need to figure out which ML to use

I have a million records of duty trades between two users. One user drops a duty, and other user will pick it up if he/she likes it (There are 50k users in total) and anybody could pick it up, in 20 ...
0
votes
0answers
5 views

Many Input-tensors for keras model, can this be more efficient?

Introduction I first wanted to post this on stackoverflow, but since it is not thát program-language related, but more on a conceptual level of data processing.. I thought it would fit better here. ...
0
votes
1answer
19 views

Classification of data generated by radar using FFT

I have time domain data which is having binary label in form of 0 and 1. I applied FFT to all the features and label as well. The problem is my output label is now not binary anymore. How to solve ...
-1
votes
1answer
34 views

No target variable in my data

I have a list of transactions of bus route from place to place, I don't have any target variable here. I was asked to give meaningful insights from the data, what can I do here? I cleaned the data, ...
2
votes
1answer
29 views

how to implement a hierarchical clustering technique using parallel execution in R

In R, currently to implement wards method for hierarchical clustering, I use the following code - results <- hclust(data, "ward.D2"). However as my data size has ...
5
votes
2answers
76 views

How do I decide if I need to go for Normalization and not Standardization or vice-versa?

While designing a ML model, how do I decide if I need to go for Normalization and not Standardization or vice-versa? On what factor is this decision made?
1
vote
1answer
26 views

Using a loop to predict longer vectors with a LSTM

I have a model based on LSTMs that can predict a vector output based on a vector input. I can't increase the size of the output because : I would need a larger network to obtain good results It would ...
1
vote
1answer
29 views

Decision trees With branching Factor?

How to construct a Binary Tree from a decision tree with branching factor greater than 2 (b>2)?
0
votes
0answers
23 views

DecisionTreeClassifier for multi label classification giving outputs as single classes

I have built a DecisionTreeClassifier for multi-label classification with details given on https://scikit-learn.org/stable/modules/multiclass.html with input data in shape ...
5
votes
1answer
135 views

Feature engineering suggestion required

I am having a problem during feature engineering. Looking for some suggestions. Problem statement: I have usage data of multiple customers for 3 days. Some have just 1 day usage some 2 and some 3. ...
0
votes
1answer
77 views

Pandas to_sql insert only some columns

I am new using pandas. I am asking about how to insert specific columns using to_sql. This is my explanation. I have a database with a table datasiswa with columns: id: as int, with autoincrement,...
2
votes
1answer
32 views

Using an unsupervised Isolation Forest, how does one identify the optimal number of outliers from the anomaly scores?

I am using an unsupervised isolation forest algorithm and computing anomaly scores to detect outliers from a 2 dimensional toy dataset. From a scatter plot, I am able to detect/visualize the data ...
0
votes
1answer
31 views

Isolation Forest

Can some one please explain Isolation Forests more clearly? Everywhere I search, I find the same explanation: Isolation Forest ‘isolates’ observations by randomly selecting a feature and then ...
1
vote
0answers
71 views

Named Entity Recognition using context of the sentence

I have a problem in which I want to know how can we extract or name the entity based on the context in which it is getting used in a sentence. For example: If we have to extract date field which is ...
-1
votes
1answer
34 views

What does it mean for a prior to be improper [closed]

It’s use will never result in a posterior distribution which integrates (or sums) to 1. ?
1
vote
1answer
26 views

is it bad to have many different measurements for the same target variable?

I'm working on a dataset that has repeated measurements for the same target variable. When I don't change anything and create model, cross validation overfits with 0.99 score but in testset it gives ...
1
vote
3answers
150 views

What skills do I need to become a data scientist? And how to show them? [closed]

I have fimiliarized myself with the recommended most important concepts (Linear Algebra, Analysis, Phython, Numpy, Pandas, a bit of Statistics, Linear regression). For the last two, I don't know how ...
1
vote
2answers
60 views

Low accuracy in multi-class classification despite all data being generated from rules

I have a well defined data where i have cleaned up my data to final form which has 20 features mapping to a number between 1 to 100. Upto 5 features are enabled(value set to 1) for each row. The data ...
0
votes
0answers
10 views

How to create a SAS Library Folder

I am trying to create a folder to use in the SAS library. I have tried to do this many different ways. Every time I run the code it always says that the path does not exist. Below is my error ...
0
votes
0answers
14 views

Best model for Antimicrobial Resistance (AMR) prediction?

Some classes of problem are best solved by a specific class of machine learning model, due to the structure of the data (e.g. Deep Learning for computer vision). Prediction of bacterial resistance/...
1
vote
0answers
26 views

Lookup from time series panda dataframe

I have below reference table with date time series defined in 20 mins interval ...
0
votes
1answer
15 views

Looking for help calculating a probability formula

How do I put this into a calculator or a excel spreadsheet formula. I have never done this math before, but I want to figure it out.
0
votes
1answer
67 views

What Predictions can be done for Restroom/Washroom Data? [closed]

My company has installed sensors, which actually monitors the Restrooms/Washrooms in the Building. Currently the sensors collect data such as Ammonia, Nitrous and Visitors Count; All the data ...
1
vote
3answers
134 views

Forecasting ticket sales and city

I am learning data science. I have the following dataset for train tickets: ...
0
votes
1answer
24 views

General question on EDA, correlations, classification, ML

I am looking for a general best practices regarding classification and correlations. I created a new predictor feature call it B, based on a certain threshold in a feature A. Now I started to do EDA ...
2
votes
2answers
61 views

Difference between train, test split before preprocessing and after preprocessing

I am new to machine learning. I am bit confused in preprocessing. Generally, Scenario-1: I am splitting the dataset into train,test and validation and applying the transformations like fit_transform ...
1
vote
2answers
35 views

Machine Learning Validation Set

I have read that validation set is used for Hyper-parameter tuning and comparing models. But, what if my algorithm/model does not have any hyperparameter? Should I use validation set at all? Because ...
0
votes
3answers
104 views

How to predict future sales based upon last year sales data? [closed]

I have past 1 year of sales data and now i want to predict sales for next coming year. How can i predict it.
0
votes
1answer
17 views

General question on the approach to optimise numbers

I have a huge huge model in SQL that nobody knows what it is doing. This model spits out some numbers and those numbers should be optimised to match another batch of 'correct' numbers as much as ...