Questions tagged [test]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
30 views

Is it a problem to use the test dataset for the hyperparameter tuning, when I want to compare 2 classification algorithms on the 10 different dataset?

I know that we should use the validation set to perform hyperparameter tuning and that test dataset is not anymore really the test if it is used for hyperparameter tuning. But is this a problem if i ...
John B's user avatar
  • 1
0 votes
2 answers
50 views

Why shouldn't we try to balance the test set?

Most advice I have found online is that we must not balance the test set. The test set should remain to be unseen. However, I failed to see how balancing the test set will cause us to leak knowledge ...
Fraïssé's user avatar
  • 119
0 votes
1 answer
74 views

Imputation in train or test data

I'm having a rather simple question. Let's say i want to do a median imputation. I've read in some places that you should do: ...
Guilherme Raibolt's user avatar
0 votes
1 answer
86 views

Fairness metrics in the test set when wrong distribution

I have a doubt that we have been discussing for weeks with my colleagues and I wanted your opinion. I have a model for diagnosis of a disease and I want to know if it is fair. I train the model with ...
Esmeralda Ruiz Pujadas's user avatar
0 votes
1 answer
36 views

The meaning of P and degree of freedom in T-Test

I read about T-Test and how we can use it to compare between 2 models (https://towardsdatascience.com/paired-t-test-to-evaluate-machine-learning-classifiers-1f395a6c93fa) There are some issues I'm not ...
user3668129's user avatar
0 votes
0 answers
36 views

Robustness of an ARIMA Model

I have built an ARIMAX model in python for predicting a time series. After presenting my findings ive been asked what robustness tests i have used. My skillset is more on the python side. I only have ...
DVCITIS's user avatar
  • 131
1 vote
1 answer
55 views

Test score higher than train score

I implemented a Gaussian Naive Bayes classifier and I got a test score (99,99%) higher than the train score (96,87%) Is this normal or does it mean that my model is underfitting ? Thank you.
biihu's user avatar
  • 11
0 votes
1 answer
31 views

How to demonstrate two variables are orthogonal with respect to the output in a 3-D Python dataset?

I have a Python dataset with 300 samples and 3 columns: 2 independent integer variables X,Y and the dependent continuous variable ...
Adrián Pérez Diéguez's user avatar
0 votes
2 answers
884 views

Why label encoding before split is data leakage?

I want to ask why Label Encoding before train test split is considered data leakage? From my point of view, it is not. Because, for example, you encode "good" to 2, "neutral" to 1 ...
Anar's user avatar
  • 73
0 votes
1 answer
26 views

How to address label imbalance in deciding train/test splits?

I'm working on a dataset that isn't split into test and train set by default and I'm a bit concerned about the imbalance between the 'label' distributions between them and how they might affect the ...
civy's user avatar
  • 101
0 votes
1 answer
111 views

Is it good to use .fit to xtest when we use PolynomialFeatures() of sklearn?

My teacher did this in class, and I'm wondering is this ok to use .fit_transform with xtest? It shouldn't just be poly.transform(xtest) Teacher's Code ...
JEAN LEONARDO 's user avatar
1 vote
2 answers
113 views

Updating a train/val/test set

It is considered best practice to split your data into a train and test set at the start of a data science / machine learnign project (and then your train set further into a validation set for ...
Aesir's user avatar
  • 448
2 votes
2 answers
310 views

Dataset and why use evaluate()?

I am starting in Machine Learning, and I have doubts about some concepts. I've read we need to split our dataset into training, validation and test sets. I'll ask four questions related to them. 1 - ...
Murilo's user avatar
  • 125