Questions tagged [error-handling]
The error-handling tag has no usage guidance.
49
questions
0
votes
0
answers
7
views
Error analysis with one large and one small value
I have given two variables $(x_{true}, y_{true})$.
By using two variables namely, ($\alpha, \beta$), I can obtain ($x_{test}, y_{test}$).
Now, at this point my aim is to find $\alpha_{best}$ and $\...
- 113
1
vote
1
answer
30
views
MAE divided by median metric
I have a regression task for which my best models has a Mean Absolute Error (MAE) of approximately 15,000. The median value of the target variable is approximately 150,000.
I want to report that the ...
- 65
0
votes
1
answer
11
views
SOS: Working LightGBM model script to find best model
I have been trying to get a working LightGBM model which I can train on my data, select the best performing model with highest f1 score and then use it obtain the f1 score on the testing data. However,...
- 1
2
votes
0
answers
13
views
Characterizing errors in rotation and translation while estimating camera pose from images
Has anyone characterized the errors in rotation and translation while estimating camera pose of natural images using SFM or visual odometry? I mean, when estimating camera pose, what is the typical ...
- 674
1
vote
0
answers
21
views
How to include the sudden peaks/bursts in LSTM based time-series model's training
I am using LSTM for time-series prediction whereby I am taking past 50 values as my input. Now, the thing is that it is predicting just OKish, and not doing the exact prediction, especially for the ...
- 131
0
votes
1
answer
23
views
Comparing RMSEs of multiple test sets having different sizes
The data I have is a time series data (stock returns), and I am training a Random Forest Regressor on it. Total observations = 2499
To better evaluate the performance, I have implemented rolling ...
- 101
0
votes
1
answer
482
views
Xgboost fit won't recognize my custom eval_metric. Why?
Do you know why my custom_eval_metric doesn't work? I get the error:
...
- 3
0
votes
0
answers
8
views
Multiclass classification oob error
Im implementing a random forrest for a 6 class classification and witnessing a strange phenomenon.
I have 10 percent of my set sectioned out as a pseudo validation set. Im training 50 percent of the ...
- 1
4
votes
0
answers
499
views
sklearn FutureWarning message when running a CNN model
When I run my model, I am receiving the following error message:
...
- 125
3
votes
1
answer
364
views
Why does the MAE still remain, at all?
This may seem to be a silly question. But I just wonder why the MAE doesn't reduce to values close to 0.
It's the result of an MLP with 2 hidden layers and 6 neurons per hidden layer, trying to ...
- 48
-2
votes
1
answer
2k
views
ImportError: Pandas requires version '0.3.0' or newer of 's3fs' [closed]
I'm trying to read files from S3, using boto3, pandas, anaconda, but I have the following error:
...
0
votes
1
answer
2k
views
recognizing the correct word & "Set type is unordered"-error in python-pandas
My Data Set (CSV):
...
- 13
0
votes
2
answers
78
views
What is the value of AIC criterion if RSS is 0? [closed]
The AIC formula is :
$AIC = 2k + n Log(RSS/n)$
So if RSS is equal to 0, it is undefined. How do I deal with this? What value should it take?
0
votes
2
answers
875
views
Beautifulsoup find_all returns TypeError: list indices must be integers or slices, not str [closed]
This should have an easy solution but I can't understand how to avoid it.
...
- 99
0
votes
1
answer
894
views
1
vote
1
answer
15
views
Reason of use of Product rule of Probability in Predicting Error
P(x,y) = P(y|x)P(x)
Why do we use this in estimating expected prediction error?
i.e. E{(y - f(x))^2}
I researched and I came to know that it helps in figuring out noise but How?
- 21
3
votes
3
answers
4k
views
Cannot clone object <keras.wrappers.scikit_learn.KerasRegressor object at 0x7fdc9c3ba550>
Trying to hypertune ANN but getting an error while using fit..(grid1.fit(X_train, y_train))
Below is the code
...
1
vote
1
answer
6k
views
Python - Logistic (Logit) Regression - why am I getting an Endog error?
I'm running the following code:
...
1
vote
2
answers
156
views
How to make tool that's robust to user-generated typos?
Background: A client is generating datasets (excel files). They asked I make an app to analyze the datasets, e.g. summary tables and figures. I'm doing this in R shiny.
Problem: There are many typos ...
- 141
0
votes
0
answers
1k
views
Operands Could not be Broadcast with Shapes (19,)(0,)
I have googled and read something similar to the problem I have but I do not seem to know how to fix the error I got from this particular code:
...
- 171
0
votes
0
answers
33
views
CNN models comparison
I coded a 38 layer CNN and 8 layer CNN but there's something wrong in my 38 layer CNN, which doesn't learn anything. Not able to fugure out what's wrong. They were trained on CIFAR.
1
vote
1
answer
70
views
Making Sense of this Error Message
I am using a book and a video to learn how to use KNN method to classify movies according to their genres.This is my code:
...
- 171
1
vote
1
answer
78
views
Can an R^2, or coefficient of determination be used on non-linear data?
I have used the $R^2$ metric to determine how well my neural network performs a non-linear regression. And it seems to work. The plots look almost identical, and I get an $R^2$ value of 0.93... it ...
- 129
1
vote
1
answer
1k
views
MLP Parameter tuning - gridsearchCV cannot fit?
I'm making an MLP classifier for binomial classification from 145 features.
I want to get the best parameters on my MLP classifier to get a better prediction so I followed the answer to this question,...
- 33
0
votes
1
answer
337
views
What are good practices in reporting RMSE or MAPE estimates for a machine learning model?
I have built a regression model to estimate prices given some attributes. Prices are expressed in million USD, with average of 4.4 million USD. I need to provide an estimate of the RMSE and MAPE of ...
- 31
0
votes
2
answers
53
views
I am getting different mean_absolute_error when i retrain my model everything same
I have set my numpy random seed to 0.
I am training on colab and using keras.
I didn't change anything.
I just re-ran my cell and the val_absolute_error changed.
Code:
...
1
vote
1
answer
149
views
How to create a system to detect text structure of a file?
Let's say I want to create a Machine Learning system that has a lot of log files of some few types (F1, F2,.. Fn) and I get a new Log file with maybe some errors or ...
- 111
0
votes
0
answers
25
views
Error using imread function in matlab code
I was doing some sort of speech recognition pattern for recognition of sound but I stuck at imread error in matlab, any advice what to change in picture below you can find code and error.
Code
Error
...
- 11
1
vote
1
answer
274
views
Importing Excel format data into R/R Studio and using glmnet package?
I have no problem importing Excel formatted data into R/R Studio and use all other R packages that I use. But, when I want to use the glmnet package to develop a regularization model, I invariably ...
- 121
1
vote
1
answer
193
views
Should I only use scalar labels with Keras LSTM?
I have an array X_train = (1110,25,2) and a y_train = (1110,5,2). It means I use arrays with length of 25 for inputs and length ...
- 163
1
vote
1
answer
939
views
What is the error rate for random guessing?
I am studying for my Machine Learning exam. In sample exam questions, there is a specific one that I could not understand:
And the question is: "What is the error rate for random guessing?"
I could ...
- 13
2
votes
2
answers
6k
views
PySpark: java.io.EOFException
System:
1 name node, 4 cores, 16 GB RAM
1 master node, 4 cores, 16 GB RAM
6 data nodes, 4 cores, 16 GB RAM each
6 worker nodes, 4 cores, 16 GB RAM each
around 5 Terabytes of storage space
The data ...
- 131
2
votes
1
answer
18k
views
1
vote
0
answers
41
views
binary classification for counting - estimating the error on counts due to error on prediction score
Ok, so I have the following set up:
I have a binary classification problem and I am classifying events into signal and background. Ultimately, I want to count how many background events and how many ...
5
votes
1
answer
1k
views
Training on accurate data versus noisy data
I have data currently available that is very accurate and I would like to train my classification methods on this set of clean data to learn the important markers for distinguishing between classes. ...
- 185
0
votes
1
answer
117
views
Regression model performance with noisy dependent variable
I'm doing a support vector regression with the dependent variable representing measurements from an uncalibrated sensor (measurement error between 2% and 20%) and I want to study the effect of this ...
- 11
0
votes
2
answers
17k
views
Tensorflow InvalidArgumentError: You must feed a value for placeholder tensor
I come across this error when I run the following code, trying to get prediction on test data. By printing out operation names, I see no operation named ...
- 205
1
vote
1
answer
47
views
k nearest neighbors method, temporal trend in error
I have this set of data that looks like this
I was asked o build a $k$-nearest neighbors algorithm for it which I just finished building. I have this question in regards to the data that I do not ...
- 143
1
vote
1
answer
29
views
Implementation of reliable rule learning
I want to perform "reliable rule learning", i.e. mining a set of rules with a very low number of false negatives. I recently read the paper "Reliable agnostic learning" by Kalai et al. (https://doi....
- 21
1
vote
1
answer
60
views
Matplotlib: plot indicating the precision of measurements
I have some data with some margin of error and am using numpy arrays to plot that data. Assuming the precision is, let's say, 0.05 or 0.03grams, then the data will be something like
[4.0 $\pm$ 0.05, ...
- 131
2
votes
0
answers
94
views
Errorbars on a weighted average (of a non gaussian distribution)
I have some datapoints $x_i$ and errors $\sigma_i$ which are the absolute value of some datapoints $w_i$ with (supposed) gaussian errorbars (the $\sigma_i$). The $x_i$ are amplitudes so we did not ...
- 121
5
votes
1
answer
69
views
Theoretical background for model arhitecture choosing
Suppose I have a dataset $X$ and two different binary labels $y_{1}$ and $y_{2}$. The classes are very imbalanced - 3% of true in $y_{1}$ and 2% in $y_{2}$. Moreover, there are no pairs of (0,1), so, ...
1
vote
1
answer
165
views
Help training Back-propagation Neural Network With 150k training pairs
I am currently trying to train my backpropagation to classify 150k training pairs. Each training pair is a vector of 18 Bipolar numbers and it runs through 2 hidden layers with a final output of 1 ...
3
votes
0
answers
1k
views
2
votes
2
answers
21k
views
Problems with accuracy.score sklearn
I am learning python and trying myself out at mashine learning. I am reproducing a super simple example - based on the infamous iris dataset. Here it goes:
...
- 155
3
votes
2
answers
8k
views
First steps with Python and scikit-learn
I believe I have a simple if not trivial question. I have a background in statistics and I tend to use Stata and R quite a bit. I am interested in learning Python. I used it for a while now and ...
- 155
1
vote
1
answer
241
views
Uncertainty calculation through integration and correct analysis methodology
In the following text, uncertainty refers to standard deviation.
My methodology and notation was based mainly on the book "A Student's Guide to Data and Error Analysis" by H.J.C. Berendsen."
...
2
votes
0
answers
59
views
Modified Voting Algorithm to find the best recommendation
I have to find the best 10 items from the set of items for x number of given features. I don't know what the best recommendation will be. User data is not available to validate it. After reading a ...
- 325
-1
votes
1
answer
150
views
R error using Knitr
I am attempting to compile code using Knitr in R.
My code below is returning the following error, and causes errors in the rest of the document.
...
- 79