Questions tagged [error-handling]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
7 views

Error analysis with one large and one small value

I have given two variables $(x_{true}, y_{true})$. By using two variables namely, ($\alpha, \beta$), I can obtain ($x_{test}, y_{test}$). Now, at this point my aim is to find $\alpha_{best}$ and $\...
user avatar
  • 113
1 vote
1 answer
30 views

MAE divided by median metric

I have a regression task for which my best models has a Mean Absolute Error (MAE) of approximately 15,000. The median value of the target variable is approximately 150,000. I want to report that the ...
user avatar
  • 65
0 votes
1 answer
11 views

SOS: Working LightGBM model script to find best model

I have been trying to get a working LightGBM model which I can train on my data, select the best performing model with highest f1 score and then use it obtain the f1 score on the testing data. However,...
user avatar
  • 1
2 votes
0 answers
13 views

Characterizing errors in rotation and translation while estimating camera pose from images

Has anyone characterized the errors in rotation and translation while estimating camera pose of natural images using SFM or visual odometry? I mean, when estimating camera pose, what is the typical ...
user avatar
1 vote
0 answers
21 views

How to include the sudden peaks/bursts in LSTM based time-series model's training

I am using LSTM for time-series prediction whereby I am taking past 50 values as my input. Now, the thing is that it is predicting just OKish, and not doing the exact prediction, especially for the ...
user avatar
  • 131
0 votes
1 answer
23 views

Comparing RMSEs of multiple test sets having different sizes

The data I have is a time series data (stock returns), and I am training a Random Forest Regressor on it. Total observations = 2499 To better evaluate the performance, I have implemented rolling ...
user avatar
0 votes
1 answer
482 views

Xgboost fit won't recognize my custom eval_metric. Why?

Do you know why my custom_eval_metric doesn't work? I get the error: ...
user avatar
0 votes
0 answers
8 views

Multiclass classification oob error

Im implementing a random forrest for a 6 class classification and witnessing a strange phenomenon. I have 10 percent of my set sectioned out as a pseudo validation set. Im training 50 percent of the ...
user avatar
4 votes
0 answers
499 views

sklearn FutureWarning message when running a CNN model

When I run my model, I am receiving the following error message: ...
user avatar
  • 125
3 votes
1 answer
364 views

Why does the MAE still remain, at all?

This may seem to be a silly question. But I just wonder why the MAE doesn't reduce to values close to 0. It's the result of an MLP with 2 hidden layers and 6 neurons per hidden layer, trying to ...
user avatar
-2 votes
1 answer
2k views

ImportError: Pandas requires version '0.3.0' or newer of 's3fs' [closed]

I'm trying to read files from S3, using boto3, pandas, anaconda, but I have the following error: ...
user avatar
0 votes
1 answer
2k views

recognizing the correct word & "Set type is unordered"-error in python-pandas

My Data Set (CSV): ...
user avatar
  • 13
0 votes
2 answers
78 views

What is the value of AIC criterion if RSS is 0? [closed]

The AIC formula is : $AIC = 2k + n Log(RSS/n)$ So if RSS is equal to 0, it is undefined. How do I deal with this? What value should it take?
user avatar
0 votes
2 answers
875 views

Beautifulsoup find_all returns TypeError: list indices must be integers or slices, not str [closed]

This should have an easy solution but I can't understand how to avoid it. ...
user avatar
  • 99
0 votes
1 answer
894 views

Python writing to Excel file: writerow() takes no keyword arguments

I have this script: ...
user avatar
  • 99
1 vote
1 answer
15 views

Reason of use of Product rule of Probability in Predicting Error

P(x,y) = P(y|x)P(x) Why do we use this in estimating expected prediction error? i.e. E{(y - f(x))^2} I researched and I came to know that it helps in figuring out noise but How?
user avatar
3 votes
3 answers
4k views

Cannot clone object <keras.wrappers.scikit_learn.KerasRegressor object at 0x7fdc9c3ba550>

Trying to hypertune ANN but getting an error while using fit..(grid1.fit(X_train, y_train)) Below is the code ...
user avatar
1 vote
1 answer
6k views

Python - Logistic (Logit) Regression - why am I getting an Endog error?

I'm running the following code: ...
user avatar
1 vote
2 answers
156 views

How to make tool that's robust to user-generated typos?

Background: A client is generating datasets (excel files). They asked I make an app to analyze the datasets, e.g. summary tables and figures. I'm doing this in R shiny. Problem: There are many typos ...
user avatar
0 votes
0 answers
1k views

Operands Could not be Broadcast with Shapes (19,)(0,)

I have googled and read something similar to the problem I have but I do not seem to know how to fix the error I got from this particular code: ...
user avatar
  • 171
0 votes
0 answers
33 views

CNN models comparison

I coded a 38 layer CNN and 8 layer CNN but there's something wrong in my 38 layer CNN, which doesn't learn anything. Not able to fugure out what's wrong. They were trained on CIFAR.
user avatar
1 vote
1 answer
70 views

Making Sense of this Error Message

I am using a book and a video to learn how to use KNN method to classify movies according to their genres.This is my code: ...
user avatar
  • 171
1 vote
1 answer
78 views

Can an R^2, or coefficient of determination be used on non-linear data?

I have used the $R^2$ metric to determine how well my neural network performs a non-linear regression. And it seems to work. The plots look almost identical, and I get an $R^2$ value of 0.93... it ...
user avatar
1 vote
1 answer
1k views

MLP Parameter tuning - gridsearchCV cannot fit?

I'm making an MLP classifier for binomial classification from 145 features. I want to get the best parameters on my MLP classifier to get a better prediction so I followed the answer to this question,...
user avatar
  • 33
0 votes
1 answer
337 views

What are good practices in reporting RMSE or MAPE estimates for a machine learning model?

I have built a regression model to estimate prices given some attributes. Prices are expressed in million USD, with average of 4.4 million USD. I need to provide an estimate of the RMSE and MAPE of ...
user avatar
  • 31
0 votes
2 answers
53 views

I am getting different mean_absolute_error when i retrain my model everything same

I have set my numpy random seed to 0. I am training on colab and using keras. I didn't change anything. I just re-ran my cell and the val_absolute_error changed. Code: ...
user avatar
1 vote
1 answer
149 views

How to create a system to detect text structure of a file?

Let's say I want to create a Machine Learning system that has a lot of log files of some few types (F1, F2,.. Fn) and I get a new Log file with maybe some errors or ...
user avatar
0 votes
0 answers
25 views

Error using imread function in matlab code

I was doing some sort of speech recognition pattern for recognition of sound but I stuck at imread error in matlab, any advice what to change in picture below you can find code and error. Code Error ...
user avatar
1 vote
1 answer
274 views

Importing Excel format data into R/R Studio and using glmnet package?

I have no problem importing Excel formatted data into R/R Studio and use all other R packages that I use. But, when I want to use the glmnet package to develop a regularization model, I invariably ...
user avatar
  • 121
1 vote
1 answer
193 views

Should I only use scalar labels with Keras LSTM?

I have an array X_train = (1110,25,2) and a y_train = (1110,5,2). It means I use arrays with length of 25 for inputs and length ...
user avatar
1 vote
1 answer
939 views

What is the error rate for random guessing?

I am studying for my Machine Learning exam. In sample exam questions, there is a specific one that I could not understand: And the question is: "What is the error rate for random guessing?" I could ...
user avatar
  • 13
2 votes
2 answers
6k views

PySpark: java.io.EOFException

System: 1 name node, 4 cores, 16 GB RAM 1 master node, 4 cores, 16 GB RAM 6 data nodes, 4 cores, 16 GB RAM each 6 worker nodes, 4 cores, 16 GB RAM each around 5 Terabytes of storage space The data ...
user avatar
  • 131
2 votes
1 answer
18k views

TypeError: '<' not supported between instances of 'int' and 'str'

I have the following code ...
user avatar
  • 243
1 vote
0 answers
41 views

binary classification for counting - estimating the error on counts due to error on prediction score

Ok, so I have the following set up: I have a binary classification problem and I am classifying events into signal and background. Ultimately, I want to count how many background events and how many ...
user avatar
5 votes
1 answer
1k views

Training on accurate data versus noisy data

I have data currently available that is very accurate and I would like to train my classification methods on this set of clean data to learn the important markers for distinguishing between classes. ...
user avatar
  • 185
0 votes
1 answer
117 views

Regression model performance with noisy dependent variable

I'm doing a support vector regression with the dependent variable representing measurements from an uncalibrated sensor (measurement error between 2% and 20%) and I want to study the effect of this ...
user avatar
  • 11
0 votes
2 answers
17k views

Tensorflow InvalidArgumentError: You must feed a value for placeholder tensor

I come across this error when I run the following code, trying to get prediction on test data. By printing out operation names, I see no operation named ...
user avatar
  • 205
1 vote
1 answer
47 views

k nearest neighbors method, temporal trend in error

I have this set of data that looks like this I was asked o build a $k$-nearest neighbors algorithm for it which I just finished building. I have this question in regards to the data that I do not ...
user avatar
1 vote
1 answer
29 views

Implementation of reliable rule learning

I want to perform "reliable rule learning", i.e. mining a set of rules with a very low number of false negatives. I recently read the paper "Reliable agnostic learning" by Kalai et al. (https://doi....
user avatar
1 vote
1 answer
60 views

Matplotlib: plot indicating the precision of measurements

I have some data with some margin of error and am using numpy arrays to plot that data. Assuming the precision is, let's say, 0.05 or 0.03grams, then the data will be something like [4.0 $\pm$ 0.05, ...
user avatar
2 votes
0 answers
94 views

Errorbars on a weighted average (of a non gaussian distribution)

I have some datapoints $x_i$ and errors $\sigma_i$ which are the absolute value of some datapoints $w_i$ with (supposed) gaussian errorbars (the $\sigma_i$). The $x_i$ are amplitudes so we did not ...
user avatar
  • 121
5 votes
1 answer
69 views

Theoretical background for model arhitecture choosing

Suppose I have a dataset $X$ and two different binary labels $y_{1}$ and $y_{2}$. The classes are very imbalanced - 3% of true in $y_{1}$ and 2% in $y_{2}$. Moreover, there are no pairs of (0,1), so, ...
user avatar
1 vote
1 answer
165 views

Help training Back-propagation Neural Network With 150k training pairs

I am currently trying to train my backpropagation to classify 150k training pairs. Each training pair is a vector of 18 Bipolar numbers and it runs through 2 hidden layers with a final output of 1 ...
user avatar
3 votes
0 answers
1k views

XgBoost error: contrasts can be applied only to factors with 2 or more levels

...
user avatar
  • 857
2 votes
2 answers
21k views

Problems with accuracy.score sklearn

I am learning python and trying myself out at mashine learning. I am reproducing a super simple example - based on the infamous iris dataset. Here it goes: ...
user avatar
  • 155
3 votes
2 answers
8k views

First steps with Python and scikit-learn

I believe I have a simple if not trivial question. I have a background in statistics and I tend to use Stata and R quite a bit. I am interested in learning Python. I used it for a while now and ...
user avatar
  • 155
1 vote
1 answer
241 views

Uncertainty calculation through integration and correct analysis methodology

In the following text, uncertainty refers to standard deviation. My methodology and notation was based mainly on the book "A Student's Guide to Data and Error Analysis" by H.J.C. Berendsen." ...
user avatar
2 votes
0 answers
59 views

Modified Voting Algorithm to find the best recommendation

I have to find the best 10 items from the set of items for x number of given features. I don't know what the best recommendation will be. User data is not available to validate it. After reading a ...
user avatar
  • 325
-1 votes
1 answer
150 views

R error using Knitr

I am attempting to compile code using Knitr in R. My code below is returning the following error, and causes errors in the rest of the document. ...
user avatar
  • 79