Questions tagged [loss]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
27 views

Training Loss increases, but Validation Loss decreases

I am finetuning a T5 transformer model on a sequence to sequence task. My program outputs the training and validation loss every 500 optimization steps. However, when I first started training the ...
0
votes
1answer
14 views

why the accuracy result and the loss result of an ANN model is inconsistent?

I trained a model based on an ANN and the accuracy is 94.65% almost every time while the loss result is 12.06%. Now my question is shouldn't the loss of the model be (100-94 = 6%) or near it? Why it ...
0
votes
1answer
62 views

HuggingFace Transformers is giving loss: nan - accuracy: 0.0000e+00

I am a HuggingFace Newbie and I am fine-tuning a BERT model (distilbert-base-cased) using the Transformers library but the training loss is not going down, instead ...
0
votes
0answers
38 views

Is my CNN model overfitting or underfitting?

I would like to be sure of whether the model is overfitting or undercutting. Being new to this, is there any specific point to identify when to stop the training process. Any help in this regard would ...
0
votes
0answers
40 views

Validation Accuracy, Validation Loss and Training Loss Remain Constant

Background Hello, I'm new to deep learning and I recently trained a simple convolutional neural network from Francois Chollet's Deep Learning with Python book. The network was trained on 12500 images ...
0
votes
0answers
48 views

Q values loss per episode and mean absolute error

I am new to deep reinforcement learning! I am following this code for my adaptation problem (doing actions) https://github.com/jaromiru/AI-blog/blob/master/CartPole-DQN.py I am wondering how I can ...
0
votes
1answer
38 views

Training loss = 0, training accuracy =1, validation and test around 85%

I have created different CNNs for doing image classification. The dataset is this: https://www.kaggle.com/crowww/a-large-scale-fish-dataset There are 9 classes, and each class contains 1000 images of ...
1
vote
0answers
33 views

How to calculate MAE and threshold in a multivariate time series

I'm trying to understand how to calculate the MAE in my time series and then the thresholds to understand which of my data in the test set are anomalies. I'm following this tutorial, which is based on ...
0
votes
0answers
23 views

Validation Loss Decreases Then Increases to The Same Values

I am training a transformer-based model using Pytorch. The training loss decreases until it hits a floor, which is expected. However, the validation loss decreases to a minimum then starts increasing. ...
1
vote
0answers
17 views

How to interpret high loss value from model.evaluate() on test data

I'm collecting some metrics for my model's performance using: ...
0
votes
0answers
26 views

How to increase accuracy and decrease loss of my model

https://jovian.ai/casella0798/badmodel I created the model above to predict red wine quality. I have 6 classes, from 3 to 8. Dataset is unbalanced, with a lot of classes 5 and 6. My model performs ...
1
vote
1answer
49 views

Interpreting Categorical Crossentropy Loss

I would like to ask for clarification about the loss values outputted during training using Categorical Crossentropy as the loss function. If I have 11 categories, and my loss is (for the sake of the ...
0
votes
0answers
39 views

Training loss in CNN oscillates but not due to too large learning rate

I am training a CNN (SSD Inception V2) and I get a strange shape of the training loss: At first, I thought it was a too large learning rate (suggested in Question Oscillating loss in CNN ). But after ...
-1
votes
1answer
37 views

Why are the Loss and Accuracy metrics not suitable?

I have read in a book where it was described that Loss and Accuracy are only conditionally suitable for a statement strength. Other metrics are used like Precision, Recall, ... . Does anyone know a ...
0
votes
0answers
19 views

Sudden drop in loss at epoch start, then gradual raise

I'm building an autoencoder for natural language words. The question: Why do I see at the start of each epoch a sudden drop in the loss and then gradual bounce back (loss raises but slowly) followed ...
1
vote
1answer
52 views

Accuracy graph of binary classification by CNN [closed]

Why in binary classification of images with CNN the loss and accuracy graph are so unstable? I mean accuracy of validation test does not increase smoothly, it goes to 80%, then comes to 60%, then ...
1
vote
1answer
2k views

Should Discriminator Loss increase or decrease?

This question is purely based on the theoretical aspect of GANs. So, when training a GAN how should the discriminator loss look like? Should the loss of discriminator increase (as the generator is ...
-2
votes
1answer
57 views

Why do people prefer $(target-actual)^2$ over $|(target-actual)|$ [duplicate]

When computing loss functions, people use $(target-actual)^2$. They sqaure it to prevent any negative loss. But we can even use $|(target-actual)|$ to prevent any negative loss. So, why do people ...
0
votes
2answers
49 views

Regression problem with Deep Learning

I'm working on the Housing Price dataset, where the target is to predict the housing price. The price of the house will always be positive and according to me, it's possible that the model can predict ...
0
votes
1answer
201 views

Is it vital to use weighted metrics with weighted loss functions?

When one has an imbalanced machine learning problem, let's say a binary classification problem where class 0 is a majority class and class 1 is a minority class. Here class 1 is the most important ...