Questions tagged [loss]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
2k views

Should Discriminator Loss increase or decrease?

This question is purely based on the theoretical aspect of GANs. So, when training a GAN how should the discriminator loss look like? Should the loss of discriminator increase (as the generator is ...
1
vote
0answers
15 views

The case of (1,478) dim and parameters of neural network to find out

colleagues, actually I am kind'a new to NN, but hard trying.. I have data: Index: 40073 entries (excluded from training, UID) Columns: 484 entries dtypes: bool(468), float64(2), int64(13), object(1) I ...
1
vote
0answers
39 views

How to calculate MAE and threshold in a multivariate time series

I'm trying to understand how to calculate the MAE in my time series and then the thresholds to understand which of my data in the test set are anomalies. I'm following this tutorial, which is based on ...
1
vote
0answers
18 views

How to interpret high loss value from model.evaluate() on test data

I'm collecting some metrics for my model's performance using: ...
1
vote
1answer
49 views

Interpreting Categorical Crossentropy Loss

I would like to ask for clarification about the loss values outputted during training using Categorical Crossentropy as the loss function. If I have 11 categories, and my loss is (for the sake of the ...
1
vote
1answer
56 views

Accuracy graph of binary classification by CNN [closed]

Why in binary classification of images with CNN the loss and accuracy graph are so unstable? I mean accuracy of validation test does not increase smoothly, it goes to 80%, then comes to 60%, then ...
0
votes
1answer
39 views

Training loss = 0, training accuracy =1, validation and test around 85%

I have created different CNNs for doing image classification. The dataset is this: https://www.kaggle.com/crowww/a-large-scale-fish-dataset There are 9 classes, and each class contains 1000 images of ...
0
votes
2answers
51 views

Regression problem with Deep Learning

I'm working on the Housing Price dataset, where the target is to predict the housing price. The price of the house will always be positive and according to me, it's possible that the model can predict ...
0
votes
1answer
230 views

Is it vital to use weighted metrics with weighted loss functions?

When one has an imbalanced machine learning problem, let's say a binary classification problem where class 0 is a majority class and class 1 is a minority class. Here class 1 is the most important ...
0
votes
0answers
17 views

NeMo Conformer-CTC Predicts Same Word Repeatedly When Fine-Tuning

I'm using the NeMo Conformer-CTC small on the LibriSpeech dataset (the clean subset, around 29K inputs, using 90% for training and 10% for testing). I use Pytorch Lightning. When I try to train, the ...
0
votes
0answers
28 views

Training Loss increases, but Validation Loss decreases

I am finetuning a T5 transformer model on a sequence to sequence task. My program outputs the training and validation loss every 500 optimization steps. However, when I first started training the ...
0
votes
1answer
14 views

why the accuracy result and the loss result of an ANN model is inconsistent?

I trained a model based on an ANN and the accuracy is 94.65% almost every time while the loss result is 12.06%. Now my question is shouldn't the loss of the model be (100-94 = 6%) or near it? Why it ...
0
votes
1answer
129 views

HuggingFace Transformers is giving loss: nan - accuracy: 0.0000e+00

I am a HuggingFace Newbie and I am fine-tuning a BERT model (distilbert-base-cased) using the Transformers library but the training loss is not going down, instead ...
0
votes
0answers
39 views

Is my CNN model overfitting or underfitting?

I would like to be sure of whether the model is overfitting or undercutting. Being new to this, is there any specific point to identify when to stop the training process. Any help in this regard would ...
0
votes
0answers
44 views

Validation Accuracy, Validation Loss and Training Loss Remain Constant

Background Hello, I'm new to deep learning and I recently trained a simple convolutional neural network from Francois Chollet's Deep Learning with Python book. The network was trained on 12500 images ...
0
votes
0answers
51 views

Q values loss per episode and mean absolute error

I am new to deep reinforcement learning! I am following this code for my adaptation problem (doing actions) https://github.com/jaromiru/AI-blog/blob/master/CartPole-DQN.py I am wondering how I can ...
0
votes
0answers
23 views

Validation Loss Decreases Then Increases to The Same Values

I am training a transformer-based model using Pytorch. The training loss decreases until it hits a floor, which is expected. However, the validation loss decreases to a minimum then starts increasing. ...
0
votes
0answers
27 views

How to increase accuracy and decrease loss of my model

https://jovian.ai/casella0798/badmodel I created the model above to predict red wine quality. I have 6 classes, from 3 to 8. Dataset is unbalanced, with a lot of classes 5 and 6. My model performs ...
0
votes
0answers
40 views

Training loss in CNN oscillates but not due to too large learning rate

I am training a CNN (SSD Inception V2) and I get a strange shape of the training loss: At first, I thought it was a too large learning rate (suggested in Question Oscillating loss in CNN ). But after ...
0
votes
0answers
20 views

Sudden drop in loss at epoch start, then gradual raise

I'm building an autoencoder for natural language words. The question: Why do I see at the start of each epoch a sudden drop in the loss and then gradual bounce back (loss raises but slowly) followed ...
-1
votes
1answer
39 views

Why are the Loss and Accuracy metrics not suitable?

I have read in a book where it was described that Loss and Accuracy are only conditionally suitable for a statement strength. Other metrics are used like Precision, Recall, ... . Does anyone know a ...
-2
votes
1answer
60 views

Why do people prefer $(target-actual)^2$ over $|(target-actual)|$ [duplicate]

When computing loss functions, people use $(target-actual)^2$. They sqaure it to prevent any negative loss. But we can even use $|(target-actual)|$ to prevent any negative loss. So, why do people ...