# How Does Cross-Entropy Work With Softmax Activation Function?

I found online that the derivative of a cross-entropy activation function with a softmax activation is (output - expected), which had me very confused. If for example, the expected value is 1, and since the output is always less than 1 (softmax), doesn't it mean that the derivative is negative, and that if we train our weights with this gradient, the weights will decrease, and so the output will decrease in the next iteration, thus increasing the error? How does it work?