1
$\begingroup$

I have a sparse matrix of count data that I'm using as input to a neural network.

I know, usually, the input data should be normalized (e.g. via min-max scaling, $z$-score standardization, etc.). But for features that are counts, what is a good approach? Should I $\log_2(x+1)$ transform the data and then do a $z$-score standardization? Is there another better approach?

Improve this question
$\endgroup$

1 Answer 1

Reset to default
1
$\begingroup$

One option is to convert counts to rate. Rates are always bound between 0 and 1. For example instead of a count of 100 events, the data could be encoded as a rate of .10 (100 events out of 1,000 opportunities).

Improve this answer
$\endgroup$
1
  • $\begingroup$ I like this idea, specially if you have an expected top count. If you divide your counts for the expected top count, you convert your input in universal rates, that do not depend on the samples you have. It´s the same when you divide pixel values by 255 before inputing them to a convolutional NN. $\endgroup$
    – AlexSC
    Commented Aug 16, 2023 at 10:59

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.