1
$\begingroup$

I am deploying a LSTM pytorch model for production and I have issue with scaling the LSTM output correctly. While the model was tested the output was scaled with label data:

y_scaler = MinMaxScaler(feature_range=(-1, 1))
y_test_scaled = y_scaler.transform(y_test.reshape(-1, 1))

Now when I am loading the model from state_dict and making a prediction how I should inverse scale the data? I am not having the newest label data during the forecast. For the input data I am using QuantilieTransformer. I can make predictions this way:

y_test_scaler = MinMaxScaler(feature_range=(-1, 1))
y_minmax = label_data # For example past 40 days of the label data

y_test_scaled = y_test_scaler.fit_transform(y_minmax.reshape(-1, 1))

If I use the whole label-data as y_minmax the results are not good enough. But If I use less label data for scaling predictions are decent.

# Inverse transform predictions from LSTM model
y_actual = y_test_scaler.inverse_transform(y.reshape(-1, 1))

Should the output of LSTM be somehow inversed with x_scaler or how? :)

EDIT: I got good results by making prediction for large amount of sequences. (Predicting 1 sequence to future and 300 sequences of history data). It is not a problem to load a lot of history data during the prediction, but I believe there is a smarter way to get the same result.

$\endgroup$

1 Answer 1

0
$\begingroup$

Answering to my own question: One way to do it was to use joblib dumping the scalers that were used in the training process.

More about it is discussed in here: https://stackoverflow.com/questions/41993565/save-minmaxscaler-model-in-sklearn

Works the same way for LSTM.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.