Do sklearn Pipelines automatically split big datasets in chunks for the transform method?

Each transformer in the pipe has a transform method. It seems as sklearn by default pushes all X_train into the transform method. Is there a built-in function to apply the transformers batchwise?

X = pipe[0].transform(X_train )


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.