What is the difference between the layers.TextVectorization() and

from tensorflow.keras.preprocessing.text import Tokenizer
from tensorflow.keras.preprocessing.sequence import pad_sequences

And when to use what ?


1 Answer 1


Tokenization is the process of splitting a stream of language into individual tokens.

Vectorization is the process of converting string data into a numerical representation.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.