3
$\begingroup$

What is the difference between the layers.TextVectorization() and

from tensorflow.keras.preprocessing.text import Tokenizer
from tensorflow.keras.preprocessing.sequence import pad_sequences

And when to use what ?

$\endgroup$

1 Answer 1

5
$\begingroup$

Tokenization is the process of splitting a stream of language into individual tokens.

Vectorization is the process of converting string data into a numerical representation.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.