Count Vectorizer is a way to convert a given set of strings into a frequency representation.Count Vectors can be helpful in understanding the type of text by the frequency of words in it. But its major disadvantages are:
Its inability in identifying more important and less important words for analysis.
It will just consider words that are abundant in a corpus as the most statistically significant word.
It also doesn't identify the relationships between words such as linguistic similarity between words.
TF-IDF is better than Count Vectorizers because it not only focuses on the frequency of words present in the corpus but also provides the importance of the words. We can then remove the words that are less important for analysis, hence making the model building less complex by reducing the input dimensions.
Even though TFIDF can provide a good understanding about the importance of words but just like Count Vectors, its disadvantage is:
It fails to provide linguistic information about the words such as the real meaning of the words, similarity with other words etc.
So, you should try to align your use case with pros mentioned above. Also i would suggest to explore Word2vec and Glove Embeddings if you wants vectors to have some contextual information