Hot answers tagged

1

Only this line is solved the error ax.bar(npy_dataframe["Complaint Type"].value_counts().head().keys(),npy_dataframe["Complaint Type"].value_counts().head())


1

For your first question, you can check if the tokenizer covers a certain string with the following: text = 'today is a good day 😃' ids2string = lambda ids: tokenizer.convert_tokens_to_string(tokenizer.convert_ids_to_tokens(ids)) ids2string(tokenizer(text)['input_ids']) > <s>today is a good day 😃</s> If emoji is not included in the tokenizer ...


Only top voted, non community-wiki answers of a minimum length are eligible