https://nlpprogress.com/ aims to provide pointers to the state of the art papers and datasets for the main NLP tasks.
It seems to be updated regularly so far. However it depends on the efforts of volunteers so there's no guarantee about completeness or future updates.
If you want to be up to date with the new advancements, a good way is skimming through the accepted papers of the major NLP conferences, namely ACL, EMNLP, and the regional EACL, NAACL, AACL.
If you want even more information, you can skim through the papers uploaded to the arxiv. One way to do that is via Twitter, by following bots that tweet papers in ...