Can BERT do the next-word-predict task?

As BERT is bidirectional (uses bi-directional transformer), is it possible to use it for the next-word-predict task? If yes, what needs to be tweaked?

• Have you seen the original publication? It seems to be addressing prediction at the sentence level, as explained in its section 3.3.2. – mapto Feb 28 '19 at 9:07
• Consider a related discussion on GitHub. – mapto Mar 13 '19 at 10:04