Today I read an interesting post to drop RNNs for sequential models.

However, the post, unfortunately, didn't go into much detail on how one would study the attention based models and start experimenting with them.

The only usefull link was to this paper which uses convolutional networks.

The paper is very packed and dense, making it hard for me to understand, and I couldn't find any books on implementation of these attention models.

Does anyone have any suggestions?

  • $\begingroup$ Use GitHub to find them.. books are not needed anymore (partially) when it comes to DL since the recent update will never be on a book in the due time but it will be Git! $\endgroup$
    – Aditya
    Sep 20 '18 at 16:00

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.