I want to study and develop some application using reinforcement learning machine learning methods. I am already familiar with classification problem using supervised learning.

Can someone suggest me some material (links, youtube tutorials, pdf notes, ...) or some simple script in Rstudio (using maybe the iris dataset) to start studying from?



2 Answers 2


As your question was focused on reinforcement learning with RStudio I.e., in R language


You Tube


Tutorial links


Lecture NOTES


  • Mastering Reinforcement Learning with Python: Build next-generation, self-learning models using reinforcement learning techniques and best practices
  • Reinforcement Learning Algorithms with Python: Learn, understand, and develop smart algorithms for addressing AI challenges
  • Python Reinforcement Learning Projects: Eight hands-on projects exploring reinforcement learning algorithms using TensorFlow
  • Reinforcement Learning: Industrial Applications of Intelligent Agents
  • Handbook of Reinforcement Learning and Control: 325 (Studies in Systems, Decision, and Control)
  • Algorithms for Reinforcement Learning: Csaba Szepesvari. Nice compendium of ready to be implemented algorithms.
  • Reinforcement Learning and Dynamic Programming using Function Approximators. Busoniu, Lucian; Robert Babuska ; Bart De Schutter ; Damien Ernst (2010). This is a very practical book that explains some state-of-the-art algorithms (i.e., useful for real world problems) like fitted-Q-iteration and its variations.
  • Reinforcement Learning: State-of-the-Art. Vol. 12 of Adaptation, Learning and Optimization. Wiering, M., van Otterlo, M. (Eds.), 2012. Springer, Berlin. In Sutton's words "This book is a valuable resource for students wanting to
go beyond the older textbooks and for researchers wanting to easily catch up with
recent developments".
  • Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles : Draguna Vrabie, Kyriakos G. Vamvoudakis , Frank L. Lewis. I am not familiar with this one, but I have seen it recommended.
  • Markov Decision Processes in Artificial Intelligence, Sigaud O. & Buffet O. editors, ISTE Ld., Wiley and Sons Inc, 2010. I definitely suggest the books by Sutton and Barto as an excellent intro, the chapter by Bertsekas for getting a solid theoretical background and the book by Busoniu et al. for practical algorithms that can solve some non-toy problems. I also find useful the book by Szepesvari as a quick reference for understanding an comparing algorithms. There are also several good specialized monographs and surveys on the topic, some of these are:

The book "Reinforcement Learning" by Barto and Sutton is standard literature and was study material in at least two of my lectures. The presented algorithms are quite basic, giving you a proper foundation before you can delve into deep RL.

As soon as you have got solid understanding of the basics, here are good algorithms/papers about deep RL which I'd recommend reading in the order:


PPO / Proximal Policy Optimization Algorithms by Schulman et al.

World Models / World Models by Ha and Schmidhuber

Dreamer / Dream to Control: Learning Behaviors by Latent Imagination by Hafner et al.

Note these papers are just a small part of many different approaches, but should give you a rough overview about what has been developed in the last years.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.