Overview
- Explains deep reinforcement learning implementation using TensorFlow, PyTorch and OpenAI Gym
- Comprehensive coverage on fine-tuning Large Language Models using RLHF with complete code examples
- Every concept is explained with the help of a working code which can run with minimal effort
Buy print copy
Tax calculation will be finalised at checkout
About this book
Gain a theoretical understanding to the most popular libraries in deep reinforcement learning (deep RL). This new edition focuses on the latest advances in deep RL using a learn-by-coding approach, allowing readers to assimilate and replicate the latest research in this field.
New agent environments ranging from games, and robotics to finance are explained to help you try different ways to apply reinforcement learning. A chapter on multi-agent reinforcement learning covers how multiple agents compete, while another chapter focuses on the widely used deep RL algorithm, proximal policy optimization (PPO). You'll see how reinforcement learning with human feedback (RLHF) has been used by chatbots, built using Large Language Models, e.g. ChatGPT to improve conversational capabilities.
You'll also review the steps for using the code on multiple cloud systems and deploying models on platforms such as Hugging Face Hub. The code is in Jupyter Notebook, which canbe run on Google Colab, and other similar deep learning cloud platforms, allowing you to tailor the code to your own needs.
Whether it’s for applications in gaming, robotics, or Generative AI, Deep Reinforcement Learning with Python will help keep you ahead of the curve.
What You'll Learn
- Explore Python-based RL libraries, including StableBaselines3 and CleanRL
- Work with diverse RL environments like Gymnasium, Pybullet, and Unity ML
- Understand instruction finetuning of Large Language Models using RLHF and PPO
- Study training and optimization techniques using HuggingFace, Weights and Biases, and Optuna
Who This Book Is For
Software engineers and machine learning developers eager to sharpen their understanding of deep RL and acquire practical skills in implementing RL algorithms fromscratch.
Keywords
- Artificial Intelligence
- Deep Reinforcement Learning
- PyTorch
- Neural Networks
- Robotics
- Autonomous Vehicle
- Machine Learning
- Markov Decision Processes
- OpenAI Gym
- Deep Q - Learning
Authors and Affiliations
About the author
Nimish is a seasoned entrepreneur and an angel investor, with a rich portfolio of tech ventures in SaaS Software and Automation with AI across India, the US and Singapore. He has over 30 years of work experience. Nimish ventured into entrepreneurship in 2006 after holding leadership roles at global corporations like PwC, IBM, and Oracle.
Nimish holds an MBA from Indian Institute of Management, Ahmedabad, India (IIMA), and a Bachelor of Technology in Electrical Engineering from Indian Institute of Technology, Kanpur, India (IITK). ​
Bibliographic Information
Book Title: Deep Reinforcement Learning with Python
Book Subtitle: RLHF for Chatbots and Large Language Models
Authors: Nimish Sanghi
Publisher: Apress Berkeley, CA
eBook Packages: Professional and Applied Computing, Apress Access Books, Professional and Applied Computing (R0)
Copyright Information: Nimish Sanghi 2024
Softcover ISBN: 979-8-8688-0272-0Due: 20 July 2024
eBook ISBN: 979-8-8688-0273-7Due: 20 July 2024
Edition Number: 2
Number of Pages: XVI, 606
Number of Illustrations: 105 b/w illustrations, 99 illustrations in colour