andy1li/udacity-reinforcement — explained in plain English
Analysis updated 2026-07-17 · repo last pushed 2021-05-13
Study reinforcement learning fundamentals like Dynamic Programming, Monte Carlo, and Temporal Difference methods.
Reference example notebooks for practical RL tasks like teaching a robot to walk or controlling a pendulum.
Use as a template for structuring your own reinforcement learning study projects.
| andy1li/udacity-reinforcement | cynikolai/sequence-cluster-learner | michelepapucci/impacts | |
|---|---|---|---|
| Stars | 1 | 1 | 1 |
| Language | Jupyter Notebook | Jupyter Notebook | Jupyter Notebook |
| Last pushed | 2021-05-13 | 2017-12-02 | — |
| Maintenance | Dormant | Dormant | — |
| Setup difficulty | moderate | easy | easy |
| Complexity | 3/5 | 1/5 | 2/5 |
| Audience | researcher | general | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires a Python/Jupyter environment plus whatever RL libraries each individual notebook depends on.
This repository is a collection of learning projects from Udacity's Deep Reinforcement Learning course. It documents one person's journey through increasingly complex techniques for teaching machines to make decisions and learn from experience. Reinforcement learning is a way to train AI systems to get better at tasks by rewarding good decisions and penalizing bad ones, much like how you'd train a dog. The repository shows how to build these systems using different mathematical approaches, starting with simple methods and moving to more sophisticated ones. The early projects (Dynamic Programming, Monte Carlo, Temporal Difference) cover foundational techniques that form the backbone of the field. Later projects tackle real-world problems like teaching a robot to walk, controlling a pendulum, or managing a trading portfolio. Each project is typically a Jupyter Notebook, which is an interactive document that shows both the code and explanations side by side. The structure reveals a clear progression. The first few lessons are marked as complete and teach the core theory, how to calculate the best actions in a problem space. Once those foundations are solid, the projects branch into practical applications. Some involve simulated environments where an AI learns to navigate or control movement. Others explore policy gradient methods, which is a different mathematical approach to training these systems. The mix of completed and in-progress tasks suggests this is an active learning journal, not a finished library or tool. This repository would be useful for anyone trying to learn reinforcement learning themselves, whether as a student working through the same Udacity course or someone self-studying this field. It's a personal study archive rather than a tool you'd use directly, but it could serve as a reference for how to structure your own projects or as inspiration for what techniques to explore next. The README doesn't provide much documentation beyond the project checklist, so most value comes from reading the individual notebooks themselves.
A personal study archive of Jupyter notebooks from Udacity's Deep Reinforcement Learning course, progressing from basic theory to robot walking and trading projects.
Mainly Jupyter Notebook. The stack also includes Jupyter Notebook, Python.
Dormant — no commits in 2+ years (last push 2021-05-13).
Setup difficulty is rated moderate, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
double-check against the repo, no cap.