Predictive Simulations to Study Plantarflexors in Gait Pathologies
Predictive Simulation of Biologic Motion using SCONE
Non-programming exercise solutions were checked against ChatGPT. However, their website does say you can email them to get solutions back.
Some programming exercises, examples, and algorithms are implemented in my Github repository.
Chapter 1: Introduction
Part 1: Tabular Solution Methods
Chapter 2: Multi-Armed Bandits
Chapter 3: Finite Markov Decision Processes
Chapter 4: Dynamic Programming
Chapter 5: Monte Carlo Methods
Project: Right Turn Racer
Chapter 6: Temporal Difference Learning
Project: CliffWalking
Chapter 7: n-step BootStrapping