Notes

Modern Robotics

Projects

Northwestern Robotics Coursera Specialization, Course 2: Robot Kinematics
Northwestern Robotics Coursera Specialization, Course 3: Robot Dynamics

Foot and Ankle Biomechanics

Notes

Chapter 1: Anatomy of the Foot
Chapter 2: Basic Biomechanics
Chapter 3: Anatomical Nomenclature: Conundrums of Nonstandardized Foot and Ankle Terminology
Chapter 4: Kinematics and Kinetics of the Foot and Ankle during Gait
Chapter 5: Bone, Cartilage, and Joint Function
Chapter 6: Muscles and Tendons
Chapter 7: Ligaments
Chapter 8: Plantar Soft Tissue

OpenSim

Notes

Predictive Simulations to Study Plantarflexors in Gait Pathologies
Predictive Simulation of Biologic Motion using SCONE

Reinforcement Learning: An Introduction

Non-programming exercise solutions were checked against ChatGPT. However, their website does say you can email them to get solutions back.

Some programming exercises, examples, and algorithms are implemented in my Github repository.

Projects

Right Turn Racer
CliffWalking
Mountain Car

Notes

Chapter 1: Introduction
Part 1: Tabular Solution Methods
Chapter 2: Multi-Armed Bandits
Chapter 3: Finite Markov Decision Processes
Chapter 4: Dynamic Programming
Chapter 5: Monte Carlo Methods
Chapter 6: Temporal Difference Learning
Chapter 7: n-step BootStrapping
Chapter 8: Planning and Learning with Tabular Methods
Chapter 9: On-policy Prediction with Approximation
Chapter 10: On-policy Control with Approximation
Chapter 11: Off-policy Methods with Approximation
Chapter 12: Eligibility Traces
Chapter 13: Policty Gradient Methods