Not a book or a course, but rather a blog post by Sanjeev Arora et al that made backpropagation crystal clear for me: [1].

[1] https://www.offconvex.org/2016/12/20/backprop/