You will end up learning only that subset of lisp that this book implements. So this book is definitely as not overwhelming as it sounds.

In my case, I did know some lisp (Clojure) before starting out, but I'd strongly recommend that you don't hold back based only on that requirement.