Go for it. Start small. Bite off just a little at a time.

Understand that age is neither good nor bad. There is a lot of ageism in the industry, so one thing you should be prepared to do is strike out on your own if you need to (either part-time as moonlighting or otherwise).