Non-determinism comes in many forms. I don't think it's an all or nothing thing.

Eliminating non-determinism is always nice, even if lots of other non-determinism remains.

Having predictable and understandable resource use is a nice plus. Removing dynamic memory allocation also tends to increase locality, remove indirections, and remove error handling paths from your code.