That's not to say that LLMs are currently a poor fit for many domains (and maybe always will be), but I feel like your general objection would apply to many – and even deterministic – models we've been using for a long time as well.

Or would you say that weather forecasts are completely useless as well?

As long as you arent trying to offload any decision making, LLMs are extremely efficient tools.