Testing for LLMs is an evolving practice but you need to have tests even if you stick with one provider, otherwise you won't be able to swap out models safely within that provider either.