This makes sense if your web API asserts that all responses are JSON responses, and if it provides a schema for responses somewhere as a contract.

But, in general, it's totally fine to return a 404 with no other info. That's a totally acceptable API.