In the formal, information-theory sense, they literally don't, at least not on their own without further constraints (like band-limiting or bounded polynomial degree or the like)

They give you relative information. Like word2vec

...which you always have.