If we're talking about Greg Egan, then I'll go ahead and also suggest his short stories Luminous and Dark Integers. They postulate a similarly tight connection between physical processes and mathematical theorems, and then go on to consider the implications of the fact that such a system can't prove its own consistency.