What are you proposing is the problem? That we will foolishly bull forwards, and accidentally violate the laws of physics and consume more energy than there is?
the fear is that we would consume too much now, and not leave enough behind to facilitate the research/development needed to find/create better sources of energy.
E.g., you used up the fuel in the car too fast, and can't reach the next gas station.