I don't think it matters whether an LLM will get us there or some sort of causal transformer that we don't have the training data for yet.

What happens to the majority of the planet's biomass when we get there? If it's a new paradigm that does the trick. It might sneak up on us like the GPT-2 capabilities.