I think we'll see a shift to BYO LLM in the future. I saw that overleaf offers an assistant feature and an associated subscription. But I already pay for ChatGPT and Github copilot, I'm not going to pay for a third assistant - particularly when I can just bypass overleaf and use copilot in vscode directly.
I think Github already offers BYOK (bring your own key). I think the problem is that you are still expected to pay for all the premium subs, the key only allows you to go above the rate/monthly limits.
I think Jetbrains does it better with a full BYOM for models, including ollama. And I think if you go for ollama, you only need to pay for the IDE license, not for the AI add-on but don't quote me on that.
I think commercially there'll be a really strong pull for dev tools to resell access to frontier models.
It's hard to make money out of dev tools, but if you tie in a service people are prepared to pay hundreds of dollars a month for, then suddenly it looks easier to make money out of an otherwise unsaleable IDE plugin that accesses that service.
