It's not that hard to make a turnkey "just add power" appliance that does nothing but spit out tokens. Some sort of "ollama appliance", which just sits on your network and provides LLM functionality for your home lab?
But beyond that, what would your mythical dream product do?
i'm talking about something you plug in and get on your network then you can chat with it with a typical chat interface and it should expose an openai compatible api
