Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

A lot of companies and research institutes in the EU would like to be able to use a locally hosted LLM for their employees so they don't have to worry what data they give away.

Also it is not rational for any individual to buy the hardware for running a serious LLM and then let it idle 99.9% of the day.



Why would not these companies or research institutes in the EU not be able to run locally hosted LLMs for their employees though?


What model do you propose that is close enough to chatgpt or Claude so people will actually use it for their work?


I am not up to date with the models, but I have heard good stories about a couple of open source models. You should ask Simon Willis. I hope he will be summoned (@simonw).


It was my point that currently the best open weight models are from China, so not usable in the EU.

But of course the world changes so rapidly that what is now is irrelevant tomorrow.




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: