How does this compare to llamafile? I recently started experimenting with pointing my openAI web apps at local llamafile and its pretty straightforward: http://blog.pamelafox.org/2024/01/using-llamafile-for-local-...

Llamafile doesnt support an OpenAI compatible embedding endpoint yet but I filed an issue and they seem to be interested in adding it.