RAG cli from llamaindex, allow you to do it 100% locally when used with ollama o...

homarp · 2024-05-30T22:51:30 1717109490

and at some point (https://github.com/ggerganov/llama.cpp/issues/7444) you will be able to use Phi-3-vision https://huggingface.co/microsoft/Phi-3-vision-128k-instruct

but for now you will have to use python.

You can try it here https://ai.azure.com/explore/models/Phi-3-vision-128k-instru... to get an idea of its OCR + QA abilities

nl · 2024-05-31T00:49:15 1717116555

Does the llamaindex PDF indexer correctly deal with multi-column PDFs? Most I've seen don't, and you get very odd results because of this.

rspoerri · 2024-05-31T05:52:37 1717134757

i've made quite good conversions from pdf to markdown with https://github.com/VikParuchuri/marker . it's slow but worth a shot. Markdown should be easily parseable by a rag.

i'm trying to get a similar system setup on my computer.

nl · 2024-05-31T07:36:01 1717140961

This looks worth exploring, so thanks. The author has done a bunch of work beyond what PyMuPDF does on multicolumn layouts.

pierre · 2024-05-31T03:29:10 1717126150

Locally you can choose pypdf or mupdf wich are good but not perfect. If you can send your data online llamaparse is quite good.

j45 · 2024-05-31T05:27:28 1717133248

Pulling the text out of the PDFs correctly and independently is correct.

jd3 · 2024-05-30T23:31:57 1717111917

basically, still the same answer(s) from

https://news.ycombinator.com/item?id=38759877

https://news.ycombinator.com/item?id=36832572

tspann · 2024-05-31T13:39:44 1717162784

https://milvus.io/docs/integrate_with_llamaindex.md

Pretty easy to run local and lightweight with Milvus Lite with LlamaIndex

ekianjo · 2024-05-30T23:21:37 1717111297

llamaindex has an horrible API, very poor docs and is constantly changing. I do not recommend it.

papichulo2023 · 2024-05-31T01:45:25 1717119925

Any alternative?

hm-nah · 2024-05-31T14:14:18 1717164858

Vanilla python

dmd · 2024-05-31T19:41:25 1717184485

So your solution to “I don’t like flying [specific airline]” would be “how about a big pile of aluminum and some jet fuel”?

vladsanchez · 2024-05-31T19:00:45 1717182045

LOL `papichulo`? Que tigre!?

papichulo2023 · 2024-06-02T15:51:43 1717343503

Jaja la primera palabra que se me vino a la cabeza