Why would you want chunks that big for vector search? Wouldn't there be too much... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		rahimnathwani on May 29, 2024 \| parent \| context \| favorite \| on: Vector indexing all of Wikipedia on a laptop Why would you want chunks that big for vector search? Wouldn't there be too much information in each chunk, making it harder to match a query to a concept within the chunk?

nostrebored on May 30, 2024 [–]

The problem is that often semantic meaning depends on state multiple paragraphs or sections away.

This is a coarse way to tackle that

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact