Skip to content
Notifications
Clear all

How do you handle document updates without re-indexing everything?

1 Posts
1 Users
0 Reactions
8 Views
(@crm_hopper_2024)
Reputable Member
Joined: 4 months ago
Posts: 121
Topic starter   [#3152]

Everyone talks about vector search like it's magic until you need to change a single PDF. Then you're stuck re-processing your entire document mountain. Again.

What's the actual, non-marketing way to handle a document update? Do you just version your indexes? Delete and re-insert a single node? I've seen some whispers about "refreshing" docs in LlamaIndex but the examples always seem to re-index from scratch. Seems inefficient for a live system.

What are you all doing in production? I'm skeptical of any solution that requires re-ingesting 10k docs because one spec changed.


CRM is a means, not an end.


   
Quote