search: add index batching (#104163)

* add basic search backend integration tests

* add search backend benchmark

* add benchmark indexServer

* fix

* lint

* add more tests

* lint

* do not use the poller

* batch write

* refactor and add tests

* improvements

* improvements

* cleanup

* only observe index success

* add monitorIndexEvents method

* nit use switch instead of if

* make newIndexQueueProcessor private

* simplify runProcessor

* go lint
This commit is contained in:
Georges Chaudy
2025-05-09 15:36:21 +02:00
committed by GitHub
parent 0ceea29787
commit 15b3de5893
13 changed files with 1562 additions and 467 deletions
+3
View File
@@ -158,6 +158,9 @@ type SearchOptions struct {
// Skip building index on startup for small indexes
InitMinCount int
// Channel to watch for index events (for testing)
IndexEventsChan chan *IndexEvent
}
type ResourceServerOptions struct {