Unified Storage Indexer: Build tenant indexes concurrently (#95795)

* WIP - build tenant indexes concurrently * adds local dev seeders and readme for indexer * update logging and adds locking in getShard() * update logs * Adds Namespaces func. Initializes index after ResourceServer is created. * fixes Count() and updates test lint issues * Initialize index separately. Don't do it when creating the resource server. Makes testing really awkward. * fix lint error * handles error when getting namespaces * updates test and index helper funcs
2024-11-06 12:58:07 -06:00
parent 3877537dc0
commit b6596db75e
13 changed files with 373 additions and 70 deletions
@@ -0,0 +1,5 @@
+<h2>Indexer Seeders</h2>
+
+These seeders are used for performance testing in the indexer in your local dev environment. They are not used in production.
+
+By default, they each create 1 million resources. You can adjust this in the script if needed. Creating 1M objects takes about 5-10 minutes.