7b4fcd486a
Revert "fix: unified resource server list queries order column" ( #109529 )
2025-08-12 17:29:50 +02:00
e0404f924c
K8s/SecureValues: Wire InlineSecureValueSupport to apistore ( #109449 )
...
* inline wire
* extra fields
* add variable
* wire
2025-08-11 15:22:56 +03:00
6851d8ae0c
Storage: Skip slow test TestIntegrationBenchmarkResourceServer ( #109424 )
2025-08-08 20:51:12 +00:00
68059344f8
Unified storage: Remove unifiedStorageSearchPermissionFiltering feature flag ( #109216 )
...
* Unified storage: Remove unifiedStorageSearchPermissionFiltering ff
* unit test
2025-08-06 02:04:32 -06:00
6b1143565a
Chore: Make cgo optional (for sqlite) ( #108756 )
...
* make cgo optional for sqlite
* update go.mod; check error code differently
* reduce api surface even more
* move test errors into sqlite package
* add a comment
2025-07-31 09:25:19 +00:00
a95fb3a37c
Chore: Omit integration tests if short test flag is passed ( #108777 )
...
* omit integration tests if short test flag is passed
* Update pkg/services/ngalert/models/receivers_test.go
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
* Update pkg/tests/api/alerting/api_ruler_test.go
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
* Update pkg/tests/api/alerting/api_ruler_test.go
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
* Update pkg/tests/api/alerting/api_ruler_test.go
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
* Update pkg/tests/api/alerting/api_ruler_test.go
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
* Update pkg/tests/api/alerting/api_ruler_test.go
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
* Update pkg/services/ngalert/models/receivers_test.go
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
* Update pkg/cmd/grafana-cli/commands/datamigrations/to_unified_storage_test.go
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
* Update pkg/services/ngalert/models/receivers_test.go
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
* fix the rest
* false positive
---------
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
2025-07-28 13:38:54 +02:00
183cd0843e
keep instance in the ring on shutdown ( #108609 )
2025-07-24 15:39:12 -04:00
981fdb29d4
update storage-api to only build index if it owns the namespace ( #108418 )
...
* update storage-api to only build index if it owns the namespace
---------
Co-authored-by: Mustafa Sencer Özcan <mustafasencer.ozcan@grafana.com >
2025-07-23 15:59:24 -04:00
4a779c4ccb
fix: unified resource server list queries order column ( #108094 )
2025-07-16 08:09:31 +02:00
84a4ed612b
fix: re-order db initialization logic for resource server ( #108059 )
2025-07-14 10:25:42 +00:00
602b7826c4
refactor(unified-storage): remove resource_server config option ( #107649 )
2025-07-11 15:33:51 +02:00
9d2eadcfd2
PoC: replace using testing.Short in storage/unified package with integration test skip method ( #107887 )
...
* PoC: check if testing.Short is called from integration tests only.
* Rename helper function.
* Fix logic.
* Remove skipping of integration tests from non-integration tests.
* Remove skipping of integration tests from non-integration tests.
* Fix import.
2025-07-09 15:32:10 +00:00
3f502f305d
Chore: Update mocks with recent mockery ( #107816 )
2025-07-09 09:15:34 +02:00
b7153d4d20
fix: grpc resource delete error when qos enabled ( #107560 )
2025-07-03 12:02:05 +02:00
041c343a86
Unified storage: Respect GF_DATABASE_URL override ( #105331 )
...
* Database for unified storage resources now reuses DB code that respects URL override.
Access instrument_queries via section getter.
2025-07-03 09:57:40 +00:00
e076c74869
sqltemplate, dbimpl: Remove single-method function types ( #107525 )
...
* Remove dbProviderFunc function.
This removes one extra indirection that made the code bit more difficult to navigate.
* Remove indirection function types implementing single-method interfaces.
This streamlines the code and makes it bit easier to navigate.
* Update pkg/storage/unified/sql/sqltemplate/dialect_mysql.go
Co-authored-by: Mustafa Sencer Özcan <32759850+mustafasencer@users.noreply.github.com >
---------
Co-authored-by: Mustafa Sencer Özcan <32759850+mustafasencer@users.noreply.github.com >
2025-07-03 10:38:12 +02:00
3674d952a6
fix: use database section for resource server db engine configuration ( #107495 )
2025-07-02 09:00:51 +00:00
9a92900ef3
fix(unified-storage): remove 's' in config parameter ( #107457 )
2025-07-01 14:06:21 +02:00
d76e55371a
fix(unified-storage): use the provided connection config parameters ( #107455 )
...
* fix(unified-storage): use the provided connection config parameters
* extend tests
* make update-workspace
2025-07-01 11:25:16 +00:00
974a2c47f9
feat(unified-storage): add qos support for the resource server ( #105939 )
2025-07-01 09:22:55 +00:00
f66a693438
Chore: Rename integration tests to follow the common convention ( #105987 )
...
* automatically rename integration tests to follow the common convention
* name tests differently
* alter column type to bigint
* update another column to bigint
* add another alter
* fix subquery for mysql
2025-06-29 16:56:24 +02:00
930c9b3beb
fix: double registration panic in auth fallback ( #107330 )
...
fix double registration panic in auth fallback
2025-06-27 19:22:16 +02:00
6f3b619f59
Remove use of prometheus.DefaultRegisterer from ProvideUnifiedStorageGrpcService. ( #107315 )
2025-06-27 15:58:00 +02:00
f4ee58db50
unified-storage: split resource index client ( #106297 )
...
* split resource server and index server grpc connection if defined in config
2025-06-27 08:15:52 -04:00
0982cfd9a0
Unified Storage/Search: Add max count config for indexing ( #107255 )
...
* Add max count config for indexing
* Build empty index when max count is exceeded
* Address linting
* Refactor buildIndexes
* Add test for max count threshold
* Update test doc comments
* Refactor TestBuildIndexes_MaxCountThreshold to not use mock framework
* Rename mocks used in TestBuildIndexes_MaxCountThreshold
* Refactor mockResourceIndex
* Test setting of indexing threshold configs
* Tweak comments, log
* Fix logging in buildEmptyIndex
* Export and reuse TestDocumentBuilderSupplier
* Reuse MockResourceIndex
2025-06-27 14:00:39 +02:00
5f21f320f7
fix(unified-storage): use continue token containing both formats for dualwriter ( #106525 )
2025-06-13 15:59:46 +02:00
7864c1660f
K8s: Get trash fixes ( #106411 )
2025-06-11 13:54:38 -05:00
1196d66c5e
feat(unified-storage): log continue token on error ( #106475 )
2025-06-10 16:41:39 +02:00
04d39cbbc6
unistore: split ListIterator and ListHistory in StorageBackend ( #105654 )
...
split listIterator from ListHistory
2025-05-23 15:00:18 +02:00
392c1a71c9
Storage: Take migration_locking setting into account ( #105938 )
2025-05-23 14:11:21 +02:00
c4d3eb1cd0
Remove support for Google Spanner database. ( #105846 )
...
* Remove support for Google Spanner database.
2025-05-23 11:35:59 +02:00
a13fe75de8
refactor(unified-storage): set the GUID in the resource server ( #105683 )
2025-05-21 09:49:49 +02:00
a7922912fe
SecretsManager: Introduce secrets database wrapper ( #105472 )
...
SecretsManager: Introduce secret database wrapper
Co-authored-by: PoorlyDefinedBehaviour <brunotj2015@hotmail.com >
Co-authored-by: Leandro Deveikis <leandro.deveikis@gmail.com >
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com >
2025-05-20 11:48:47 +01:00
91882cf50e
chore(unified-storage): add tracing for unified storage folder implementation ( #105601 )
2025-05-19 23:25:08 +03:00
bdae4424e8
unified-storage: setup distributor module option A ( #104737 )
...
* setup distributor module
* move lifecycler into resource server provider
* remove ring/client pool setup from distributor module and use the same ring/client pool between storage server module and distributor module
* implement resourcestore server methods
* make healthcheck fail if ring is not running
2025-05-19 07:46:03 -04:00
5d8f2e0ec3
refactor(unified-storage): extract list iterator and add tests ( #105600 )
2025-05-19 13:05:49 +02:00
1ffe653156
Revert change of order of checks when setting up resource DB ( #105514 )
...
* Revert change of order in newResourceDBProvider
* Ignore error in provisioningSecrets when working with wrong DB.
* Update workspace.
* Add owner.
2025-05-16 11:35:36 +03:00
002f46736a
refactor(unified-storage): move generated protos to own pkg ( #105356 )
2025-05-15 21:36:52 +02:00
7268d6c1bc
admin api: Fix reencryption of private_key in signing_key table, introduce test for reencryption ( #105010 )
...
* Add integration test for reencrypting secrets.
Rotate keys before reencryption.
Test for setting table from enterprise repo.
2025-05-15 09:51:25 +02:00
e162c69c34
search: fix document missing at startup ( #105198 )
...
* fix document missing at startup
* go-lint
* fix tests
* fix tests
* fix integration tests now that we are storing real values
2025-05-12 07:56:25 +02:00
15b3de5893
search: add index batching ( #104163 )
...
* add basic search backend integration tests
* add search backend benchmark
* add benchmark indexServer
* fix
* lint
* add more tests
* lint
* do not use the poller
* batch write
* refactor and add tests
* improvements
* improvements
* cleanup
* only observe index success
* add monitorIndexEvents method
* nit use switch instead of if
* make newIndexQueueProcessor private
* simplify runProcessor
* go lint
2025-05-09 15:36:21 +02:00
694b9dfe50
Chore: Replace xorm.io/xorm imports ( #104458 )
...
* replace xorm.io/xorm imports
* replace xorm from other go.mod files
* clean up workspace
* nolint does not make sense anymore as it is not a module
* try if nolint directive helps
* use nolint:all for xorm
* add more nolints
* try to skip xorm in linter config
* exclude xorm differently
* retrigger ci
2025-05-02 17:13:01 +02:00
3f2ad925fb
chore(unified-storage): remove debug logging for poller ( #104862 )
2025-05-02 15:02:17 +03:00
188a02723f
fix(unified-storage): only fetch from history table if rv changed ( #104740 )
2025-04-30 12:29:09 +02:00
4adebd6058
unified-storage: setup ring to shard requests ( #103783 )
...
* Updates the instrumentation_server service to use mux instead of the builtin router, and have it store the router in the module server: this is so we can register the /ring endpoint to check the status of the ring
* Create a new Ring service that depends on the instrumentation server and declares it as a dependency for the storage server
* Create standalone MemberlistKV service for Ring service to use
* Update the storage server Search and GetStats handler to distribute requests if applicable
2025-04-25 13:08:44 -04:00
fc9f32a9f6
SQLTemplates: Add helper to ensure all templates have a test-case ( #103964 )
...
* SQLTemplates: Add helper to ensure all templates have a test-case associated
* UnifiedStorage: Add missing sql template test case
* LegacyDashboards: Add sql templates fs to test cases for exhaustiveness check
* RBACStore: Add sql templates fs to test cases for exhaustiveness check
* LegacyIAM: Add missing sql template test cases
2025-04-22 11:21:51 +02:00
3380ea441a
feat(unified-storage): return guid, group and resource on read/list ( #104121 )
2025-04-17 12:58:58 +02:00
e69052a417
unistore: add check when update the folder of a resource ( #102699 )
...
* Add check for move folder
* make the server test generic
* address comment
2025-04-14 16:57:40 +02:00
1125f36f4f
fix(test): Attempt to make TestPollingNotifier/notify_returns_channel_and_starts_polling less flaky ( #103947 )
...
Signed-off-by: Dave Henderson <dave.henderson@grafana.com >
2025-04-14 09:41:09 +02:00
757be6365a
CI: Bump golangci-lint to 2.0.2 ( #103572 )
2025-04-10 14:42:23 +02:00
Mustafa Sencer Özcan
Ryan McKinley
William Wernert
Stephanie Hingtgen
Serge Zaitsev
Will Assis
Jean-Philippe Quéméner
Peter Štibraný
Arati R.
Georges Chaudy
Dana Axinte
Matheus Macabu
Dave Henderson
Mariell Hoversholm