public/grafana
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
62,065 Commits 655 Branches 650 Tags
f2f1663dba8a5f6884df19bebd2dbe61c831d8d5
Commit Graph

670 Commits

Author SHA1 Message Date
Will Assis
005da25698 fix: ListManagedObjects and CountManagedObjects panic when search is not configured (#110726) 
fix ListManagedObjects and CountManagedObjects panicking when search index not configured
 2025-09-05 20:58:12 +00:00
owensmallwood
dc1c5a610c Unified Storage: Fix broken tests (#110710) 
fix broken tests
 2025-09-05 17:19:13 +00:00
owensmallwood
d715bda8af Unified Storage: Adds pruner to kv backend (#110549) 
* WIP adding pruner to kv store impl

* pruner only keeps 20 most recent versions

* ignore grafana-kv-data folder

* extracts some stuff to pruner.go file. Adds tests. Adds kvBackendOptions.

* update logging, comments, exports kvbackendoptions fields

* update nooppruner ref

* fixes field casing in test

* fix test

* linter fixes

* remove comment

* make KvStorageBackend private

* Adds pruner key validation and tests. Fixes broken tests.

* update error message when validating pruner key
 2025-09-05 10:02:11 -06:00
Bruno
9a641c651f secrets: update test to accept []byte(nil) and []byte{} (#110630) 
Co-authored-by: Matheus Macabu <macabu.matheus@gmail.com>
 2025-09-05 10:19:57 -03:00
Peter Štibraný
bd529226a3 unified-storage search: return results matching all search terms (#110672) 
* Extract common indexing code.

* Extract common search code.

* Match all terms in the search query.
 2025-09-05 11:00:54 +00:00
Ryan McKinley
eeb940e733 Chore: Replace hand crafted mocks with mockery (#110627) 2025-09-05 07:13:15 +00:00
Will Assis
ea7c370edd unified-storage: add ListSinceModified to kv store (#110250) 
* implement ListKeysSince in event store

 implement data store version

---------

Co-authored-by: Georges Chaudy <chaudyg@gmail.com>
 2025-09-04 12:26:40 -04:00
Bruno
6b5cacfade use standard sql in secure_value_lease_inactive.sql (#110532) 
* use standard sql in secure_value_lease_inactive.sql

* ci
 2025-09-04 10:01:05 -03:00
Peter Štibraný
642d43ff49 search-after-write: Reuse index even if docs count doesn't match (#110527) 
* search-after-write: Reuse index even if docs count doesn't match

* Revert unrelated change.
 2025-09-03 15:35:46 +00:00
maicon
fa20755d4b fix: Synchronously notify subscribers when writing Create events to CDK backend (#110476) 
* Remove goroutine when writing events on CDK backend

Signed-off-by: Maicon Costa <maiconscosta@gmail.com>

---------

Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
 2025-09-03 11:49:04 -03:00
Georges Chaudy
1758fa8fbb unistore: use scorch indexing instead of upside_down (#110463) 
* use scorchwith in memory

* comments

* refactor
 2025-09-03 11:06:08 +02:00
Serge Zaitsev
cdd7a2cfd2 Chore: Disable CGo in tests (#108764) 
* make cgo optional for sqlite

* update go.mod; check error code differently

* reduce api surface even more

* move test errors into sqlite package

* CGO_ENABLED=0 in unit tests

* disable for enterprise, too

* add driver name constant

* remove unused constants

* make test an integration one

* try integration tests without cgo

* implement error codes for modernc sqlite driver

* typo fix

* missing return

* use error pointer as an interface

* alias the driver

* update workspace, check for test errors too

* check error properly

* add missing driver after rebase

* fix missing import after rebase

* debugging, lets try again

* properly parse options, revert many previous changes

* remove another log

* better url parsing

* revert test rename, leave it for later

* revert reusedSession in unistore

* revert more code

* remove driver name

* revert formatting

* add integration test without cgo for sqlite

* remove tracing and logging

* bring driver alias back

* fix type

* wrong package
 2025-09-02 17:24:30 +02:00
Bruno
f8cd7049e8 Secrets: garbage collection (#110247) 
* clean up older secret versions

* start gargbage collection worker as background service

* make gen-go

* fix typo

* make update-workspace

* undo go mod changes

* undo go work sum changes

* Update pkg/registry/apis/secret/garbagecollectionworker/worker.go

Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>

* Update pkg/registry/apis/secret/garbagecollectionworker/worker.go

Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>

* default gc_worker_batch_size to 1 minute

* fix typo

* fix typo

* add test to ensure cleaning up secure values is idempotent

* make gen-go

* make update-workspace

* undo go.mod and .sum changes

* undo enterprise imports

---------

Co-authored-by: Matheus Macabu <macabu.matheus@gmail.com>
Co-authored-by: Matheus Macabu <macabu@users.noreply.github.com>
 2025-09-02 11:11:01 -03:00
Jean-Philippe Quéméner
6d5fe47790 fix(unified-storage): use contextual logger for permissions (#110455) 2025-09-02 15:53:37 +02:00
Jean-Philippe Quéméner
5fb72d1b04 fix(unified-strorage): optimize allocations (#110448) 2025-09-02 15:43:48 +02:00
Matheus Macabu
1e926a29c0 Secrets: Extract external facing decrypt types to apps (#110432) 2025-09-02 10:30:29 +02:00
maicon
fccf58add7 Unistore: Only Shadow Search Traffic when running on modes > 0 (#110302) 
* Unistore: Only Shadow Search Traffic when running on modes > 0

Signed-off-by: Maicon Costa <maiconscosta@gmail.com>

---------

Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
 2025-09-01 16:14:53 -03:00
Peter Štibraný
4475e2ad19 getClientToDistributeRequest: remove logging of selected client, fix logging of error (#110403) 2025-09-01 10:57:25 +00:00
Peter Štibraný
da43e2ae07 Don't use transaction in ListModifiedSince. (#110392) 
* Don't use transaction in ListModifiedSince.

To guarantee that we don't include events with RV > LatestRV, we include the check in SQL query instead.

* Fix integration test by converting SQL comments into template comments.
 2025-09-01 11:39:02 +02:00
Todd Treece
9416abc146 Storage: Set default list limit to 500 (#110356) 2025-09-01 11:09:40 +02:00
Peter Štibraný
238f121e10 LastModifiedSince: return latestRV even when it hasn't changed. (#110391) 
Return latestRV.
 2025-09-01 08:45:40 +00:00
Will Assis
18bc69f5c6 unified-storage: Bleve test cleanup (#110240) 
* consolidate index build tests

* shut up logging in test
 2025-08-29 15:35:31 +00:00
Peter Štibraný
3a3ba483b1 unified-storage: Skip query when ListModifiedSince cannot return anything. (#110338) 
* Skip query when ListModifiedSince cannot return anything.

* Only save listRV if it's different than sinceRV. This saves a disk access if not needed.

* Add test for ListModifiedSince with same RV.
 2025-08-29 14:49:20 +02:00
Peter Štibraný
ad571b50e9 Create context with deadline inside goroutine. (#110297) 2025-08-28 15:33:34 +00:00
Peter Štibraný
7a8010be0c search-after-write: improve observability (#110288) 
* Improve tracing and observability around updating of index during search.
 2025-08-28 16:02:47 +02:00
maicon
12382d7f20 unistore/apistore: improve package docs (#110242) 
Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
 2025-08-27 19:00:05 -03:00
owensmallwood
699bffc9e4 Unified Storage: Dont need to test casing with ordering (#110245) 
Dont need to test casing with ordering.
 2025-08-27 14:06:43 -06:00
Will Assis
7921c7da23 unified-storage: reuse index if RV is set even if it is outdated (#110184) 
* unified-storage: reuse index if RV is set even if it is outdated and searchAfterWrite FF is enabled
 2025-08-27 11:10:54 -04:00
Matheus Macabu
85c567609d Secrets: Add result label for decryption errors (#110213) 2025-08-27 14:09:43 +02:00
owensmallwood
b4ed217656 Unified Storage: Removes check for name ordering and adds test (#110183) 
removes check for name ordering. Adds test to assert expected name and rv ordering.
 2025-08-26 12:39:30 -06:00
Mustafa Sencer Özcan
3056924d10 fix: enforce timeout for requests run in qos (#110162) 2025-08-26 18:40:22 +02:00
Matheus Macabu
78ac555c4d CI: Run gofmt on Linting action (#110159) 
* CI: Run gofmt on Linting action

* Chore: Run gofmt on all packages
 2025-08-26 16:14:03 +02:00
Peter Štibraný
067b6e20a2 Fix name of the summary, remove _total suffix (#110143) 2025-08-26 08:48:05 +00:00
owensmallwood
bacb5c576c Unified Storage: Fix yield statement (#110134) 
fix yield
 2025-08-25 20:06:24 -06:00
Ryan McKinley
27c92a6644 Dashboards: Make conversion data optional (#109965) 2025-08-25 13:47:42 +03:00
Stephanie Hingtgen
1091054c25 Unistore: Wire up inline secure values (#110072) 
* Unistore: Wire up inline secure values

* add validation and test

* linter
 2025-08-25 02:48:49 -06:00
Peter Štibraný
4c996a8a7f search: Guarantee search-after-write consistency (#109972) 2025-08-25 10:13:07 +02:00
lean.dev
21fc58f632 SecretsManager: fix span name for SetVersion operations (#110035) 
SecretsManager: fix span name for SetVersion operations
 2025-08-22 12:01:41 +00:00
owensmallwood
cace999671 Unified Storage: Add ListSinceModified to StorageBackend (#109697) 
* WIP added ListSinceModified to StorageBackend interface

* fix compile time check

* Fix method name

* Fix naming

* fix the rest of the ListSinceModified names

* Uses resource key without name field

* get latest rv from resource_version. Update test.

* adds moar tests

* adds method stub for ListModifiedSince to other StorageBackend implementations

* adds dummy impl to noop storage backend for ListModifiedSince

* skip tests for badger kv backend for now

* fixes tests and adds badgerkv impl for ListModifiedSince

* add badger kv impl

* adds test for new query

* adds test data for new query

* adds ListModifiedSince stub to mockStorageBackend

* uncomment tests

* refactors ListModifiedSince to return an iter.seq2 and handles deduplication. Updates tests. Updates query result sorting.

* remove comments

* remove folder from query (dont need it, yet?)

* regen test queries

* updates test

* updates function comment

* use resourcepb.ResourceKey instead of ModifiedResourceKey

* wrap seq in single transaction. Rollback transaction after 30s if iterator never used. Only track last seen event. Formatting.

* skip TestListModifiedSince for kv backend

* use WatchEvent_Type for action type

* remove redundant fields from order by clause and regen test data for query

* remove redundant fields from order by clause and regen test data for query
 2025-08-20 11:54:31 -06:00
Will Assis
34496e137c unified-storage: Search after write save rv to index (#109641) 
* save rv to index after index is built
 2025-08-19 09:41:35 -04:00
Matheus Macabu
ea833ddf1f Unified/APIStore: Fix flaky tests on secure value support inline (#109806) 2025-08-19 09:49:44 +02:00
Peter Štibraný
c508b01cc5 chore: Close bleve indexes created in temp dir. (#109799) 
* Close indexes created in temp dir.
 2025-08-18 16:27:57 +02:00
Matheus Macabu
10508d0614 Secret/Keepers: Return already exists error from DB when creating keeper (#109782) 2025-08-18 14:42:55 +02:00
maicon
5270d8e53f fix(unified-storage): remove permissions after executing on both stores (#109722) 
Signed-off-by: Maicon Costa <maiconscosta@gmail.com>
Co-authored-by: Jean-Philippe Quéméner <jeanphilippe.quemener@grafana.com>
 2025-08-15 15:57:42 +00:00
Ryan McKinley
5007f362f3 Chore: fix flakey secure value test (#109724) 2025-08-15 07:58:50 +00:00
Will Assis
43cda1f1a4 unified-storage: disable watcher when search-after-write feature flag is enabled (#109634) 
* disable indexer watcher when search-after-write feature flag is enabled
 2025-08-14 10:18:09 -04:00
Ryan McKinley
d3df5b8ddd Secrets: Manage secure values inside any resource (#107803) 2025-08-14 12:31:24 +00:00
Matheus Macabu
dfae5e5b4d Secrets: Add namespace matches checks to authorizer and secure value client (#109651) 
* Decrypt: Add namespace matches to authorizer

* SecureValueClient: Add namespace matches when auth checking
 2025-08-14 11:50:56 +02:00
lean.dev
3106abf1a6 SecretsManager: clear unused metrics and standarize labels(#109515) 2025-08-13 14:01:50 +01:00
Mustafa Sencer Özcan
7b4fcd486a Revert "fix: unified resource server list queries order column" (#109529) 2025-08-12 17:29:50 +02:00