Commit Graph
465 Commits
Author SHA1 Message Date
Andreas ChristouandKevin Minehart 769114b1d7 [v10.4.x] CI: Fix drone docker publish (#91208)
CI: Fix drone docker publish (#91204)

* $debug -> $$debug

* use bash instead of sh

* Update publish_images.star

* Install bash in the docker/docker image

* buildifier

(cherry picked from commit bee678da94)

# Conflicts:
#	.drone.yml

Co-authored-by: Kevin Minehart <5140827+kminehart@users.noreply.github.com>
2024-07-30 18:07:09 +03:00
Kevin MinehartandDiego Augusto Molina 82d719d8b3 [v10.4.x] CI: Fix release-pr call in releases (#91094)
* CI: Fix release-pr call in releases (#91088)

* Fix release-pr call in releases

* Remove backport arg

* set TARGET to v_target

(cherry picked from commit 2ffdc2d5b0)

* Release Pipeline: [RPM pkg verification] Fix linefeeds converted to literal backslash-n sequences (#90989)

fix lf converted to literal backslash-n sequence

(cherry picked from commit 9852513c65)

---------

Co-authored-by: Diego Augusto Molina <diegoaugustomolina@gmail.com>
2024-07-27 04:03:05 +03:00
Kevin Minehart 9da678809b Upgrade go to 1.22.5 2024-07-25 17:38:08 -05:00
Kevin Minehart fd6bd298c2 [v10.4.x] CI: replace publish image step with a much simpler one that supports LATEST (#90619)
CI: replace publish image step with a much simpler one that supports LATEST (#90498)

* replace publish image step with a much simpler one that supports LATEST

(cherry picked from commit 6a2a6b0fbc)
2024-07-18 12:18:30 -06:00
Jev Forsberg 6f64c51675 [v10.4.x] Automation: Verify DEB and RPM packages (#90403)
Automation: Verify DEB and RPM packages (#90146)

* baldm0mma/verify_aptyum/ add verify_linux_packages_step

* baldm0mma/verify_aptyum/ add name and image

* baldm0mma/verify_aptyum/ add commands

* baldm0mma/verify_aptyum/ add test pipeline

* baldm0mma/verify_aptyum/ update deps for verify_linux_packages_step

* baldm0mma/verify_aptyum/ update ubuntu image

* baldm0mma/verify_aptyum/ add rockylinux9 image

* baldm0mma/verify_aptyum/ update to verify_linux_DEB_packages_step naming

* baldm0mma/verify_aptyum/ add verify_linux_RPM_packages_step

* baldm0mma/verify_aptyum/ update commands for RPM check

* baldm0mma/verify_aptyum/ update test pipeline

* baldm0mma/verify_aptyum/ update annos

* baldm0mma/verify_aptyum/ update annos

* baldm0mma/verify_aptyum/ update args

* baldm0mma/verify_aptyum/ add arg to verify_linux_RPM_packages_step

* baldm0mma/verify_aptyum/ update oss_steps

* baldm0mma/verify_aptyum/ update deps args

* baldm0mma/verify_aptyum/ update sec hash

* baldm0mma/verify_aptyum/ make format-drone

* baldm0mma/verify_aptyum/ update sec hash

* baldm0mma/verify_aptyum/ update drone

* baldm0mma/verify_aptyum/ update function styles

* baldm0mma/verify_aptyum/ revert changes

* baldm0mma/verify_aptyum/ make drone

* baldm0mma/verify_aptyum/ redirect install logs

* baldm0mma/verify_aptyum/ restructure args

* baldm0mma/verify_aptyum/ update verify_linux_DEB_packages_step

* baldm0mma/verify_aptyum/ make format drone

* baldm0mma/verify_aptyum/ update verify_linux_RPM_packages_step

* baldm0mma/verify_aptyum/ add retry_command

* baldm0mma/verify_aptyum/ make drone

* baldm0mma/verify_aptyum/ update attempts to 10 minutes

* baldm0mma/verify_aptyum/ handle is_preview

* baldm0mma/verify_aptyum/ add doc strings to satisfy starlark linter

* baldm0mma/verify_aptyum/ revert is_preview

* baldm0mma/verify_aptyum/ update to rpm repo download

* baldm0mma/verify_aptyum/ add back logging for rpm

* baldm0mma/verify_aptyum/ revert to working

* baldm0mma/verify_aptyum/ update to use RPM repo

* baldm0mma/verify_aptyum/ remove redirect for logging

* baldm0mma/verify_aptyum/ rem gpg check

* baldm0mma/verify_aptyum/ fromat drone

* baldm0mma/verify_aptyum/ rem comment

* baldm0mma/verify_aptyum/ add single comment on timing

(cherry picked from commit d781ec2daa)
2024-07-12 16:17:41 -06:00
8e9aa45716 [10.4.x] backport CI / release changes (#89631)
* Chore: Add go workspace (#83191)


---------

Co-authored-by: ismail simsek <ismailsimsek09@gmail.com>

* CI: Make pkg/build its own module, remove unused Grafana modules in go.mo… (#89243)

* Make pkg/build its own module, remove unused Grafana modules in go.mod/go.sum

* fix go.work format

* log errors on file close errors

* CI: Add release-pr workflow (#89005)

* Add release-pr workflow

* update CODEOWNERS

* CI: Trigger release pr workflow when a release is completed (#89062)

* Automation: Verify release artifacts on grafana.com (#89197)

* baldm0mma/verify_release/ create verify_release_for_download function

* baldm0mma/verify_release/ add name, image, env

* baldm0mma/verify_release/ add initial commands

* baldm0mma/verify_release/ add deps?

* baldm0mma/verify_release/ update location

* baldm0mma/verify_release/ add anno to lib-star

* bald0mma/verify_release/ update func name to verify_grafanacom_step

* baldm0mma/verify_release/ add verify shell script

* baldm0mma/verify_release/ add script content, first attempt

* baldm0mma/verify_release/ add node image to verify_grafanacom_step

* baldm0mma/verify_release/ add gcom secret note

* baldm0mma/verify_release/ add sudo to apt-get

* baldm0mma/verify_release/ add anno

* baldm0mma/verify_release/ add anno to secrets

* baldm0mma/verify_release/ update commands to reflect node env image

* baldm0mma/verify_release/ update annos

* baldm0mma/verify_release/ update tag variable

* baldm0mma/verify release/ add whitespace

* baldm0mma/verify_releases/ update with no bash loops

* baldm0mma/verify_release/ update exit logic

* baldm0mma/verify_release/ remove annos

* baldm0mma/verify_releasse/ resign and build yml

* baldm0mma/verify_release/ remove annos

* baldm0mma/verify_release/ update signature

* baldm0mma/verify_release/ download curl

* baldm0mma/verify_release/ remove temp key folder removal

* baldm0mma/verify_release/ account for artifact download time

* baldm0mma/verify_release/ add anno

* baldm0mma/verify_release/ update location

* baldm0mma/verify_release/ update script

* baldm0mma/verify_release/ make drone

* baldm0mma/verify_release/ update script for oss or ent

* baldm0mma/verify_release/ add promotion option

* baldm0mma/verify_release/ make drone

* Update scripts/drone/events/release.star

Co-authored-by: Kevin Minehart <5140827+kminehart@users.noreply.github.com>

* Update scripts/drone/steps/lib.star

Co-authored-by: Kevin Minehart <5140827+kminehart@users.noreply.github.com>

* Update scripts/drone/steps/lib.star

Co-authored-by: Kevin Minehart <5140827+kminehart@users.noreply.github.com>

* baldm0mma/verify_release/ update drone

* Update scripts/drone/events/release.star

Co-authored-by: Kevin Minehart <5140827+kminehart@users.noreply.github.com>

* baldm0mma/verify_release/ update drone

* Update scripts/drone/steps/lib.star

Co-authored-by: Kevin Minehart <5140827+kminehart@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Kevin Minehart <5140827+kminehart@users.noreply.github.com>

* baldm0mma/update drone

* baldm0mma/verify_release/ update path

* baldm0mma/verify_release/ make drone

* baldm0mma/update drone

* Apply suggestions from code review

Co-authored-by: Kevin Minehart <5140827+kminehart@users.noreply.github.com>

* baldm0mma/verify_release/ update for loop to account for failure

* baldm0mma/verify_release/ make drone

* baldm0mma/verify_release/ make format-drone

* baldm0mma/verify_release/ rem unused var

---------

Co-authored-by: Kevin Minehart <5140827+kminehart@users.noreply.github.com>

---------

Co-authored-by: Todd Treece <360020+toddtreece@users.noreply.github.com>
Co-authored-by: ismail simsek <ismailsimsek09@gmail.com>
Co-authored-by: Jev Forsberg <46619047+baldm0mma@users.noreply.github.com>
2024-06-24 15:06:53 -05:00
grafana-delivery-bot[bot]andAndreas Christou 3f351af597 [v10.4.x] Azure: Update resource group (#88765)
Azure: Update resource group (#88690)

Update azure e2e tests

(cherry picked from commit 17f03882d4)

Co-authored-by: Andreas Christou <andreas.christou@grafana.com>
2024-06-05 16:47:04 +03:00
Stephanie HingtgenandKevin Minehart 654db2500a [v10.4.x] Chore: Upgrade go to 1.21.10 (#87473)
* [v10.4.x] Chore: Upgrade go to 1.21.10

* sign drone

---------

Co-authored-by: Kevin Minehart <kmineh0151@gmail.com>
2024-05-08 10:05:19 -05:00
Dave Henderson 9dcf8e650f [v10.4.x] chore: bump Go to 1.21.8 (#83937)
chore: bump Go to 1.21.8 (#83927)

* chore: bump Go to 1.21.8

Signed-off-by: Dave Henderson <dave.henderson@grafana.com>

* bump workflows too

Signed-off-by: Dave Henderson <dave.henderson@grafana.com>

---------

Signed-off-by: Dave Henderson <dave.henderson@grafana.com>
(cherry picked from commit 01fb2cff62)
2024-03-05 16:44:27 -05:00
Andreas Christou 6263884192 [v10.4.x] CI: Bump alpine image version (#83723)
CI: Bump `alpine` image version (#83716)

Bump image version

(cherry picked from commit c9d8d8713b)
2024-02-29 20:34:08 +02:00
Sofia Papagiannaki 6a47c8da8e Drone: Do not upload artifacts if e2e tests have not run (#82451) 2024-02-15 10:26:43 +02:00
Andreas Christou dcbc3aa46a Chore: Update grabpl to v3.0.50 (#82379)
Bump grabpl version
2024-02-13 15:39:41 +00:00
Kevin Minehart 68345b9596 CI: Add dagger cloud token to PR steps for caching (#81817)
* Add dagger cloud token to steps for caching

* lint
2024-02-02 12:59:48 -06:00
Fabrizio 2d60c0123b Chore: Improve how we install Python (#81695) 2024-02-01 13:27:29 +01:00
Andrej Ocenas cb945aa5df NodeGraph: Use layered layout instead of force based layout (#78957) 2024-01-31 17:26:12 +01:00
Fabrizio 564a1d32b7 Add Python as dependency (#80979) 2024-01-31 12:44:22 +01:00
Kyle BrandtandKevin Minehart 43d0664340 Prometheus: (Experimental) Inject label matchers into queries (also change drone to fix ARM rpm build and Update Swagger) (#81396)
- Feature Toggle is `promQLScope`.
 - Query property is:

"scope": {
  "matchers": "{job=~\".*\"}"
 }

Misc:
 - Also updates drone GO version to address ARM bug https://github.com/golang/go/issues/58425
 - Also updates Swagger defs that were causing builds to fail

---------

Co-authored-by: Kevin Minehart <kmineh0151@gmail.com>
2024-01-29 22:22:17 +02:00
Josh Hunt a138ce668d I18n: Remove unneeded i18n:compile script (#81184) 2024-01-24 17:24:24 +00:00
Timur Olzhabayev 4083d23f01 Chore: Bumping go to 1.21.6 (#80709)
* Bumping go to 1.25.6

* bumping sqlite to 1.14.19

* Bumping sqlite version
2024-01-23 14:32:26 +01:00
Santiago d4e831b051 Alerting: Use mimir:r274-1780c50 in CI (#80985)
* Alerting: Use new mimir image in CI

* add image to blocks, enable experimental routes
2024-01-22 16:25:50 +02:00
Dimitris Sotirakis 65104a7efa ImagePullSecrets: Add GAR secret to image_pull_secret in .drone.yml (#80912)
* Add GAR secret to image_pull_secret

* Fix starlark fmt
2024-01-19 19:29:49 +02:00
Timur Olzhabayev 7c74ab7059 Revert "bumping go to 1.25.6"
This reverts commit 73439f2cd3.
2024-01-17 11:40:25 +01:00
Timur Olzhabayev 73439f2cd3 bumping go to 1.25.6 2024-01-17 11:38:25 +01:00
Horst Gutmann 01e430e821 chore: Bump Alpine base image to 3.18.5 (#80540) 2024-01-16 15:24:40 +01:00
Kevin Minehart 95a9074ad4 CI: Make --grafana-repo configurable via GRAFANA_REPO (#80378)
Make --grafana-repo configurable via GRAFANA_REPO
2024-01-11 17:53:02 +02:00
Kevin Minehart 9501000856 CI: add rgm promotion pipeline (#80296)
* add package upload promotion pipeline
2024-01-11 09:22:14 -06:00
Josh Hunt c9dd12851f Chore: Temp allow verify-i18n step to fail (#80371)
allow verify-i18n to fail
2024-01-11 16:50:01 +02:00
Dimitris Sotirakis 7ba930b135 Chore: Update grabpl (#79758)
Update grabpl
2023-12-20 17:07:55 +02:00
Andreas Christou 1f25c5f830 Build: Re-add missing armv7 images (#79751)
Readd missing images
2023-12-20 13:55:23 +00:00
Victor Marin 9dc015b595 Re-add arm32 builds (#79496)
* Re-add arm32 builds

* update grabpl version

* make drone

* make drone

* format drone
2023-12-15 16:56:22 +02:00
Timur Olzhabayev 4991e71b85 Chore: Upgrade Go to 1.21.5 (#79329)
* bumping grafanas go version to 1.21.5

* adding how to upgrade go doc

* removing the whole ci-build and corresponding pipelines

* clarifying that we have to run make drone

* fixing starlark linter and removing unused code

* Adding note about enterprise

* trying to change the underyling image to avoid musl issues

* only need to golang one
2023-12-15 10:36:49 +01:00
gotjoshandSantiago 23fe8f4e9c Alerting: Introduce a Mimir client as part of the Remote Alertmanager (#78357)
* Alerting: Introduce a Mimir client as part of the Remote Alertmanager

This is our first attempt at making Grafana communicate use Mimir as a backend - it uses a new set of APIs that we've developed on the Mimir side to upload the grafana configuration and alertmanager state so that it can then be ported over.

Codewise, we've introduced a couple of things:

A client to isolate in its own package all the communication that happens with Mimir
A few changes to the remote/alertmanager to include uploading the configuration and state when it starts
A few refactors that align a bit better with the design approach that we're thinking
An integration tests again these newly developed APIs using a custom image

---------

Signed-off-by: gotjosh <josue.abreu@gmail.com>
Co-authored-by: Santiago <santiagohernandez.1997@gmail.com>
2023-11-23 16:59:36 +00:00
Santiago eef8525a4b Alerting: Fix remote Alertmanager integration tests (CI/Makefile) (#78541)
* Alerting: Fix remote Alertmanager integration tests (CI/Makefile)
2023-11-22 18:13:04 +00:00
Horst Gutmann d78b3fea2f CI: Test backend on feature-toggles documentation changes (#78177)
Run backend tests if the feature-toggles documentation changes
2023-11-17 09:21:35 +01:00
Kevin Minehart f6d3238505 CI: Fix race condition when building docker on main (#77504)
* build docker after packages are updated

* use my branch for main pipelines for testing

* use my branch for main pipelines for testing

* use main instead now

* formatting
2023-11-01 18:25:49 +02:00
Ryan McKinley 5d5f8dfc52 Chore: Upgrade Go to 1.21.3 (#77304) 2023-11-01 09:17:38 -07:00
Kevin Minehart 8a5d4c4c6e CI: Update RGM steps to use the artifacts command (#77470)
* update rgm steps to use artifacts subcmd

* format-drone

* make drone
2023-10-31 22:52:09 +02:00
Josh Hunt 75005a8482 Chore: Update to yarn 4 (#77156)
* update to yarn 4

* update project to yarn 4

* update tetherdrop archive

* update sdks

* change puppeteer image to official node 20 one

* revert previous, use grafana/docker-puppeteer:pre-node-20 instead

* okay, try original docker image, but use npx instead of yarn for wait-on

* remove wait-on from deps as we use it via npx now

* yarn dedupe

* remove logs from drone

* empty commit testing yarn cache :)

* comment explaining why no -y
2023-10-31 16:11:54 +02:00
Jack Baldry d8d7a40d13 Use latest grafana/docs-base image (#77299)
* Use latest grafana/docs-base image

The pinned tag does not support recent shortcodes like `docs/public-preview`.

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

* Always pull the image

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

---------

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
2023-10-27 18:30:56 +01:00
Horst Gutmann aa9fc3be72 CI: Fix release-npm-packages action (#77127)
* Remove dependency of NpmReleaseAction to the git binary

* Switch to using the node image for the release-npm-packages step
2023-10-27 10:20:20 +03:00
Niki Manoledaki 9a0af13dbc Remove pr-swagger-gen dependency on clone-enterprise (#77217)
clone-enterprise step can fail in swagger-gen pipeline
2023-10-26 12:55:56 -04:00
Jack Westbrook 69af9f9ad7 Chore: Update to node 20 (#76097)
* chore(node): update node version to 20

* chore(node): bump to 20.8.0, update drone variables

* chore(drone): update yaml config

* chore(yarn): bump yarn to latest to fix building binaries ERR_IMPORT_ASSERTION_TYPE_MISSING errors

* test(grafana-data): update whitespace in time formats for node 20 (18.13+)

* chore(node): move to LTS 20.8.1

* chore(node): bump to LTS 20.9.0
2023-10-26 09:34:50 +02:00
bbcc81405b Chore: Add CI Pipeline to generate Grafana's OpenAPI specification (#75393)
* chore: move over initial changes from sofia's pr #58029

* chore: remove go_image

* chore: begin removing edition, remove unused imports

* chore: remove edition from swagger_gen.star and generate .drone.yml

* chore: regen drone.yml

* fix: fix order of load statements

* fix: try #2 fix order of load statements

* linter fixes

* chore: add doc comment explaining purpose of new clone_pr_branch step

* fix: add placeholder documentation for ver_mode arg

* attempt #1 to import and use clone_enterprise_step_pr

* Update scripts/drone/pipelines/swagger_gen.star

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* attempt #2 to import and use clone_enterprise_step_pr

* fix: fix drone lint err invalid or unknown step dependency

* fix: regen hmac to make drone run

* fix: fix drone lint err

* fix: update swagger-clean cmd in step

* attempt to return non zero exit code

* test to see if pipeline fails

* fix: add git to clone pr branch step

* fix: add git and make to swagger-gen step

* try to rerun drone

* debug: figure out why cannot find make swagger-clean

* debug: see if cd grafana/grafana fixes things

* debug: undo cd grafana/grafana

* debug: add more logging statements

* debug: try and remove cd grafana in swagger-gen

* debug: removed grafana after clone statement; add debug before cloning

* fix: remove disable clone

* regen specs to see if swagger-gen step passes now

* add descriptive error message to swagger-gen step

* remove api-spec.json from .gitignore

* revert backend change, regen spec

* add back backend change, regen specs

* Update scripts/drone/pipelines/swagger_gen.star

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* Update scripts/drone/pipelines/swagger_gen.star

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* revert gitignore change, set enterprise source to drone source branch

* chore: remove unused variable, change committish var name to source

* testing functionality: make a new BE change without gen spec, pipeline should fail

* test functionality: does removing err msg cause step to fail properly

* test functionality: add back err msg and && after

* chore: remove debug statements from swagger gen step

* chore: remove debug lines from clone_pr_branch step

* test functionality: regen specs, swagger_gen step should pass

* test funcionality: regen specs again ????

* chore: update swagger-gen step err msg

* test functionality: make BE change dont regen spec, swagger gen should fail

* test functionality: regen the specs, swagger-gen should pass

* chore: revert test BE change, regen spec

* chore: remove unused clone step

* chore: regen drone.yml

---------

Co-authored-by: Timur Olzhabayev <timur.olzhabayev@grafana.com>
Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>
2023-10-24 13:01:04 -04:00
Horst Gutmann bd2b4e956b CI: rgm-package must wait for update-package-json-version in main pip… (#77022)
CI: rgm-package must wait for update-package-json-version in main pipeline
2023-10-24 11:52:14 +03:00
Guilherme Caulada 442e533803 CI: Rename scripts that build artifacts to use _build_ (#77005)
Rename scripts that build artifacts to use _build_
2023-10-23 20:14:12 -03:00
Guilherme Caulada 24a14f3cd7 CI: Implement RGM pipeline parity between editions (#76283)
* Implement RGM pipeline parity between editions

* Use grafana/grafana-build:dev-11c8a20

* Use grafana/grafana-build:dev-261c863

* Use grafana/grafana-build:dev-2db3b18

* Switch nightly trigger for testing purposes

* Use grafana-dev api key for testing

* Use grafana/grafana-build:dev-d4d2e26

* Use grafana-dev api key

* Use production variables

* Revert nightly trigger to cron
2023-10-17 11:13:14 -03:00
Santiago 7d9b2c73c7 Alerting: Use Mimir image to run integration tests for the remote Alertmanager (#76608)
* Alerting: Use Mimir image to run integration tests for the remote Alertmanager

* skip integration test when running all tests

* skipping integration test when no Alertmanager URL is provided

* fix bad host for mimir_backend

* remove basic auth testing until we have an nginx image in our CI
2023-10-17 12:21:45 +02:00
Dimitris Sotirakis d28e365f74 Slack notifications: Remove CI changes notifications from the grafana-delivery channel (#76671)
Remove notification from the grafana-delivery channel
2023-10-17 12:12:02 +03:00
Dimitris Sotirakis faa22b8f20 CI: Remove 0.0.0-test tag event (#76662)
Remove 0.0.0-test tag event
2023-10-17 10:20:14 +03:00
Horst Gutmann 6b52bb9c27 Chore: Upgrade Go to 1.20.10 (#76359) 2023-10-11 16:49:24 +03:00