Skip to content

Commit

Permalink
Update alerts in 24h BigQuery exporter deployment (#1040)
Browse files Browse the repository at this point in the history
  • Loading branch information
cristinaleonr authored Apr 12, 2024
1 parent 8706caa commit 3fff7f5
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions config/federation/prometheus/alerts.yml
Original file line number Diff line number Diff line change
Expand Up @@ -841,13 +841,13 @@ groups:

# GardenerHistoricalThroughputIsStalled fires when historical reprocessing for
# datatypes under processing by the v2 pipeline falls below 1 date / day.
# The bq_gardener_historical_throughput metric is under the bigquery exporter 3h
# deployment, so the timeout for this alert is 4 hours.
# The bq_gardener_historical_throughput metric is under the bigquery exporter 24h
# deployment, so the timeout for this alert is 48 hours.
- alert: GardenerHistoricalThroughputIsStalled
expr: |
increase(gardener_jobs_total{status="success", daily="false"}[1d]) > 0
UNLESS ON(experiment, datatype) bq_gardener_historical_throughput > 0
for: 8h
for: 48h
labels:
repo: dev-tracker
severity: ticket
Expand All @@ -863,7 +863,7 @@ groups:
- alert: GardenerConfigDatatypeMissingInGardenerHistoricalThroughputQuery
expr: |
gardener_config_datatypes UNLESS ON(experiment, datatype) bq_gardener_historical_throughput
for: 8h
for: 48h
labels:
repo: dev-tracker
severity: ticket
Expand Down

0 comments on commit 3fff7f5

Please sign in to comment.