Alert groups insights and metrics

Grafana IRM provides detailed metrics and logs to help you monitor your alert groups handling performance and analyze trends. These insights enable you to identify bottlenecks, measure response effectiveness, and continuously improve your alerting processes.

About alert groups metrics

Alert groups metrics in Grafana IRM track key performance indicators related to alert groups handling, including:

Alert groups volume across integrations
Response times for alert groups acknowledgment
Notification patterns
Team and user metrics

These metrics are exposed in Prometheus format, making them easy to query and visualize in Grafana dashboards.

Available metrics

Grafana IRM provides the following core metrics:

Metric	Type	Description
`alert_groups_total`	Gauge	Total count of alert groups for each integration by state (firing, acknowledged, resolved, silenced)
`alert_groups_response_time`	Histogram	Mean time between alert groups start and first action over the last 7 days
`alert_groups_resolution_time`	Histogram	Mean time between alert groups start and resolution over the last 7 days
`user_was_notified_of_alert_groups_total`	Counter	Total count of alert groups users were notified of

Access metrics

For Grafana Cloud customers

Alert groups metrics are automatically collected in the preinstalled grafanacloud-usage data source and have the prefix grafanacloud_oncall_instance, for example:

grafanacloud_oncall_instance_alert_groups_total
grafanacloud_oncall_instance_alert_groups_response_time_seconds_bucket
grafanacloud_oncall_instance_alert_groups_resolution_time_seconds_bucket
grafanacloud_oncall_instance_user_was_notified_of_alert_groups_total

Metric details and examples

Alert groups total

This metric tracks the count of alert groups in different states with the following labels:

Label	Description
`id`	ID of Grafana instance (stack)
`slug`	Slug of Grafana instance (stack)
`org_id`	ID of Grafana organization
`team`	Team name
`integration`	Integration name
`service_name`	Value of alert groups `service_name` label
`state`	Alert groups state (`firing`, `acknowledged`, `resolved`, `silenced`)

Example query:

Get the number of alert groups in “firing” state for “Grafana Alerting” integration:

grafanacloud_oncall_instance_alert_groups_total{integration="Grafana Alerting", state="firing"}

Alert groups response time

This metric tracks response times with the following labels: