asxpi/iac
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

monitoring: collapse session scopes, fix cadvisor healthcheck
All checks were successful
deploy / ansible (push) Successful in 7m59s
Details

Browse source 
Each SSH login from Ansible and CI deploys creates its own
session-N.scope unit. As a journal label that made 3400+ streams and
Loki rejected new ones with 429, dropping container logs. Map them all
to session.scope.

cAdvisor's image healthcheck probes localhost:8080, but it listens on
the VPC address on 9180, so both containers showed unhealthy.

Assisted-by: Claude:opus-5-5
This commit is contained in:
Sergei Poljanski 2026-11-13 06:42:10 +04:00
commit 2359370e24
Signed by: asxpi
GPG key ID: 4F8851660FA4121B
2 changed files with 14 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

8
ansible/roles/monitoring_agent/templates/config.alloy.j2
View file

@ -46,6 +46,14 @@ loki.relabel "journal" {
source_labels = ["__journal__systemd_unit"]
target_label = "unit"
}
// Every SSH login (Ansible, CI deploys) gets its own session-N.scope:
// one stream each blew Loki's active stream limit.
rule {
source_labels = ["unit"]
regex = "session-\\d+\\.scope"
target_label = "unit"
replacement = "session.scope"
}
rule {
source_labels = ["__journal_priority_keyword"]
target_label = "level"