Sergei Poljanski
e20f5a7d07
All checks were successful
deploy / ansible (push) Successful in 7m23s
Nothing watched the servers: tonight's asxpio crash loop was found by hand. On asxpio-ops, Prometheus (30 days), Loki (14 days) and Grafana at gf.asxp.io (WireGuard only), with blackbox_exporter probing every service from outside and postgres_exporter. On both hosts node_exporter and cAdvisor on the VPC address, and Alloy shipping container logs, the journal and Traefik's access log to Loki over the VPC. Traefik and Forgejo expose their metrics; restic and the bucket replica record their last success for node_exporter. Dashboards: an overview as home, plus hosts, containers, Traefik, probes, Postgres and logs. Alerts by email to me@asxp.io: host or service down, certificate under 14 days, disk or memory nearly full, a container restart-looping, Postgres down, backup or replica stale. Assisted-by: Claude:opus-5-5
34 lines
1.4 KiB
YAML
34 lines
1.4 KiB
YAML
---
|
|
# Monitoring: Prometheus, Loki and Grafana on asxpio-ops; node_exporter,
|
|
# cAdvisor and Alloy on both hosts. Scrapes and log shipping use the VPC.
|
|
|
|
# renovate: datasource=docker depName=prom/prometheus
|
|
monitoring_prometheus_version: "v3.16.0"
|
|
# renovate: datasource=docker depName=grafana/grafana
|
|
monitoring_grafana_version: "12.4.15"
|
|
# renovate: datasource=docker depName=grafana/loki
|
|
monitoring_loki_version: "3.7.9"
|
|
# renovate: datasource=docker depName=grafana/alloy
|
|
monitoring_alloy_version: "v1.21.3"
|
|
# renovate: datasource=docker depName=prom/node-exporter
|
|
monitoring_node_exporter_version: "v1.12.1"
|
|
# renovate: datasource=docker depName=ghcr.io/google/cadvisor
|
|
monitoring_cadvisor_version: "v0.60.6"
|
|
# renovate: datasource=docker depName=prom/blackbox-exporter
|
|
monitoring_blackbox_version: "v0.29.1"
|
|
# renovate: datasource=docker depName=quay.io/prometheuscommunity/postgres-exporter
|
|
monitoring_postgres_exporter_version: "v0.20.1"
|
|
|
|
monitoring_metrics_retention: 30d
|
|
monitoring_logs_retention: 336h # 14 days
|
|
monitoring_alert_email: me@asxp.io
|
|
|
|
# Agents listen on the host's VPC address only
|
|
monitoring_node_exporter_port: 9100
|
|
monitoring_cadvisor_port: 9180
|
|
monitoring_loki_port: 3100
|
|
monitoring_textfile_dir: /var/lib/node_exporter/textfile
|
|
|
|
monitoring_grafana_host: gf.asxp.io
|
|
monitoring_grafana_admin_password: "{{ vault_grafana_admin_password }}"
|
|
monitoring_forgejo_metrics_token: "{{ vault_forgejo_metrics_token }}"
|