Sergei Poljanski
2e9d4649a0
restic writes both regions itself, but the ad-hoc backups under asxpio-ops/, the Terraform state and the k8s state only ever went to hel1. Sync each hel1 bucket into its fsn1 twin every morning from asxpio-services, with rclone pinned like everything else. restic/ is excluded, so the independent fsn1 restic repositories are never touched. A run that would delete more than 1000 objects stops and mails, so a mistake on the hel1 side cannot empty the replica the next morning. The first dry run copied 23 objects and deleted none. Assisted-by: Claude:opus-5-5
19 lines
654 B
Django/Jinja
19 lines
654 B
Django/Jinja
#!/bin/bash
|
|
# Managed by Ansible (role s3_replicate). hel1 -> fsn1, one bucket at a time;
|
|
# a failing pair does not stop the others, but fails the run.
|
|
set -uo pipefail
|
|
failed=0
|
|
rclone() {
|
|
docker run --rm --env-file /etc/s3-replicate/env \
|
|
rclone/rclone:{{ s3_replicate_rclone_version }} "$@"
|
|
}
|
|
{% for p in s3_replicate_pairs %}
|
|
echo "s3-replicate: {{ p.src }} -> {{ p.dst }}"
|
|
rclone sync hel1:{{ p.src }} fsn1:{{ p.dst }} \
|
|
--fast-list --checkers 16 --transfers 8 --max-delete {{ s3_replicate_max_delete }} \
|
|
{% for e in p.exclude | default([]) %}
|
|
--exclude '{{ e }}' \
|
|
{% endfor %}
|
|
--stats-one-line -v || failed=1
|
|
{% endfor %}
|
|
exit $failed
|