Automated Backup with Docker setup

revant_one · January 16, 2021, 3:22pm

The frappe framework feature of S3 backup has open issues

S3 Backup create bucket on Amazon s3 but does not add files. · Issue #15261 · frappe/frappe · GitHub (from 2017)
Offsite backup fails · Issue #14823 · frappe/frappe · GitHub (from 2020)

Attempt to fix?

you’ll need to follow the trail from s3_backup_settings.py
use print() and console.log() Debugging
If you prefer debugger VSCode, PyCharm

You can use docker based alternative, It’ll also backup and push site_config.json.
more: GitHub - frappe/frappe_docker: Docker images for production and development setups of the Frappe framework and ERPNext

docker based alternative

docker task for s3 backups are tested everyday as part of cron job.

github.com

frappe/frappe_docker/blob/accccb8f4e40bbb925c182dce628e53777e5f4dc/tests/docker-test.sh#L198


      
              --network frappebench00_default \
              vltgroup/s3cmd:latest s3cmd --access_key=$MINIO_ACCESS_KEY \
              --secret_key=$MINIO_SECRET_KEY \
              --region=us-east-1 \
              --no-ssl \
              --host=minio:9000 \
              --host-bucket=minio:9000 \
              mb s3://erpnext
          echo -e "\n"
          
          
echo -e "\e[1m\e[4mPush backup to MinIO s3\e[0m"
          docker run \
              -e BUCKET_NAME=erpnext \
              -e REGION=us-east-1 \
              -e BUCKET_DIR=local \
              -e ACCESS_KEY_ID=$MINIO_ACCESS_KEY \
              -e SECRET_ACCESS_KEY=$MINIO_SECRET_KEY \
              -e ENDPOINT_URL=http://minio:9000 \
              -v frappebench00_sites-vol:/home/frappe/frappe-bench/sites \
              --network frappebench00_default \
              frappe/erpnext-worker:edge push-backup

github.com

frappe/frappe_docker/blob/accccb8f4e40bbb925c182dce628e53777e5f4dc/tests/docker-test.sh#L235


      
          docker-compose \
              --project-name frappebench00 \
              -f installation/docker-compose-common.yml \
              -f installation/docker-compose-erpnext.yml \
              -f installation/erpnext-publish.yml \
              up -d
          
          
loopHealthCheck
          echo -e "\n"
          
          
echo -e "\e[1m\e[4mRestore backup from MinIO / S3\e[0m"
          docker run \
              -e MYSQL_ROOT_PASSWORD=admin \
              -e BUCKET_NAME=erpnext \
              -e BUCKET_DIR=local \
              -e ACCESS_KEY_ID=$MINIO_ACCESS_KEY \
              -e SECRET_ACCESS_KEY=$MINIO_SECRET_KEY \
              -e ENDPOINT_URL=http://minio:9000 \
              -e REGION=us-east-1 \
              -v frappebench00_sites-vol:/home/frappe/frappe-bench/sites \
              --network frappebench00_default \