ERPNext 13 Docker - Ubuntu 22.04 - Jan 2023

revant_one · January 25, 2023, 6:12am

Self host your cluster, no vendor lock-in.

No docker? k3s uses containerd. It has vast search results to get you running.

Ysedky · January 25, 2023, 10:28pm

Any idea about best way to move an ERPNEXT v13 stack from one production Docker Swarm to another server in another swarm?

I used your latest documentation for Docker Swarm till the CRON step.

Now I have 3 production sites that I want to move them to a new VPS (higher specs) and don’t want to loose the data.

I have very limited HDD space on the old server so taking local backup of the DB is almost impossible.

Thanks,

revant_one · January 26, 2023, 12:14am

Attach and mount a volume to backup data. You can then unmount and attach the same volume on new server to restore.

Ysedky · January 26, 2023, 4:51pm

Shall I do this after performing the final step in custom_containers/docker-swarm.md at main · castlecraft/custom_containers · GitHub i.e. I create the erpnext stack, configure-erpnext, create-site , and erpnext-backup ?

Is it fine to drop the “mariadb-slave” database to free space ? this will free almost half the hard disk.

I can’t create a volume on the old server (no free space to store the MariaDB database) , is it possible to run scp and pull the data from the volumes below to overwrite its corresponding volumes on the new server?

/var/lib/docker/volumes/mariadb_db-data/_data
/var/lib/docker/volumes/frappe-bench-v13_redis-cache-vol/_data
/var/lib/docker/volumes/frappe-bench-v13_redis-queue-vol/_data
/var/lib/docker/volumes/frappe-bench-v13_redis-socketio-vol/_data
/var/lib/docker/volumes/frappe-bench-v13_sites-vol/_data
/var/lib/docker/volumes/frappe-bench-v13_assets-vol/_data
/var/lib/docker/volumes/frappe-bench-v13_logs-vol/_data

I also noticed in your gist that you used only one environment variable “VERSION” while we used to have two variables; “ERPNEXT_VERSION” and “FRAPPE_VERSION”

T33KS · January 26, 2023, 7:38pm

Hello tareks,

When did you last try to set it up using these instructions.

Because I’ve been trying for a week now, and I get an error after running the new-site command. The same error as in this issue

Any ideas?

jannis · January 26, 2023, 8:31pm

Hello,

thank’s,

I’m search a instruction such as this Fast steps to install Frappe/ERPNext v13/v14 on Clean Ubuntu 22.04 Production/Develop

Tested and working in Jan 2023.

Very good quality, @PyJumper ++ .

Greezs

revant_one · January 26, 2023, 10:58pm

mariadb slave can be removed if it’s not used.
you can try whatever works for you

there was a refactor to images, now we use only 1 ERPNext image, so only one VERSION.

Ysedky · January 29, 2023, 2:00pm

I got the same error when going step by step (without changing anything) into custom_containers/docker-swarm.md at main · castlecraft/custom_containers · GitHub by @revant_one

Here is the error:
2023-01-29 13:38:49 24 [Warning] Access denied for user ‘root’@‘localhost’ (using password: YES)

I have tried all the possible solutions as in : Database Error on Creating First Site during Docker Compose Installation · Issue #1056 · frappe/frappe_docker · GitHub

Any ideas?

T33KS · January 29, 2023, 3:00pm

I can’t figure it out. I’m still facing the same issue, but I followed the single server instructions and not the swarm one.
I tried it with 14.13 and 14.14.

Edit: Does your password contain any special week l character. Check this reply from @revant_one on GitHub:

github.com/frappe/frappe_docker

Database Error on Creating First Site during Docker Compose Installation

opened 10:51PM - 24 Jan 23 UTC

xbiggyl

bug

## Description of the issue This issue has been described in this closed issu…e here and I tried to comment but no reply: https://github.com/frappe/frappe_docker/issues/1009 I am getting the same error as in the issue above, after multiple tries and starting from scratch each time. `pymysql.err.OperationalError: (1045, "Access denied for user 'root'@'172.27.0.8' (using password: YES)"` ## Context information (for bug reports) I am trying to setup ERPnext on a dedicated server running Ubuntu 20.04 by following the single server docker installation instructions here: https://github.com/frappe/frappe_docker/blob/main/docs/single-server-example.md I am also following the Port Based Multiple Tenancy instructions here: https://github.com/frappe/frappe_docker/blob/main/docs/port-based-multi-tenancy.md ## Steps to reproduce the issue By following the instructions to the letter I receive the above mentioned error when I run the following command (I replaced the changeit with the corresponding password): ``` docker compose --project-name erpnext-one exec backend \ bench new-site one.example.com --no-mariadb-socket --mariadb-root-password changeit --install-app erpnext --admin-password changeit ``` ### Stacktrace / full error message if available ``` Traceback (most recent call last): File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/home/frappe/frappe-bench/apps/frappe/frappe/utils/bench_helper.py", line 109, in <module> main() File "/home/frappe/frappe-bench/apps/frappe/frappe/utils/bench_helper.py", line 18, in main click.Group(commands=commands)(prog_name="bench") File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/click/core.py", line 829, in __call__ return self.main(*args, **kwargs) File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/click/core.py", line 782, in main rv = self.invoke(ctx) File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/click/core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/click/core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/click/core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/click/core.py", line 610, in invoke return callback(*args, **kwargs) File "/home/frappe/frappe-bench/apps/frappe/frappe/commands/site.py", line 74, in new_site _new_site( File "/home/frappe/frappe-bench/apps/frappe/frappe/installer.py", line 80, in _new_site install_db( File "/home/frappe/frappe-bench/apps/frappe/frappe/installer.py", line 156, in install_db setup_database(force, source_sql, verbose, no_mariadb_socket) File "/home/frappe/frappe-bench/apps/frappe/frappe/database/__init__.py", line 20, in setup_database return frappe.database.mariadb.setup_db.setup_database( File "/home/frappe/frappe-bench/apps/frappe/frappe/database/mariadb/setup_db.py", line 41, in setup_database if force or (db_name not in dbman.get_database_list()): File "/home/frappe/frappe-bench/apps/frappe/frappe/database/db_manager.py", line 49, in get_database_list return self.db.sql("SHOW DATABASES", pluck=True) File "/home/frappe/frappe-bench/apps/frappe/frappe/database/database.py", line 199, in sql self.connect() File "/home/frappe/frappe-bench/apps/frappe/frappe/database/database.py", line 113, in connect self._conn = self.get_connection() File "/home/frappe/frappe-bench/apps/frappe/frappe/database/mariadb/database.py", line 98, in get_connection conn = self._get_connection() File "/home/frappe/frappe-bench/apps/frappe/frappe/database/mariadb/database.py", line 104, in _get_connection return self.create_connection() File "/home/frappe/frappe-bench/apps/frappe/frappe/database/mariadb/database.py", line 107, in create_connection return pymysql.connect(**self.get_connection_settings()) File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/pymysql/connections.py", line 353, in __init__ self.connect() File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/pymysql/connections.py", line 633, in connect self._request_authentication() File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/pymysql/connections.py", line 907, in _request_authentication auth_packet = self._read_packet() File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/pymysql/connections.py", line 725, in _read_packet packet.raise_for_error() File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/pymysql/protocol.py", line 221, in raise_for_error err.raise_mysql_exception(self._data) File "/home/frappe/frappe-bench/env/lib/python3.10/site-packages/pymysql/err.py", line 143, in raise_mysql_exception raise errorclass(errno, errval) pymysql.err.OperationalError: (1045, "Access denied for user 'root'@'172.27.0.8' (using password: YES)") ``` ### Additional Info I even tried the following troubleshooting instructions: https://github.com/frappe/frappe_docker/blob/main/docs/troubleshoot.md#fixing-mariadb-issues-after-rebuilding-the-container But I keep getting the error. The site folder is created is: /var/lib/docker/volumes/erpnext-one_sites/_data But no DB entry in mariadb, not even a mariadb database is created. This is the result from `SHOW DATABASES;` ``` +--------------------+ | Database | +--------------------+ | information_schema | | mysql | | performance_schema | | sys | +--------------------+ ``` ### The erpnext-one.yaml file after removing the Traefik stuff and adding the port-site-1 and port-site-2 (as per [this](https://github.com/frappe/frappe_docker/blob/main/docs/port-based-multi-tenancy.md)) ``` name: erpnext-one services: backend: depends_on: configurator: condition: service_completed_successfully image: frappe/erpnext:v14.13.0 networks: bench-network: null mariadb-network: null volumes: - type: volume source: sites target: /home/frappe/frappe-bench/sites volume: {} configurator: command: - | bench set-config -g db_host $$DB_HOST; bench set-config -gp db_port $$DB_PORT; bench set-config -g redis_cache "redis://$$REDIS_CACHE"; bench set-config -g redis_queue "redis://$$REDIS_QUEUE"; bench set-config -g redis_socketio "redis://$$REDIS_SOCKETIO"; bench set-config -gp socketio_port $$SOCKETIO_PORT; depends_on: redis-cache: condition: service_started redis-queue: condition: service_started redis-socketio: condition: service_started entrypoint: - bash - -c environment: DB_HOST: mariadb-database DB_PORT: "3306" REDIS_CACHE: redis-cache:6379 REDIS_QUEUE: redis-queue:6379 REDIS_SOCKETIO: redis-socketio:6379 SOCKETIO_PORT: "9000" image: frappe/erpnext:v14.13.0 networks: bench-network: null mariadb-network: null volumes: - type: volume source: sites target: /home/frappe/frappe-bench/sites volume: {} frontend: command: - nginx-entrypoint.sh depends_on: backend: condition: service_started websocket: condition: service_started environment: BACKEND: backend:8000 CLIENT_MAX_BODY_SIZE: 50m FRAPPE_SITE_NAME_HEADER: $$host PROXY_READ_TIMOUT: "120" SOCKETIO: websocket:9000 UPSTREAM_REAL_IP_ADDRESS: 127.0.0.1 UPSTREAM_REAL_IP_HEADER: X-Forwarded-For UPSTREAM_REAL_IP_RECURSIVE: "off" image: frappe/erpnext:v14.13.0 networks: bench-network: null volumes: - type: volume source: sites target: /home/frappe/frappe-bench/sites volume: {} queue-default: command: - bench - worker - --queue - default depends_on: configurator: condition: service_completed_successfully image: frappe/erpnext:v14.13.0 networks: bench-network: null mariadb-network: null volumes: - type: volume source: sites target: /home/frappe/frappe-bench/sites volume: {} queue-long: command: - bench - worker - --queue - long depends_on: configurator: condition: service_completed_successfully image: frappe/erpnext:v14.13.0 networks: bench-network: null mariadb-network: null volumes: - type: volume source: sites target: /home/frappe/frappe-bench/sites volume: {} queue-short: command: - bench - worker - --queue - short depends_on: configurator: condition: service_completed_successfully image: frappe/erpnext:v14.13.0 networks: bench-network: null mariadb-network: null volumes: - type: volume source: sites target: /home/frappe/frappe-bench/sites volume: {} redis-cache: image: redis:6.2-alpine networks: bench-network: null mariadb-network: null volumes: - type: volume source: redis-cache-data target: /data volume: {} redis-queue: image: redis:6.2-alpine networks: bench-network: null mariadb-network: null volumes: - type: volume source: redis-queue-data target: /data volume: {} redis-socketio: image: redis:6.2-alpine networks: bench-network: null mariadb-network: null volumes: - type: volume source: redis-socketio-data target: /data volume: {} scheduler: command: - bench - schedule depends_on: configurator: condition: service_completed_successfully image: frappe/erpnext:v14.13.0 networks: bench-network: null mariadb-network: null volumes: - type: volume source: sites target: /home/frappe/frappe-bench/sites volume: {} websocket: command: - node - /home/frappe/frappe-bench/apps/frappe/socketio.js depends_on: configurator: condition: service_completed_successfully image: frappe/erpnext:v14.13.0 networks: bench-network: null mariadb-network: null volumes: - type: volume source: sites target: /home/frappe/frappe-bench/sites volume: {} port-site-1: image: frappe/erpnext:v14.13.0 deploy: restart_policy: condition: on-failure command: - nginx-entrypoint.sh environment: BACKEND: backend:8000 FRAPPE_SITE_NAME_HEADER: erp.nameofmysite.me SOCKETIO: websocket:9000 volumes: - sites:/home/frappe/frappe-bench/sites ports: - "8081:8080" port-site-2: image: frappe/erpnext:v14.13.0 deploy: restart_policy: condition: on-failure command: - nginx-entrypoint.sh environment: BACKEND: backend:8000 FRAPPE_SITE_NAME_HEADER: erp2.nameofmysite.me SOCKETIO: websocket:9000 volumes: - sites:/home/frappe/frappe-bench/sites ports: - "8082:8080" networks: bench-network: name: erpnext-one mariadb-network: name: mariadb-network external: true volumes: redis-cache-data: name: erpnext-one_redis-cache-data redis-queue-data: name: erpnext-one_redis-queue-data redis-socketio-data: name: erpnext-one_redis-socketio-data sites: name: erpnext-one_sites x-backend-defaults: depends_on: configurator: condition: service_completed_successfully image: frappe/erpnext:v14.13.0 volumes: - sites:/home/frappe/frappe-bench/sites x-depends-on-configurator: depends_on: configurator: condition: service_completed_successfully ```

Ysedky · January 29, 2023, 4:50pm

It Works!

I rebuilt the server from scratch, followed step by step the instructions as per custom_containers/docker-swarm.md at main · castlecraft/custom_containers · GitHub by @revant_one

The only change I’ve made is to disable the Access control (made the stack “public”) for the stacks:
mariadb, erpnext, configure-erpnext and the add-site-example-com stacks.

Also, it is important to comment the --install-app=payments in the create-site.yml before deploying the stack (if you are not installing Version 14).

I used:
BENCH_NAME = ERPNext
VERSION = v13.43.1 which caused in the installed apps (Help/About):
ERPNext: v13.43.1 (HEAD)
Frappe Framework: v13.47.0 (HEAD)

OS: ubuntu 22.04 (64)
Docker Compose version v2.15.1
Portainer CE version 2.16.2
traefik version 2.9.6

T33KS · January 30, 2023, 12:04pm

I was able to solve it as well.

I had to delete the following directory on my server:

~/data/mariadb:/var/lib/mysql

which is used by the mariadb compose file used in the single server instructions.

For more info check the issue I closed on GitHub

Ysedky · January 30, 2023, 5:49pm

I migrated three sites by making S3 Backup then downloading the database, private files, public files and site-config to the sites folder then run the bench restore command.

I’ve also copied the encryption key from the old site-config file(s) to the new site(s).

I have now these problems/inquiries:

1- Lets Encrypt certificate of the three sites are all “not verified by 3rd party” in this setup it should be “Let’s Encrypt” , they were not added to Traefik acme.json . Any idea on how to regenerate the certificates? Are there any files that has to be copied but were not included in the S3 backup files ?
acme.json has only certificates for Traefik and Portainer.

2- Why there is no “assets” volume in the erpnext stack ? I see they are created under random names.

3- All PDFs (like quotations, POs, etc…) print in one “left” column despite checking the “Print Style” to 2 columns. Also the logo is not showing.

4- in @revant_one script we used only one “VERSION” environment variable due to the refactor.
I also noticed that this variable “VERSION” is used in “erpnext” stack, “site-config” stack, and create-site stack. What is I want to upgrade the ERPNEXT Version say from v13.41.1 to v13.44.0; shall I change the version in the three stacks and redeploy ? or it is enough to re-deploy the “erpnext” stack?
If we’ll do so, then after re-deploy, the old images will always reside on the system as they are still connected to the “run once” containers like “site-config” and “create-site”.

Thanks,

revant_one · January 30, 2023, 9:46pm

no clue, works for me on all sites, check dns
no need for assets. every image will have its own assets copy mounted in temp volumes. No need for asset population container
No idea, I’ve not faced it yet for custom images.
next time you run site config or create site change the version. It is not required to run those containers on every update?

Ysedky · February 4, 2023, 12:43am

I’ve made a reset to the server (OS reinstalled) and followed @revant_one script on:

github.com

castlecraft/custom_containers/blob/main/docs/docker-swarm.md#setup-traefik

## Topics

- [Install Prerequisites](#install-prerequisites)
- [Setup Docker Swarm](#setup-docker-swarm)
- [Setup Traefik](#setup-traefik)
- [Setup Portainer](#setup-portainer)
- [Setup MariaDB](#setup-mariadb)
- [Setup Swarm CRON](#setup-swarm-cron)
- [Setup ERPNext](#setup-erpnext)

### Install Prerequisites

These steps are required for production server. For dind/local setup copy `dind-devcontainer` to `.devcontainer` and reopen in devcontainer.

Use files from `compose` directory.

Setup assumes you are using Debian based Linux distribution.

Update packages

This file has been truncated. show original

Let’s Encrypt fixed.
I changed the DNS of the sites that will be migrated from the IP of the old server to the IP of the new server.
Created the sites and went through the setup wizard for each site.
Made a Copy/Paste of the old encryption keys from the old to the corresponding new sit-config
Made a bench restore command.

2- Comment of asset is noted.

3- I still have a problem that all PDFs non-table sections are printed in one column to the right. I’m digging to find a solution for this.

4- In case I want to upgrade the “erpnext” stack, I will just edit the stack, change the “VERSION” then redeploy the stack ?

Ysedky · February 4, 2023, 12:55am

Hi Revant

Regarding No. 3 , I’m facing the same problem as described in CSS not working on Generate PDF although I’m using VERSION 13.41.1 (the problem appeared in v11)

Any idea why this errors occurred ? Is the a custom image?

Printing through the PC “save to PDF” option is looking fine, only the “PDF” button is missing the css.

Thanks,

Ysedky · February 4, 2023, 1:29am

Solved using:

On the Backend Container:
bench --site mysite.domain.com set-config hostname “https://mysite.domain.com:443”

as per Pdf's not looking nice as html documents (assume CSS missing) - #4 by vrms

The question is why I had to add this if it is supposed to be fixed after v11?

revant_one · February 4, 2023, 6:09am

Yes.

There is another way to automate it https://www.youtube.com/watch?v=IZss2CziUnI

Ysedky · February 15, 2023, 11:19am

I have now 3 sites (e.g. site1.domain.com , site2.domain.com, site3.otherdomain.com) fully running in production environment on Docker Swarm node with Traefik and Portainer installed as per @revant_one manifest ( custom_containers/docker-swarm.md at main · castlecraft/custom_containers · GitHub ) .

VERSION = v13.45.0

I read the thread ( Upgrading to v14 for a Dockerized deployement ) but can’t figure out what’s the safest way to perform an upgrade to v14 . I also want to install HR and Education modules .

Any idea/link of how to do this ?

revant_one · February 15, 2023, 11:25am

build custom image with new apps

mentioned here: Frequently Asked Questions · frappe/frappe_docker Wiki · GitHub

here: frappe_docker/custom-apps.md at main · frappe/frappe_docker · GitHub

and here: Container Builds - #2 by revant_one

Make sure you try your upgrade locally in development env with set of apps that are needed for your use. If you don’t install required apps, the functionality will be missing from new version.

then upgrade as usual.

Ysedky · February 28, 2023, 4:31pm

I went through the links. Thank you.
I don’t have a custom image, however due to breaking the monolith architecture in v14, I will need to install the apps “payments”, “hrms” and “ecommerce_integrations” in addition to “erpnext” of course.

I just wonder where to start in my Portainer installation of Docker Swarm I have 4 stacks:

erpnext
configure_erpnext
create-site
erpnext-backup

as per custom_containers/docker-swarm.md at main · castlecraft/custom_containers · GitHub

Shall I just edit the “erpnext” stack, change the VERSION env variable to v14 then redeploy ?
Or I need to deploy a new stack ?

Thanks,