I probably spent 30 hours to figure this out, playing with k3s on EC2, EKS and finally GKE. I’m not an expert with K8s, beginner level I would consider myself.
A great deal of help from @revant_one helped me to get here, so special thanks to him.
Here are the exact steps I did.
-
Create a K8s cluster. In this case I used GKE, but other K8s clusters should work too. This step is irrelevant to ERPNext installation.
-
Install an in-cluster NFS service
The special thing here is to make the storage larger than 8GiB, otherwise ERPNext will complain when claiming PV.
# prepare NFS, this NFS has to be slightly larger than 8GiB, or ERPNext will fail to bind the storage
kubectl create namespace nfs
helm repo add nfs-ganesha-server-and-external-provisioner https://kubernetes-sigs.github.io/nfs-ganesha-server-and-external-provisioner
helm upgrade --install -n nfs in-cluster nfs-ganesha-server-and-external-provisioner/nfs-server-provisioner --set 'storageClass.mountOptions={vers=4.1}' --set persistence.enabled=true --set persistence.size=9Gi
- Install ERPNext
Nothing special here, these are just copy and paste from the helm chart.
# install ERPNext, don't use custom values
kubectl create namespace erpnext
helm repo add frappe https://helm.erpnext.com
helm upgrade --install frappe-bench --namespace erpnext frappe/erpnext --set persistence.worker.storageClass=nfs
- Create a site, modify the
values.yamlfile which you can find in the helm chart. This is just following up the guide.
jobs:
createSite:
enabled: true
siteName: "erp.example.com"
adminPassword: "secret"
Run the following commands:
helm template frappe-bench -n erpnext frappe/erpnext -f custom-values.yaml -s templates/job-create-site.yaml > create-new-site-job.yaml
kubectl apply -f create-new-site-job.yaml -n erpnext
- Verify the site is working. You can certainly check the pods in the K8s cluster too.
kubectl port-forward -n erpnext svc/frappe-bench-erpnext 8080:8080
curl -H "Host: erp.example.com" http://0.0.0.0:8080/api/method/ping
It should return:
{"message":"pong"}
- Install ingress-nginx
helm install nginx-ingress ingress-nginx/ingress-nginx
- Create a new ingress to route the traffic from internet
Create a yaml file called ingress.yaml
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: erp-resource
annotations:
kubernetes.io/ingress.class: "nginx"
nginx.ingress.kubernetes.io/ssl-redirect: "false"
spec:
rules:
- host: "erp.example.com"
http:
paths:
- pathType: Prefix
path: "/"
backend:
service:
name: frappe-bench-erpnext
port:
number: 8080
kubectl apply -f ingress.yaml -n erpnext
Then you should be able to visit it from erp.example.com.
This is only http, so you will get insecure access warning from the browser.