I have deployed Frappe/ERPNext on Kubernetes but cannot see ERPNext apps in it

hamza_toor · September 7, 2022, 5:47am

I have deployed Frappe/ERPNext on Kubernetes using Frappe/ERPNext Helm chart. I am able to access the application on browser. Thanks @revant_one for the help. I made use of the script that you made. Frappe Application is running fine. I have added ERPNext application in it as well by adding “erpnext” in jobs.installApps in values-job-create-mysite.yaml file. How can I add other apps in it. I have tried populating jobs.installApps with the names of Apps. But that hasn’t worked. How can I add other apps as well. @revant_one
I made use of this script.

github.com

frappe/helm/blob/main/tests/script.sh

#!/bin/bash

echo -e "\e[1m\e[4mCreate testcluster with k3d and kubernetes/ingress-nginx\e[0m"
k3d cluster create testcluster --api-port 127.0.0.1:6443 -p 80:80@loadbalancer -p 443:443@loadbalancer --k3s-arg "--disable=traefik@server:0"
kubectl apply -f https://raw.githubusercontent.com/kubernetes/ingress-nginx/controller-v1.1.1/deploy/static/provider/cloud/deploy.yaml
echo -e "\n"

echo -e "\e[1m\e[4mAdd Helm Repositories\e[0m"
helm repo add bitnami https://charts.bitnami.com/bitnami
helm repo add nfs-ganesha-server-and-external-provisioner https://kubernetes-sigs.github.io/nfs-ganesha-server-and-external-provisioner
helm repo add frappe https://helm.erpnext.com
helm repo update
echo -e "\n"

echo -e "\e[1m\e[4mCreate mariadb release from bitnami/mariadb helm chart\e[0m"
kubectl create namespace mariadb
helm install mariadb -n mariadb bitnami/mariadb -f tests/mariadb/values.yaml --version 10.3.3 --wait
echo -e "\n"

echo -e "\e[1m\e[4mCreate in-cluster release from nfs-ganesha-server-and-external-provisioner/nfs-server-provisioner helm chart\e[0m"

This file has been truncated. show original

revant_one · September 7, 2022, 11:58am

To add custom apps, you need to build your own custom images based on erpnext-worker and erpnext-nginx images

Custom image documentation: frappe_docker/README.md at main · frappe/frappe_docker · GitHub

Example Repo: castlecraft / CEPL ERPNext Images · GitLab

Once you have built your custom images with tags, override them in values.yaml

hamza_toor · September 8, 2022, 5:40am

For a test purpose, I used the same app that you used in the repo you shared. The images got successfully built. I edited the values.yaml file as well and added my own custom built images and tags in that file. However, nginx, worker, gunicorn, etc pods have not started. Their status shows “ImagePullBackOff” and kubectl describe pod [pod_name] -n erpnext gives the following output in the events.
Failed to pull image “registry.gitlab.com/castlecraft/cepl-erpnext-images/nginx:v14.0.3”: rpc error: code = NotFound desc = failed to pull and unpack image “registry.gitlab.com/castlecraft/cepl-erpnext-images/nginx:v14.0.3”: failed to resolve reference “registry.gitlab.com/castlecraft/cepl-erpnext-images/nginx:v14.0.3”: registry.gitlab.com/castlecraft/cepl-erpnext-images/nginx:v14.0.3: not found

revant_one · September 8, 2022, 5:43am

it is just 14.0.3 not v14.0.3. Remove the v

hamza_toor · September 8, 2022, 6:07am

Thanks. This was the actual issue. The pods are up and running. However, I am unable to access the erpnext app. On my browser, when I access the app, it gives 404 Not found error.
I am able to see the logs of these requests in my nginx pod as well

hamza_toor · September 8, 2022, 6:14am

I guess the issue is with the site creation. In my gunicorn pod, I can’t see the site that I created. However, the job is successfully completed and the pod is active.

revant_one · September 8, 2022, 7:56am

share job yaml, make sure you are running the job with correct pvc mounted.

I’m using the same images on my cluster.

hamza_toor · September 8, 2022, 11:33am

Thanks for the help @revant_one . I put a wrong path to the yaml file while creating the site. That’s why the site was not showing anything.

hamza_toor · September 9, 2022, 7:28am

Hi @revant_one . I successfully built India_compliance app that you installed in the example repo. Everything went fine. I was able to see the app in my gunicorn pod and after installing it I was able to use it in my Frappe/ERPNext app as well. I did everything as it is in another VM. I wanted to install hrms and posawesome apps there. I edited ci/clone-apps.sh file. In the repos directory, hrms and posawesome folders were installed. I also edited the backend.Dockerfile. And after making all the changes I built the image again. I added that image in values.yaml file and then installed frappe/erpnext by means of helm install. Everything went fine. THE ISSUE I AM FACING IS THAT WHEN I WENT INSIDE MY gunicorn POD TO INSTALL hrms and posawesome apps, I WAS NOT ABLE TO SEE THOSE APPS IN apps.txt file. Instead, there was India_compliance app showing over there. What can be the issue?

revant_one · September 9, 2022, 7:32am

Kubernetes will not pull images with same tags again unless you change the image pull policy to Always in values.

More about image pull policy: Images | Kubernetes

hamza_toor · September 9, 2022, 7:36am

Even if I am setting this up for the first time on a different system?

revant_one · September 9, 2022, 9:33am

run the configure bench job again

github.com

frappe/helm/blob/27cad47f6869a621e80638037c98bacb0e50f74d/erpnext/templates/job-configure-bench.yaml#L45-L45


      
          ls -1 ../apps > apps.txt;

ejijamz · September 22, 2022, 2:07pm

Hello @revant_one,
I have deployed Frappe/ERPNext on Kubernetes using Frappe/ERPNext Helm chart but I am not able to access the application on the browser. I already edited the host on values-job-create-mysite.yaml and values-ingress-mysite.yaml file, however, when the installation finished and i browse the site, i got the screenshot below. What could be the problem please

revant_one · September 22, 2022, 10:13pm

can you describe the setup?

have you added ingress controller and ingress?

ejijamz · September 23, 2022, 2:16am

Ok

I created a VM(ubuntu)
I installed these dependencies i. Install Docker ii. Install kubectl iii. Install helm
I installed install K3s from K3d.
I cloned this repo GitHub - frappe/helm: Helm Chart Repository for Frappe/ERPNext
from the root folder of this repo, I run this command, “./tests/script.sh”
Before executing the script, I changed the site name and ingress host to my domain name record I created on D-ocean, after running the script, below are my screenshots

The problem now is when i tried to brouse the hostname on browser, it does not open the erpnext page.

Kindly help on how to troubleshoot. Thanks

ejijamz · September 23, 2022, 2:18am

revant_one · September 23, 2022, 7:06am

the screenshot of browser you’ve shared seems to be some other web server. it’s not the ingress controller.

check if any web server like Apache, nginx, httpd are running already? try stopping it if it exists.

ejijamz · October 25, 2022, 12:47am

Hello @revant_one, thank you for your help thus far, I have been able to deploy erpnext successfully on my k3 cluster successfully. But i have an issue, I want to create new sites with the following urls for different environment

Dev - devapp.example.io
Test - testapp.example.io
UAT - uatapp.example.io
Pro - app.example.io,
kindly help and advise on how to create new sites on erpnext k3s cluster?

revant_one · October 25, 2022, 4:23am

check this to add sites helm/README.md at main · frappe/helm · GitHub

To have different environments with different apps, you make need different helm releases / “benches”.

ejijamz · December 5, 2022, 7:18pm

Hi @revant_one, thank you for your help thus far. I have successfully deployed erpnext on my DigitalOcean Kubernetes cluster, I was also able to build my custom-apps successfully using using frappe_docker/README.md at main · frappe/frappe_docker · GitHub .

My question now is,

how do i get the custom app deployed on my erpnext deployed on kubernetes so that i can access the app on the erpnext sites?
After successfully building the app, how does the image url look like and what exactly am I suppose to change in values.yaml to override it and what command do I run after to install the apps?

Kindly help