After deletion of data from the version table also there is no effect on slowness. It is still dead slow even saving expense claims is taking more than 30 seconds.
which version are you using ? How many records in version table ?
Can you make sure there is a index on ref_doctype+docname for version table ?
Regards,
Subhajit
I am using version-13 frappe and erpnext both. I have deleted all the data from Version table already but still loading and data writing speed is insanely slow.
Sounds like different issue, not because version table.
I haven’t tried v13, but you might wanna check the gunicorn/background worker setting.
Also can use recorder app to find out the performance bottleneck
Am having the smae problem with version 13. I ask for a recommend size document and someone told me to get more CPU and RAM. Am runn the same amount of user in a t2.medium instant in AWS. Am current building a new server with 20 vCPU and 30Gb RAM. am concern this will not fix my problem.
is it running slow all the time or just sometimes? how many users does your system have?
i am currently investigating a similar (?) issue: How to pinpoint CPU spike? - Developers - Discuss Frappe/ERPNext
@rmehta I identified one major issue / bug in connections (Dashboard), if the number of records in Journal Entry are huge then system search becomes too slow as everytime you open a doctype with Journal entry in connections it starts searching for the same record in system and it slow downs the system.
I have experienced the slowness major into Expense Claim, Employee Advance, Purchase Invoice, Sales Invoice (All Doctypes having Journal Entry in Dashboard/Connections)
After commenting Jounal Entry from Dashboard the submission of document showed a tremendous change i.e. from 600+ seconds to 26 seconds.
Please help in understanding the slowness in search?
Below are some references -
- 32 Core CPU
- 64 GB RAM
- Intel e7 Processor (Physical Server)
- Ubuntu 20.04
- ERPNext: v13.5.0 (version-13)
- Frappe Framework: v13.5.0 (version-13)
- Journal Entry Count - 2.3M+
- Purchase Invoice - 100k+
- Company - 96 (Multi Company)
The general rule here is not to tag anyone. If you feel someone MUST help you because your problem is very important, then you need to pay for it. If you want ERPNext to fix your issues, here is a link you can sign up. Best wishes.
My intend was not to tag anyone or pinpoint anything. However, I was trying to seek help and have found a major issue and that’s why I tagged. And I wasn’t aware about tagging policy as well. So please take it otherwise.
1 Like
Thank you for share that link. I try meny time to contact ERPNext for enterprise support and no one reply to my request. We are are running a huge instant and you are having problem all you want it help or some one to fix it for you. Am having the same problem with my server. I just recently increase the resource in the data center and thing start working better however we cant just increase resource everytime. I as if there is any white paper on how to sized erpnext server but did not get any answer. This will help with ensure thet we alway have the correct hardware requirement.
My new envoirement is:
ERP App Server
-8 CPU (65 vCore)
-240 Gb RAM
-SSD
MySQL Server (Galera Cluster)
-6 CPU (21 vCore) x3
-81 Gb RAM x3
-100 Gb SSD for Data Only x3
-50 Gb SSD for OS x3
HA Proxey
-6 CPU (21 vCore)
-102 Gb RAM
-SSD
That is a huge set up!!
Are you serving the whole of Jamaica!!!
Lol
I have over 20 clinet runnig a minimum of 17k SKU with about 100K transaction per day.
Impressive, but still…that is a huge server for that number of instances.
Maybe the concurrent user count is in the thousands ??
No it not. but i also want room for growth. And my customer have millions of records in there database. So far it working better after adding more hardware but am not sure if when i add more customer and more data it will start slow down again. This is why i need to undersatnd the size requirement so i can know hown how to invest in the hardware.
My advice. Have different instance per client. I am also facing similar issue but its only with one client. By having independent VPS the issue can be fixed easily. I have tried same as what you did. Increased all parameters, tweaked sql, heck I moved the client to another instance in hope that hardware is failing. No luck. Same issue cropped up in new VPS after migration of db. It’s got something to with how MySQL functions.
Wishing you and me the best of luck.
All the best to you Muzzy.
Have you try setting up MySQL Server (Galera Cluster) with load balance for mysql?
This question is often asked. There are definitely no documents available.
Besides increasing hardware, there are other troubleshooting steps I try to perform:
- Optimizing SQL indexes.
- Archiving historic data to another database.
- Replacing SQL I/O with Redis Cache I/O
- Disabling certain Frappe framework features.
- Optimizing/replacing pieces of framework Python code.
3 Likes
Can we come to gether as community and create document? May be we would need some technical detail from ERPNext, am not sure. The point is all major ERPs have sizing document. What make SAP run good is before you install SAP what to ensure you have the required hardware so they provide you with sized document. I have no issue working with some one to create size document with ERPNext support.
6 Likes
On ERPNEXT website you can find a whitepaper called " Scaling ERPNext". Please check it out it may be useful to find some idea related to scaling up the system
1 Like