We are thinking of importing products from a marketplace into ERPNext. With all permutations it could well be over a million items. I could imagine, that this can slow down ERPNext a lot. Does anyone have experiences with such high load of elements? Are there any guidelines?
Import the most frequent, important items or create them on the fly when you get the first opportunity for that combination!
1 Like
Yeah, that’s more complex to develop. But it will circumvent the performance issues most likely. So having 1,5 Million items in ERPNext isn’t something that you would recommend, right?
I would put it at the last option. I know @dhananjay has gone this path. Maybe he can share his experience.
We have around 1 Million items.
There are some issues with having these many items uploaded:
- There is some lag seen ( 1s or 2s) while selecting an Item from the Item table(Quotation, Sales Order, .etc)
- Analytics Reports timed out are not visible-(there is an active github issue for this)
There are also other problems, which I realized after importing these items
- Renaming Items in bulk
- Replacing BOMs linked to more than 40 items
- Updating Items: Data Import Tool has upload limits, this has to be done in batches
2 Likes
Thanks for this answer. I think we will want to circumvent this problem then.
Thanks for sharing @dhananjay. I think your performance will improve with V11! Excited to see the results once you move to it.
2 Likes
Do u have probs opening documents (invoices, receipt) with 2000+ items?
The answer to that is No
We have over 30,000 items in our database and have seen no performance issues at all
Regards
1 Like
we dont run the test with million items, but we tested with around 50K items.
we did two experiments.
- with Item code as integer
- Item Code as item name
and items with item_code as integer was quite efficient. consider it while importing to ERPNext
I don’t have a single transaction with more than 150 items.
@adnan @olamide_shodunke i do not mean total number of item in db, i mean a document (sales invoice, sales order, receipt) with 1500+ item in child table
in this case, i tested documents with 800 items in stock entry and purchase receipts. it’s working fine if against each entry there are only 2 or 3 GL entries. but if there are more GL entries, against each entry, you’ll face Request Time Out.
More GL Entries are due to different Warehouse, Cost Center etc…
Why don’t you use the Api to import product rather then the native import. We have been able to get 100K products pretty easily, we can also bulk update things like price, name and so on through the API.
2 Likes
I am facing issues with importing 1000 products in ERPNext through excel import
What error message do you get ?
can I chat with you on Skype? I am trying to setup a fresh database with data. The errors are:
{“messages”: [{“message”: "
Row 1: An Reorder entry already exists for this warehouse None
", “row”: 21, “link”: “desk#Form/Error%20Log/1d1de4fe67”, “indicator”: “red”, “title”: “Error for row 2133-0492-1020”}, {“message”: "
Row 1: An Reorder entry already exists for this warehouse None
", “row”: 22, “link”: “desk#Form/Error%20Log/cdd4d9b3da”, “indicator”: “red”, “title”: “Error for row 1690-0374-0370”}, {“message”: "
Row 1: An Reorder entry already exists for this warehouse None
", “row”: 23, “link”: “desk#Form/Error%20Log/cea74b67ab”, “indicator”: “red”, “title”: “Error for row 1871-0311-1337”}, {“message”: "
Row 1: An Reorder entry already exists for this warehouse None
", “row”: 24, “link”: “desk#Form/Error%20Log/3bb30975e1”, “indicator”: “red”, “title”: “Error for row 2780-0376-1373”}, {“message”: "
Row 1: An Reorder entry already exists for this warehouse None
", “row”: 25, “link”: “desk#Form/Error%20Log/96a51ecda0”, “indicator”: “red”, “title”: “Error for row 2313-0276-0926”}, {“message”: "
Row 1: An Reorder entry already exists for this warehouse None
", “row”: 26, “link”: “desk#Form/Error%20Log/9651b7b294”, “indicator”: “red”, “title”: “Error for row 1739-0347-0627”}, {“message”: "
Row 1: An Reorder entry already exists for this warehouse None
", “row”: 27, “link”: “desk#Form/Error%20Log/04bcf51c0d”, “indicator”: “red”, “title”: “Error for row 1739-0347-0626”}, {“message”: "
Row 1: An Reorder entry already exists for this warehouse None
", “row”: 28, “link”: “desk#Form/Error%20Log/98826add9a”, “indicator”: “red”, “title”: “Error for row 1739-0347-0625”}, {“message”: "
My Skype is sumitarora6
