ERPNext 10 New Data Import not importing data, it just shows its timing out

Unable to import items, warehouses. NO errors are shown in gui or log, just times out.

Installed Apps

ERPNext: v10.0.5

Frappe Framework: v10.0.6

in version 10 the import happens as a background job. Go to background Job and check what is the status, Also, check the “Show failed jobs” checkbox and look for failed jobs.

Also, How many rows are you trying to import?
In my recent experience it turns out - there is a limit of around 30000 (+/- 5000) rows in the new data import tool. Beyond this i get the following error:

<function upload at 0xb5c9bcdc>
Traceback (most recent call last):
  File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/rq/worker.py", line 713, in perform_job
    rv = job.perform()
  File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/rq/job.py", line 558, in perform
    self._result = self._execute()
  File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/rq/job.py", line 564, in _execute
    return self.func(*self.args, **self.kwargs)
  File "/home/frappe/frappe-bench/apps/frappe/frappe/utils/background_jobs.py", line 95, in execute_job
    method(**kwargs)
  File "/home/frappe/frappe-bench/apps/frappe/frappe/core/doctype/data_import/importer.py", line 414, in upload
    error_log_doc = frappe.log_error(error_trace)
  File "/home/frappe/frappe-bench/apps/frappe/frappe/__init__.py", line 1370, in log_error
    method=title)).insert(ignore_permissions=True)
  File "/home/frappe/frappe-bench/apps/frappe/frappe/model/document.py", line 230, in insert
    self.db_insert()
  File "/home/frappe/frappe-bench/apps/frappe/frappe/model/base_document.py", line 303, in db_insert
    ), list(d.values()))
  File "/home/frappe/frappe-bench/apps/frappe/frappe/database.py", line 139, in sql
    self.check_transaction_status(query)
  File "/home/frappe/frappe-bench/apps/frappe/frappe/database.py", line 257, in check_transaction_status
    frappe.throw(_("Too many writes in one request. Please send smaller requests"), frappe.ValidationError)
  File "/home/frappe/frappe-bench/apps/frappe/frappe/__init__.py", line 323, in throw
    msgprint(msg, raise_exception=exc, title=title, indicator='red')
  File "/home/frappe/frappe-bench/apps/frappe/frappe/__init__.py", line 309, in msgprint
    _raise_exception()
  File "/home/frappe/frappe-bench/apps/frappe/frappe/__init__.py", line 282, in _raise_exception
    raise raise_exception(encode(msg))
ValidationError: Too many writes in one request. Please send smaller requests

hi @JasonBrowne
How many rows are you trying to import?
@karthikeyan5 We will fix this issue soon.

Keep checking the progress on Re opening Data Import does not move pass in inprogress #12305 as its not resolved · Issue #12315 · frappe/erpnext · GitHub

1 Like

around 30 items. I was able to import from the command line so not sure why the gui failed.

rt Item.csv e@ERPNext-Demo3 frappe-bench) > bench import-csv --submit-after-impor
Inserted row for "Item: MBSD-2016-TICKET-CVDS"Document successfully saved
Inserted row for "Item: MBSD-2016-TICKET-CO"Document successfully saved
Inserted row for "Item: MEM-ATP-16GB- D3-1600-E/R"Document successfully saved
Inserted row for "Item: HBA-TRUENAS- 9207-8I"Document successfully saved
Inserted row for "Item: SSD-ID-32GB- MLC-D150Q"Document successfully saved
Inserted row for "Item: SYS-ES- DSS316IX-DUAL- NODE"Document successfully saved
Inserted row for "Item: CPU-INT-XE- 2.10-15M-V2"Document successfully saved
Inserted row for "Item: TRUENAS-ES- BEZEL"Document successfully saved
Inserted row for "Item: DS-SR"Document successfully saved
Inserted row for "Item: *TRUENAS-Z30-HA/001"Document successfully saved
Inserted row for "Item: HBA-TRUENAS- 9207-8E"Document successfully saved
Inserted row for "Item: MBSD-2016-TICKET-COV"Document successfully saved
Inserted row for "Item: TRUENAS-Z30-HA/001-EXT"Document successfully saved
Inserted row for "Item: MBSD-2016-TICKET-COS"Document successfully saved
Inserted row for "Item: Shiny NVMe"Document successfully saved
Inserted row for "Item: BOM-*TRUENAS-Z30-HA/001-001"Document successfully saved
Inserted row for "Item: *TRUENAS-Z30-HA/001-EXT"Document successfully saved
Inserted row for "Item: Z35-TRUENAS"Document successfully saved
Inserted row for "Item: Z35-Drive"Document successfully saved
Inserted row for "Item: MBSD-2016-TICKET"Document successfully saved
Inserted row for "Item: Z35-CHASSIS"Document successfully saved
Inserted row for "Item: MBSD-2016-TICKET-SD"Document successfully saved
Inserted row for "Item: Registration"Document successfully saved
Inserted row for "Item: FreeBSD 2016 DevSummit - Ticket"Document successfully saved
Inserted row for "Item: PPR 445"Document successfully saved
Inserted row for "Item: *TRUENAS-Z30-HA/001-001 - With Product List"Document successfully saved
Inserted row for "Item: *TRUENAS-Z30-HA-S"Document successfully saved
Inserted row for "Item: SAMPLE"Document successfully saved
Inserted row for "Item: FIRSTBUNDLE"Document successfully saved
Inserted row for "Item: PPR 47"Document successfully saved
Inserted row for "Item: New Bundle"Document successfully saved
Inserted row for "Item: FreeNAS Certified 1U"Document successfully saved
Inserted row for "Item: Registration Dev Summit"Document successfully saved
Inserted row for "Item: RAM Bundle"Document successfully saved
Inserted row for "Item: “*TRUENAS-Z30-HA-D”"Document successfully saved
Inserted row for "Item: *TRUENAS-Z30-HA"Document successfully saved
Inserted row for "Item: *TRUENAS-Z30"Document successfully saved
Inserted row for "Item: *TRUENAS-Z30-HA-D-NEW"Document successfully saved
Inserted row for "Item: *TRUENAS-Z30-HA-DNU"Document successfully saved
(13:41 frappe@ERPNext-Demo3 frappe-bench)

was also able to import my coa via the command line so i am pretty sure it the gui:
ales_Taxes_and_Charges_Template.csv package.json
(17:00 frappe@ERPNext-Demo3 frappe-bench) > bench import-csv Account.csv
Error for row "20000 - Liabilities - iX"Root cannot be edited.
Updated row for "Account: 21000 - Current Liabilities - iX"Document successfully updated
Updated row for "Account: 23000 - Payroll Deductions & Liabilities - iX"Document successfully updated
Updated row for "Account: 23100 - Payroll Employer Taxes - iX"Document successfully updated
Updated row for "Account: 23110 - Payroll Taxes - Federal - iX"Document successfully updated
Updated row for "Account: 23112 - Payroll Taxes - Foreign - iX"Document successfully updated
Updated row for "Account: 23111 - Payroll Taxes - State - iX"Document successfully updated
Updated row for "Account: 23200 - Employee Payroll Taxes - iX"Document successfully updated
Updated row for "Account: 23230 - Employee - State - iX"Document successfully updated
Updated row for "Account: 23240 - Employee - Foreign - iX"Document successfully updated
Updated row for "Account: 23220 - Employee - Local - iX"Document successfully updated
Updated row for "Account: 23250 - Employee - Other taxes withheld - iX"Document successfully up

hey manas,
I find that the below issue has been closed on GitHub:
https://github.com/frappe/erpnext/issues/12315

Is the above error resolved? is there another GitHub issue tracking this?

the above error is not related to “rescheduler fix” mentioned there.

thanks.

Hi @karthikeyan5
Those issues are related to the scheduler while the one which you are talking about is different. Please open a new GitHub issue along with the error trace. (which you have commented here)
Thank you

Hello Everyone,

Kindly provide info as I am also stuck with the same problem of importing data.

Installed Apps

Erpnext: v10.1.14

Frappe Framework: v10.1.21