We recently merged New Data Import into the latest develop branch of frappe.
The goal of the new Data Import was to move away from the rigid template we had before and move to a simpler template format which is more forgiving. It is also supposed to give better warnings to the user so that the task of importing data is simpler than before.
The new template looks something like this:
Features:
Ability to map columns that are not identified automatically manually.
Link field dependencies are automatically created if there is a single mandatory field.
For e.g Item Group while importing Item
If the autoname is based on a field, export only one ID column
For e.g ID and Item Code are the same in Item, so they are merged into one column ID (Item Code) so that the user is not confused
Ignore empty rows and columns in the template
Supported file types: .csv, .xlsx and .xls
Parse 18 different types of date formats automatically
Show a preview of the first 10 rows from the template
Export errored rows into a separate CSV
Child records are identified if the corresponding parent value cells are blank or have the same values as the previous row
Show Data Import Link in timeline if the records were updated using Data Import.
Show estimated time remaining when importing large number of records.
Very nice improvement. just one question, do we have condition based export? like date range etc…
if yes that will be great. in some cases, the data is huge and exporting all data is not possible. condition based export will be great. even if we can add this export through bench command’s will be fine.
I would like to suggest supporting upload one single excel files with multiple sheets each map to one doctype. the import program handles sequence of import accordingly.
@Anthonys if i wanted to update all item i cannot do through the erp system i have number of item group i cannot filter each and every group export it in excel
@Harshal_nirmal What do you mean by update all items ?? update what exactly??
If you want to update too many fields for example
just export all of them from data export , and change what you want to change then from data import tool import back the excel file while selecting update records.
To export via excel for a particular item group, go data export and select item doctype.
In filters select what filters you need you can add multiple filters and export the file.
you selected only one item group , we have lots of item group in item master so if i want to update all group of item master i cannot export it its show 504 error
just 1 take example if i wanted to change default warehouse multiple item group of item . so first i need to filter item group second export ok then update that group of item , here not 1 item group there is no of item group master its not possible to export and update according this case
here we cannot update item in one stoke its unnecessary create duplication of work.
in this earlier v10 we can easily update item master but v11 its not good system friendly medium scale