Data Import Tool only imports data in one RQ Worker

Hi everyone,

I recently use the Data Import Tool.

I imported a file contain 100k rows.

I expected the task will be spawn to multiple RQ workers, so that it can speed up the import process.

But seems like only 1 worker was used. You can see the image below.

Is this the designed behavior, or I have to change something to make it work as I expect?

HI,

I think it would be a good idea to chunk the data and try to enqueue it several times.

for example,

CleanShot 2024-04-16 at 16.21.19

This is my code.
If you enqueue multiple times, it seems like it will be divided into multiple queues. I don’t know exactly, but I hope you test it.

1 Like