Process items in batches similar to better-queue.

[tbreeding]

I saw some other closed issue on batching, but it didn't seem to related directly to this.

Basically, the better queue implementation is that it takes in individual items, but passes them to the process function in an array, but then outputs the results individually in the original order.

https://www.npmjs.com/package/better-queue#batch-processing

What are your thoughts on implementing something like this?

The use case is where it's more efficient to make a call to an API with multiple items than it is with each individual items.

Queue.push('1')
Queue.push('2')
Queue.push('3')

function (userIds: string[]) {
    const response = await request.post('/users/likes', { users_ids: userIds })
    // POST /users/likes` `{ user_ids: ['1', '2', '3']` <= Response `{ 1: { likes: 5 }, 2: { likes: 3 }, 3: { likes: 12 } }
   const likes = []
   for (const id of userIds) likes.push(response.body[id])

   return likes
}

This saves API calls and carries (typically) an overall speed benefit as making one request with multiple entries takes less total time than each call made individually.

[mcollina]

This would be a really nice feature to add. It's similar to _writev() in Node.js streams.

How would you implement it?

[tbreeding]

I need to take a look into. Sorry. Busy busy.

[beautyfree]

It's a pity that this hasn't been done yet, I was looking for such an opportunity