Unable to reserve big amount of links

[FreePhoenix888]

How to reproduce

await deep.reserve(5000)

Error

28 | };
29 | var ApolloError =  (function (_super) {
30 |     tslib.__extends(ApolloError, _super);
31 |     function ApolloError(_a) {
32 |         var graphQLErrors = _a.graphQLErrors, protocolErrors = _a.protocolErrors, clientErrors = _a.clientErrors, networkError = _a.networkError, errorMessage = _a.errorMessage, extraInfo = _a.extraInfo;
33 |         var _this = _super.call(this, errorMessage) || this;
                         ^
ApolloError: http exception when calling webhook
      at new ApolloError (/workspace/dev/russian-laws/node_modules/@apollo/client/errors/errors.cjs:33:21)
      at /workspace/dev/russian-laws/node_modules/@apollo/client/core/core.cjs:1427:47
      at both (/workspace/dev/russian-laws/node_modules/@apollo/client/utilities/utilities.cjs:1269:31)
      at /workspace/dev/russian-laws/node_modules/@apollo/client/utilities/utilities.cjs:1260:72
      at new Promise (:1:21)
      at then (/workspace/dev/russian-laws/node_modules/@apollo/client/utilities/utilities.cjs:1260:24)
      at /workspace/dev/russian-laws/node_modules/@apollo/client/utilities/utilities.cjs:1271:36
      at notifySubscription (/workspace/dev/russian-laws/node_modules/zen-observable/lib/Observable.js:135:16)
      at onNotify (/workspace/dev/russian-laws/node_modules/zen-observable/lib/Observable.js:179:3)
      at next (/workspace/dev/russian-laws/node_modules/zen-observable/lib/Observable.js:235:7)
✗ import and export [32138.78ms]

 0 pass
 1 fail
Ran 1 tests across 1 files. [33.29s]

[FreePhoenix888]

Note: I currently work on https://github.com/deep-foundation/russian-laws and have this problem. I guess as workaround I need to call reserve multiple times instead of one. Is this related to timeout? I do not see clear error. Can I change timeout?

[Konard]

@FreePhoenix888 did you created a test in deeplinks repository?

[FreePhoenix888]

@FreePhoenix888 did you created a test in deeplinks repository?

not yet

[FreePhoenix888]

I tried to reserve 20 000 links by calling reserve a lot of times to reserve 500 links. After reserving 500 links four times (totally reserved 2000) I get "http exception when calling webhook"

[Konard]

Workaround 1

Chunk reversed links with less then 500 links.

[FreePhoenix888]

Even if we do it in parallel we still get this error:

async function reserveItemsInBatches({
  totalItems,
  batchSize,
}: {
  totalItems: number;
  batchSize: number;
}) {
  const reservedIds = [];
  const numBatches = Math.ceil(totalItems / batchSize);

  const batchPromises = [];

  for (let i = 0; i < numBatches; i++) {
    const batch = Math.min(batchSize, totalItems - i * batchSize);
    batchPromises.push(deep.reserve(batch));
  }

  const batchResults = await Promise.all(batchPromises);

  batchResults.forEach(reserved => {
    reservedIds.push(...reserved);
    log(`Reserved ${reservedIds.length} / ${totalItems}`);
  });

  return reservedIds;
}

const reservedIds = await reserveItemsInBatches({
  totalItems: linksNumberToReserve,
  batchSize: 100,
});