Unable to resolve module @aws-sdk/chunked-blob-reader when using S3Client #4631

coofzilla · 2023-04-12T07:49:49Z

Checkboxes for prior research

I've gone through Developer Guide and API reference
I've checked AWS Forums and StackOverflow.
I've searched for previous similar issues and didn't find any solution.

Describe the bug

Xcode 14.2
Build version 14C18

ProductName: macOS
ProductVersion: 13.2.1
BuildVersion: 22D68

I am trying to use the S3Client from the @aws-sdk/client-s3 package in my React Native project, but I am encountering an error related to a missing dependency: @aws-sdk/chunked-blob-reader. Can someone help me resolve this issue or let me know what I'm missing?

Error: Unable to resolve module @aws-sdk/chunked-blob-reader

package.json:

{
  "name": "AmazonExample",
  "version": "0.0.1",
  "private": true,
  "scripts": {
    "android": "react-native run-android",
    "ios": "react-native run-ios",
    "lint": "eslint .",
    "start": "react-native start",
    "test": "jest"
  },
  "dependencies": {
    "react": "18.2.0",
    "react-native": "0.71.6",
    "@aws-sdk/client-cognito-identity": "^3.18.0",
    "@aws-sdk/client-s3": "^3.18.0",
    "@aws-sdk/credential-provider-cognito-identity": "^3.18.0",
    "react-native-get-random-values": "^1.6.0",
    "react-native-url-polyfill": "^1.3.0",
    "uuid": "^3.4.0"
  },
  "devDependencies": {
    "@babel/core": "^7.20.0",
    "@babel/preset-env": "^7.20.0",
    "@babel/runtime": "^7.20.0",
    "@react-native-community/eslint-config": "^3.2.0",
    "@tsconfig/react-native": "^2.0.2",
    "@types/jest": "^29.2.1",
    "@types/react": "^18.0.24",
    "@types/react-test-renderer": "^18.0.0",
    "babel-jest": "^29.2.1",
    "eslint": "^8.19.0",
    "jest": "^29.2.1",
    "metro-react-native-babel-preset": "0.73.9",
    "prettier": "^2.4.1",
    "react-test-renderer": "18.2.0",
    "typescript": "4.8.4"
  },
  "jest": {
    "preset": "react-native"
  }
}

Additionally, I checked that I do have the required dependency.

➜  AmazonExample yarn list --pattern @aws-sdk/chunked-blob-reader
yarn list v1.22.19
└─ @aws-sdk/[email protected]
✨  Done in 0.22s.

yarn list v1.22.19
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
├─ @aws-sdk/[email protected]
└─ @aws-sdk/[email protected]

SDK version number

"@aws-sdk/client-s3": "^3.18.0",

Which JavaScript Runtime is this issue in?

React Native

Details of the browser/Node.js/ReactNative version

node -v v16.19.0, "react-native": "0.71.6"

Reproduction Steps

Steps to reproduce:

Create a new React Native project.

Install the required AWS SDK packages.

    "@aws-sdk/client-cognito-identity": "^3.18.0",
    "@aws-sdk/client-s3": "^3.18.0",
    "@aws-sdk/credential-provider-cognito-identity": "^3.18.0",

Follow the example code provided in the AWS SDK for JavaScript documentation.
https://github.com/awsdocs/aws-doc-sdk-examples/blob/main/javascriptv3/example_code/reactnative/App.js
Run the project and error pops up.

Observed Behavior

When trying to use the S3Client in a React Native project, the application encounters the following error:

Error: Unable to resolve module @aws-sdk/chunked-blob-reader from /path/to/project/node_modules/@aws-sdk/hash-blob-browser/dist-cjs/index.js: @aws-sdk/chunked-blob-reader could not be found within the project or in these directories:
  node_modules
  2 | Object.defineProperty(exports, "__esModule", { value: true });
  3 | exports.blobHasher = void 0;
> 4 | const chunked_blob_reader_1 = require("@aws-sdk/chunked-blob-reader");
    |                                        ^
  5 | const blobHasher = async function blobHasher(hashCtor, blob) {
  6 |     const hash = new hashCtor();
  7 |     await (0, chunked_blob_reader_1.blobReader)(blob, (chunk) => {
    at ModuleResolver.resolveDependency (/path/to/project/node_modules/metro/src/node-haste/DependencyGraph/ModuleResolution.js:162:15)
    at DependencyGraph.resolveDependency (/path/to/project/node_modules/metro/src/node-haste/DependencyGraph.js:260:43)
    at Object.resolve (/path/to/project/node_modules/metro/src/lib/transformHelpers.js:177:21)
    at Graph._resolveDependencies (/path/to/project/node_modules/metro/src/DeltaBundler/Graph.js:432:35)
    at Graph._processModule (/path/to/project/node_modules/metro/src/DeltaBundler/Graph.js:218:38)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async Graph._addDependency (/path/to/project/node_modules/metro/src/DeltaBundler/Graph.js:314:20)
    at async Promise.all (index 16)
    at async Graph._processModule (/path/to/project/node_modules/metro/src/DeltaBundler/Graph.js:263:5)
    at async Graph._addDependency (/path/to/project/node_modules/metro/src/DeltaBundler/Graph.js:314:20)

The error occurs even when following the example repository provided in the AWS documentation:

https://github.com/awsdocs/aws-doc-sdk-examples/blob/main/javascriptv3/example_code/reactnative/App.js

Expected Behavior

I expected the S3Client to be imported and successfully initialized without any Errors. After following the example provided in the AWS documentation, I expected to be able to use the S3Client to upload a blob of video data to an S3 bucket.

Possible Solution

No response

Additional Information/Context

Here is the snippet for my actual use case; however, I was able to observe the error even in a brand new project with no configuration.

const useUploadVideo = () => {
  const { mutate, data, isLoading, isError, isSuccess, reset } = useMutation({
    mutationFn: async ({
      videoUri,
      userKey,
      identityPoolId = "some_ID",
      region = "some_REGION",
      s3Bucket = `some-bucket-name`,
    }: UploadVideoParams) => {
      // Fetch the video file and create a blob
      const response = await fetch(videoUri)
      const blob = await response.blob()

      // Create the S3 key for the video
      const key = `s3.amazonaws.com/somePath/${userKey}/testUpload/`

      // Initialize the S3Client
      // https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/getting-started-react-native.html
      const s3Client = new S3Client({
        region,
        credentials: fromCognitoIdentityPool({
          client: new CognitoIdentityClient({ region }),
          identityPoolId: `${region}:${identityPoolId}`,
        }),
      })

      // Create the PutObjectCommand with the required parameters
      // https://docs.aws.amazon.com/AmazonS3/latest/userguide/upload-objects.html
      const command = new PutObjectCommand({
        Bucket: s3Bucket,
        Key: key,
        Body: blob,
        ContentType: blob.type,
      })

      try {
        // Upload the video to S3
        const s3Result = await s3Client.send(command)
        console.log(s3Result)
        return s3Result
      } catch (err) {
        return console.error(err)
      }
    },
  })

  return { mutate, data, isLoading, isError, isSuccess, reset }
}

The text was updated successfully, but these errors were encountered:

cpyle0819 · 2023-04-12T16:17:13Z

Seeing this in latest: @aws-sdk/client-s3": "^3.310.0"

cpyle0819 · 2023-04-12T16:34:25Z

Looks like for RN it's trying to resolve to @aws-sdk/chunked-blob-reader-native, but that module isn't present.

cpyle0819 · 2023-04-12T18:46:49Z

When I build a package that has a browser entry in package.json, it creates a *.browser module in the outputs.

But when I build a package that has the react-native entry, it doesn't output anything different:

cpyle0819 · 2023-04-12T19:50:36Z

Looks like this was the PR that removed the dep. #4571

coofzilla · 2023-04-12T23:47:20Z

Looks like this was the PR that removed the dep. #4571

I ended up installing these version for now, essentially prior to the removal. And it appears to be working.

"@aws-sdk/client-cognito-identity": "3.298.0",
"@aws-sdk/client-s3": "3.298.0",
"@aws-sdk/credential-provider-cognito-identity": "3.298.0",

Hudson-AmalembaL · 2023-05-15T08:32:00Z

Hello @coofzilla did you manage a solution, bug is still there.

rveramx · 2023-05-18T19:11:52Z

Hello @coofzilla did you manage a solution, bug is still there.

Install @aws-sdk/chunked-blob-reader-native

dpyeates · 2023-07-04T14:17:35Z

Any update on this? Still not able to go any higher than 3.298.0.
Installing @aws-sdk/chunked-blob-reader-native gives me other errors.

RanVaknin · 2023-07-05T23:34:12Z

Hey @cpyle0819,

Thanks for the investigation. I will assign a higher priority for this and try to get this fixed asap.
Ran~

RanVaknin · 2023-07-06T16:26:22Z

Hi @dpyeates @rveramx @Hudson-AmalembaL @coofzilla , @cpyle0819 ,

We just pushed a fix that reintroduces the missing dependency.
Can you please test if this solves your issue?

Thanks 👍 ,
Ran~

kuhe · 2023-07-06T20:20:53Z

The fix is in https://github.com/awslabs/smithy-typescript/releases/tag/%40smithy%2Fhash-blob-browser%401.0.2

When updating, ensure that this package version is being used in any lockfiles you may have. For example, a fresh install of https://github.com/aws/aws-sdk-js-v3/releases/tag/v3.367.0 should bring in the above package.

dpyeates · 2023-07-14T15:54:14Z

Still not working for me.

Using

"@aws-sdk/client-s3": "^3.370.0",
"@aws-sdk/s3-request-presigner": "^3.370.0",

I am getting the following error:

/node_modules/@smithy/util-stream/dist-cjs/getAwsChunkedEncodingStream.js: stream could not be found

cpyle0819 · 2023-07-25T15:52:11Z

@RanVaknin I'm getting the same error as @dpyeates. Happens when running locally.

error: Error: Unable to resolve module stream from /Users/corepyle/Documents/teams/aws-doc-sdk-examples/javascriptv3/node_modules/@smithy/util-stream/dist-cjs/getAwsChunkedEncodingStream.js: stream could not be found within the project or in these directories:
  ../../../node_modules
  2 | Object.defineProperty(exports, "__esModule", { value: true });
  3 | exports.getAwsChunkedEncodingStream = void 0;
> 4 | const stream_1 = require("stream");
    |                           ^
  5 | const getAwsChunkedEncodingStream = (readableStream, options) => {
  6 |     const { base64Encoder, bodyLengthChecker, checksumAlgorithmFn, checksumLocationName, streamHasher } = options;
  7 |     const checksumRequired = base64Encoder !== undefined &&
    at ModuleResolver.resolveDependency (/Users/corepyle/Documents/teams/aws-doc-sdk-examples/javascriptv3/example_code/reactnative/ReactNativeApp/node_modules/metro/src/node-haste/DependencyGraph/ModuleResolution.js:162:15)
    at DependencyGraph.resolveDependency (/Users/corepyle/Documents/teams/aws-doc-sdk-examples/javascriptv3/example_code/reactnative/ReactNativeApp/node_modules/metro/src/node-haste/DependencyGraph.js:260:43)
    at Object.resolve (/Users/corepyle/Documents/teams/aws-doc-sdk-examples/javascriptv3/example_code/reactnative/ReactNativeApp/node_modules/metro/src/lib/transformHelpers.js:177:21)
    at Graph._resolveDependencies (/Users/corepyle/Documents/teams/aws-doc-sdk-examples/javascriptv3/example_code/reactnative/ReactNativeApp/node_modules/metro/src/DeltaBundler/Graph.js:432:35)
    at Graph._processModule (/Users/corepyle/Documents/teams/aws-doc-sdk-examples/javascriptv3/example_code/reactnative/ReactNativeApp/node_modules/metro/src/DeltaBundler/Graph.js:218:38)
    at async Graph._addDependency (/Users/corepyle/Documents/teams/aws-doc-sdk-examples/javascriptv3/example_code/reactnative/ReactNativeApp/node_modules/metro/src/DeltaBundler/Graph.js:314:20)
    at async Promise.all (index 2)
    at async Graph._processModule (/Users/corepyle/Documents/teams/aws-doc-sdk-examples/javascriptv3/example_code/reactnative/ReactNativeApp/node_modules/metro/src/DeltaBundler/Graph.js:263:5)
    at async Graph._addDependency (/Users/corepyle/Documents/teams/aws-doc-sdk-examples/javascriptv3/example_code/reactnative/ReactNativeApp/node_modules/metro/src/DeltaBundler/Graph.js:314:20)
    at async Promise.all (index 1)
    ```

This updates the @AWS-SDK packages to fix a bug (aws/aws-sdk-js-v3#4631). Unfortunately, another issue has popped up after these updates. I commented on the above ticket my findings. As a result, this example is still broken.

This updates the @AWS-SDK packages to fix a bug (aws/aws-sdk-js-v3#4631).

github-actions · 2023-08-09T00:03:27Z

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs and link to relevant comments in this thread.

coofzilla added bug This issue is a bug. needs-triage This issue or PR still needs to be triaged. labels Apr 12, 2023

yenfryherrerafeliz added investigating Issue is being investigated and/or work is in progress to resolve the issue. and removed needs-triage This issue or PR still needs to be triaged. labels Apr 12, 2023

cpyle0819 mentioned this issue Apr 13, 2023

ReactNative follow up awsdocs/aws-doc-sdk-examples#4684

Closed

RanVaknin self-assigned this May 22, 2023

RanVaknin added the p2 This is a standard priority issue label May 22, 2023

RanVaknin added needs-review This issue/pr needs review from an internal developer. p1 This is a high priority issue and removed investigating Issue is being investigated and/or work is in progress to resolve the issue. p2 This is a standard priority issue labels Jul 5, 2023

This was referenced Jul 6, 2023

fix(hash-blob-browser): add back missing dep #4932

Merged

Add back missing dependency smithy-lang/smithy-typescript#810

Merged

RanVaknin added response-requested Waiting on additional info and feedback. Will move to \"closing-soon\" in 7 days. and removed needs-review This issue/pr needs review from an internal developer. labels Jul 6, 2023

github-actions bot removed the response-requested Waiting on additional info and feedback. Will move to \"closing-soon\" in 7 days. label Jul 7, 2023

RanVaknin closed this as completed Jul 13, 2023

cpyle0819 mentioned this issue Jul 25, 2023

JavaScript (v3): Update ReactNativeApp dependencies. awsdocs/aws-doc-sdk-examples#5157

Merged

beqqrry-aws pushed a commit to awsdocs/aws-doc-sdk-examples that referenced this issue Jul 31, 2023

JavaScript (v3): Update ReactNativeApp dependencies. (#5157)

9d95657

This updates the @AWS-SDK packages to fix a bug (aws/aws-sdk-js-v3#4631).

shepazon pushed a commit to shepazon/aws-doc-sdk-examples that referenced this issue Aug 7, 2023

JavaScript (v3): Update ReactNativeApp dependencies. (awsdocs#5157)

d9e1e19

This updates the @AWS-SDK packages to fix a bug (aws/aws-sdk-js-v3#4631).

github-actions bot locked as resolved and limited conversation to collaborators Aug 9, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Unable to resolve module @aws-sdk/chunked-blob-reader when using S3Client #4631

Unable to resolve module @aws-sdk/chunked-blob-reader when using S3Client #4631

coofzilla commented Apr 12, 2023 •

edited

Loading

cpyle0819 commented Apr 12, 2023

cpyle0819 commented Apr 12, 2023

cpyle0819 commented Apr 12, 2023

cpyle0819 commented Apr 12, 2023

coofzilla commented Apr 12, 2023

Hudson-AmalembaL commented May 15, 2023

rveramx commented May 18, 2023

dpyeates commented Jul 4, 2023 •

edited

Loading

RanVaknin commented Jul 5, 2023

RanVaknin commented Jul 6, 2023

kuhe commented Jul 6, 2023 •

edited

Loading

dpyeates commented Jul 14, 2023 •

edited

Loading

cpyle0819 commented Jul 25, 2023 •

edited

Loading

github-actions bot commented Aug 9, 2023

Unable to resolve module @aws-sdk/chunked-blob-reader when using S3Client #4631

Unable to resolve module @aws-sdk/chunked-blob-reader when using S3Client #4631

Comments

coofzilla commented Apr 12, 2023 • edited Loading

Checkboxes for prior research

Describe the bug

SDK version number

Which JavaScript Runtime is this issue in?

Details of the browser/Node.js/ReactNative version

Reproduction Steps

Observed Behavior

Expected Behavior

Possible Solution

Additional Information/Context

cpyle0819 commented Apr 12, 2023

cpyle0819 commented Apr 12, 2023

cpyle0819 commented Apr 12, 2023

cpyle0819 commented Apr 12, 2023

coofzilla commented Apr 12, 2023

Hudson-AmalembaL commented May 15, 2023

rveramx commented May 18, 2023

dpyeates commented Jul 4, 2023 • edited Loading

RanVaknin commented Jul 5, 2023

RanVaknin commented Jul 6, 2023

kuhe commented Jul 6, 2023 • edited Loading

dpyeates commented Jul 14, 2023 • edited Loading

cpyle0819 commented Jul 25, 2023 • edited Loading

github-actions bot commented Aug 9, 2023

coofzilla commented Apr 12, 2023 •

edited

Loading

dpyeates commented Jul 4, 2023 •

edited

Loading

kuhe commented Jul 6, 2023 •

edited

Loading

dpyeates commented Jul 14, 2023 •

edited

Loading

cpyle0819 commented Jul 25, 2023 •

edited

Loading