Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unable to do tensorrt inference #176

Open
riyaj8888 opened this issue Jul 12, 2023 · 0 comments
Open

unable to do tensorrt inference #176

riyaj8888 opened this issue Jul 12, 2023 · 0 comments

Comments

@riyaj8888
Copy link

riyaj8888 commented Jul 12, 2023

i am following this tutorial https://els-rd.github.io/transformer-deploy/python/

but unable to run it . below is error
during build_engine i am getting follwoing error
[07/12/2023-10:46:47] [TRT] [E] 3: [builderConfig.cpp::validatePool::334] Error Code 3: API Usage Error (Parameter check failed at: optimizer/api/builderConfig.cpp::validatePool::334, condition: false. Setting DLA memory pool size on TensorRT build with DLA disabled. ) [libprotobuf WARNING google/protobuf/io/coded_stream.cc:604] Reading dangerously large protocol message. If the message turns out to be larger than 2147483647 bytes, parsing will be halted for security reasons. To increase the limit (or to disable these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h. [libprotobuf WARNING google/protobuf/io/coded_stream.cc:81] The total number of bytes read was 1110085751

during doing inference i am getting output as well as following error is printed

[07/12/2023-10:53:32] [TRT] [E] 3: [executionContext.cpp::validateInputBindings::1839] Error Code 3: API Usage Error (Parameter check failed at: runtime/api/executionContext.cpp::validateInputBindings::1839, condition: profileMinDims.d[i] <= dimensions.d[i]. Supplied binding dimension [1,8] for bindings[0] exceed min ~ max range at index 1, maximum dimension in profile is 512, minimum dimension in profile is 512, but supplied dimension is 8. ) [07/12/2023-10:53:32] [TRT] [E] 3: [executionContext.cpp::validateInputBindings::1839] Error Code 3: API Usage Error (Parameter check failed at: runtime/api/executionContext.cpp::validateInputBindings::1839, condition: profileMinDims.d[i] <= dimensions.d[i]. Supplied binding dimension [1,8] for bindings[1] exceed min ~ max range at index 1, maximum dimension in profile is 512, minimum dimension in profile is 512, but supplied dimension is 8. )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant