Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failure of TensorRT 8.2 when running fp16 model on GPU Tesla T4 #3726

Closed
yflv-yanxia opened this issue Mar 21, 2024 · 2 comments
Closed

failure of TensorRT 8.2 when running fp16 model on GPU Tesla T4 #3726

yflv-yanxia opened this issue Mar 21, 2024 · 2 comments
Assignees
Labels
triaged Issue has been triaged by maintainers

Comments

@yflv-yanxia
Copy link

Description

We recently converted a model similar to NAFNet into a TensorRT model, but we encountered two issues:

  1. The fp16 model's inference results are incorrect while the inference results of the fp32 model are correct.
  2. The fp32 model occupies a large amount of storage space, more than 80 times that of the original ONNX model.
    The first issue is more urgent, and we hope you can assist us in resolving it. Thank you!

Environment

TensorRT Version: 8.2.2.1

NVIDIA GPU:Tesla T4

NVIDIA Driver Version:450.36.06

CUDA Version:11.0

CUDNN Version:8.0.0

Relevant Files

onnx model
test image
correct result image
incorrect result image
inference code of onnx

Steps To Reproduce

Run inference code of onnx, you could get the correct result image.
Then convert the onnx model into tensorrt fp32/fp16 model, inference this two models get the results.

@zerollzeng
Copy link
Collaborator

8.2 is really old(and we don't fix bug on old release unless really necessary), could you please try latest version?

BTW TRT 10 will be released very soon.

@zerollzeng zerollzeng self-assigned this Mar 23, 2024
@zerollzeng zerollzeng added the triaged Issue has been triaged by maintainers label Mar 23, 2024
@ttyio
Copy link
Collaborator

ttyio commented Apr 16, 2024

closing since no activity for more than 3 weeks, thanks all!

@ttyio ttyio closed this as completed Apr 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
triaged Issue has been triaged by maintainers
Projects
None yet
Development

No branches or pull requests

3 participants