ScatterND Plugin not found while converting onnx into tensorrt model

[sunilpankaj]

Able to convert pytorch model into onnx and validated onnx output with pytorch. it's working fine. But when I try to convert onnx into tensorrt engine, it fails at onnx parser and return this error.

[TensorRT] ERROR: INVALID_ARGUMENT: getPluginCreator could not find plugin ScatterND version 1

Onnx version : 1.6.0
Tensorrt version : 7.1.3.4

Can anyone please help here, how can I add ScatterND plugin in python and how can I use it ? Is there any other way to solve this problem ?

Thanks in advance.

[Jacoobr]

Hi, sunilpankaj. Maybe you should register the ScatterND in builtin_op_importers. The builtin_op_importers write the logical operations that tensorrt called when onnx-tensorrt try to convert onnx model to trt engine. BTY, you also can implement the ScatterND with plugin manner, like plugin. Last but not least, DEFINE_BUILTIN_OP_IMPORTER(ScatterND){} is must if you want the onnx-tensorrt parse you own ScatterND operation. Hope this can help U~.

[zldrobit]

I encountered the same problem as OP.
I use trtexec tool for converting onnx to TensorRT model.
I notice that there's no ScatterND plugin in TensorRT.

[ttyio]

Hello @sunilpankaj @zldrobit
Sorry there is no support for ScatterND yet. You can follow @Jacoobr 's suggestion to implement your own plugin and register in ONNX parser. thanks!

[ajaichemmanam]

@ttyio @Jacoobr
Can you give a sample scatterND plugin implementation? and how to use it?

[GrainsofSalt]

I am having the same issue. @Jacoobr @ttyio Is there any sample documentation for implementing a plugin like this?

[alicera]

I also meet the [TensorRT] ERROR: INVALID_ARGUMENT: getPluginCreator could not find plugin ScatterND version 1

[mfoglio]

Same here

[PhilCuriosity]

嗨，sunilpankaj。也许你应该登记在ScatterND builtin_op_importers。Builtin_op_importers编写了在onnx-tensorrt尝试将onnx模型转换为trt引擎时tensorrt调用的逻辑操作。顺便说一句，您还可以通过plugin方式实现ScatterND，例如plugin。最后但并非最不重要的一点是，如果您希望onnx-tensorrt解析自己的ScatterND操作，则必须DEFINE_BUILTIN_OP_IMPORTER（ScatterND）{}。希望这对你有帮助。

能提供一份实例代码嘛，谢谢

[htran170642]

Have you guys converted to tensorrt 7.1x sucessfully? Thanks

[alicera]

If it has the tourial for creating the custom operator, it will be good

[ttyio]

FYI, ScatterND is native op in next TRT release, in about 2 months, thanks

[alicera]

Hi @ttyio
Thanks.
Do you have the tutorial for creating the custom operator?

[ttyio]

Hi @alicera ,
Here is the instanceNormalization sample:
plugin: https://github.com/NVIDIA/TensorRT/tree/master/plugin/instanceNormalizationPlugin
parser: https://github.com/onnx/onnx-tensorrt/blob/7d4f86d540738be76da0fe41bed401f4ce67614c/builtin_op_importers.cpp#L2106

[alicera]

Hi @ttyio
Thanks.
By the way, how to check the tensorRT version for my os?

[ttyio]

Hi @alicera
For python

  >>> import tensorrt
  >>> print(tensorrt.__version__)

For C++, you can use getInferLibVersion(), thanks

[alicera]

Hi @ttyio
Does it has the easy command to check the version, like watch nvidia-smi?
Or go to xxx folder to see the info.

[ttyio]

Hi @alicera
Maybe you can search libnvinfer.so in you system and check which file it is link to.

[LukeAI]

@ttyio - so apparently the 21.07 TensorRT container includes the ScatterND plugin. - Do you know if there some way to install this, natively?

[htran170642]

@LukeAI I did build successfully ScatterBN plugin with Tensorrt 7.2.2.3. You just clone the repo with your expected version and copy folder ScatterND in folder plugin then rebuild your tensorrt.

[stardust2602]

@LukeAI I did build successfully ScatterBN plugin with Tensorrt 7.2.2.3. You just clone the repo with your expected version and copy folder ScatterND in folder plugin then rebuild your tensorrt.

Hi, can it work with ScatterElements op ?

[xiangyun-hz]

@htran170642 where the repo?

[nvpohanh]

I think ScatterND is supported as of TRT 8.4 EA. @rajeevsrao could you confirm?

[htran170642]

@htran170642 where the repo?

this repo: https://github.com/NVIDIA/trt-samples-for-hackathon-cn
but you'd better use Tensorrt 8x, it's already supported many plugins like that

[rajeevsrao]

Yes, TensorRT 8.4 EA release has support for ONNX ScatterND Operator.
https://developer.nvidia.com/nvidia-tensorrt-8x-download

@sunilpankaj can you give it try?

[nvpohanh]

Closing for now due to >14 days with no response. Please feel free to reopen if the issue still exists. Thanks

[daxiongpro]

@LukeAI I did build successfully ScatterBN plugin with Tensorrt 7.2.2.3. You just clone the repo with your expected version and copy folder ScatterND in folder plugin then rebuild your tensorrt.

hello, can you make a tutorial for making ScatterND Plugin on TensorRT 7.2.2.3 ? thx very much!