SonicTriton fails to link in UBSAN builds

[makortel]

  /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x318): undefined reference to `typeinfo for inference::ModelStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x458): undefined reference to `typeinfo for inference::ModelStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x8d8): undefined reference to `typeinfo for inference::ModelStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x918): undefined reference to `typeinfo for inference::ModelStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x9d8): undefined reference to `typeinfo for inference::ModelStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0xa18): more undefined references to `typeinfo for inference::ModelStatistics' follow
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x1058): undefined reference to `typeinfo for inference::ModelStatisticsResponse'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x1098): undefined reference to `typeinfo for inference::ModelStatisticsResponse'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x10d8): undefined reference to `typeinfo for inference::ModelStatisticsResponse'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x1158): undefined reference to `typeinfo for inference::ModelStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x11d8): undefined reference to `typeinfo for nvidia::inferenceserver::client::InferenceServerGrpcClient'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x1218): undefined reference to `typeinfo for inference::ModelConfigResponse'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x1258): undefined reference to `typeinfo for inference::ModelConfig'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x1298): undefined reference to `typeinfo for inference::ModelMetadataResponse'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x1418): undefined reference to `typeinfo for inference::ModelConfigResponse'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x1458): undefined reference to `typeinfo for inference::ModelConfig'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x1498): undefined reference to `typeinfo for inference::ModelMetadataResponse'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x21d8): undefined reference to `typeinfo for inference::ModelMetadataResponse_TensorMetadata'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x22d8): undefined reference to `typeinfo for inference::ModelMetadataResponse_TensorMetadata'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x29d8): undefined reference to `typeinfo for inference::ModelMetadataResponse'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x2a58): undefined reference to `typeinfo for inference::ModelConfig'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x2a98): undefined reference to `typeinfo for inference::ModelConfigResponse'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x5c18): undefined reference to `typeinfo for nvidia::inferenceserver::client::InferenceServerGrpcClient'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x5d58): undefined reference to `typeinfo for nvidia::inferenceserver::client::InferenceServerGrpcClient'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x5e98): undefined reference to `typeinfo for nvidia::inferenceserver::client::InferenceServerGrpcClient'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x5fd8): undefined reference to `typeinfo for nvidia::inferenceserver::client::InferenceServerGrpcClient'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x6618): undefined reference to `typeinfo for inference::StatisticDuration'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x6658): undefined reference to `typeinfo for inference::StatisticDuration'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x6698): undefined reference to `typeinfo for inference::StatisticDuration'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x66d8): undefined reference to `typeinfo for inference::StatisticDuration'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x6718): undefined reference to `typeinfo for inference::StatisticDuration'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x6758): more undefined references to `typeinfo for inference::StatisticDuration' follow
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x6858): undefined reference to `typeinfo for inference::InferStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x6898): undefined reference to `typeinfo for inference::StatisticDuration'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x68d8): undefined reference to `typeinfo for inference::InferStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x6918): undefined reference to `typeinfo for inference::ModelStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonClient.cc.o:(.data.rel+0x6958): undefined reference to `typeinfo for inference::ModelStatistics'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonData.cc.o:(.data.rel+0x1d8): undefined reference to `typeinfo for inference::ModelMetadataResponse_TensorMetadata'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonData.cc.o:(.data.rel+0x218): undefined reference to `typeinfo for inference::ModelMetadataResponse_TensorMetadata'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonData.cc.o:(.data.rel+0x418): undefined reference to `typeinfo for inference::ModelMetadataResponse_TensorMetadata'
   /data/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc900/external/gcc/9.3.0/bin/../lib/gcc/x86_64-unknown-linux-gnu/9.3.0/../../../../x86_64-unknown-linux-gnu/bin/ld: tmp/slc7_amd64_gcc900/src/HeterogeneousCore/SonicTriton/src/HeterogeneousCoreSonicTriton/TritonData.cc.o:(.data.rel+0x458): undefined reference to `typeinfo for inference::ModelMetadataResponse_TensorMetadata'

https://cmssdt.cern.ch/SDT/cgi-bin/buildlogs/slc7_amd64_gcc900/CMSSW_11_3_UBSAN_X_2021-01-08-2300/HeterogeneousCore/SonicTriton

UBSAN build needs to link directly to the libraries that define the above mentioned types (because of it using dynamic_cast).

[cmsbuild]

A new Issue was created by @makortel Matti Kortelainen.

@Dr15Jones, @dpiparo, @silviodonato, @smuzaffar, @makortel, @qliphy can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

[makortel]

assign core, heterogeneous

[makortel]

@kpedro88 Could you take a look?

[cmsbuild]

New categories assigned: heterogeneous,core

@Dr15Jones,@smuzaffar,@makortel,@makortel,@fwyzard you have been requested to review this Pull request/Issue and eventually sign? Thanks

[kpedro88]

If I run this command: nm -C -D /cvmfs/cms.cern.ch/slc7_amd64_gcc900/external/triton-inference-server/2.3.0-ghbfee3/lib/libgrpcclient.so

the only typeinfo lines are:

                 U typeinfo for google::protobuf::MessageLite
                 U typeinfo for google::protobuf::io::ZeroCopyOutputStream
                 U typeinfo for google::protobuf::Message
                 U typeinfo for google::protobuf::internal::MapFieldBase
                 U typeinfo for std::thread::_State
                 U typeinfo for unsigned char

I'm not sure if or why RTTI would have been disabled when compiling Triton... I can't immediately find a setting that would be responsible for this.

[kpedro88]

See: cms-sw/cmsdist#6547

[kpedro88]

@makortel I no longer see the errors in the build log for CMSSW_11_3_UBSAN_X_2021-01-12-2300, so I think this fix was successful.

[makortel]

Which is interesting given that cms-sw/cmsdist#6547 was merged only in CMSSW_11_3_X_2021-01-13-1100. Not sure why the failure disappeared earlier :)

[makortel]

+1

[cmsbuild]

This issue is fully signed and ready to be closed.

[kpedro88]

@makortel if you click on the "CMSDIST" tab in the "Commits" section of https://cmssdt.cern.ch/SDT/html/cmssdt-ib/#/ib/CMSSW_11_3_X for that IB, you can select the UBSAN version of cmsdist, which does include my PR.

[makortel]

Ah right, and it went into the default IBs one cycle later. Thanks!