Code

TensorRT EP - timing cache#14767

Code

Merged

chilo-ms merged 35 commits intomicrosoft:mainmicrosoft/onnxruntime:mainfrom gedoensmax:tensorrt_timing_cachegedoensmax/onnxruntime:tensorrt_timing_cacheCopy head branch name to clipboardMar 10, 2023

+303-18

Commits

Commits on Dec 23, 2021

• add timing cache

  chilo-ms

  committed
  3ba51a2

  Copy full SHA for 3ba51a2

Commits on Jan 6, 2022

• enable timing cache for test

  chilo-ms

  committed
  f905d35

  Copy full SHA for f905d35

Commits on Jan 10, 2022

• Make it only on Linux

  chilo-ms

  committed
  086ba0e

  Copy full SHA for 086ba0e

Commits on Jan 14, 2022

• undo last commit

  chilo-ms

  committed
  191424b

  Copy full SHA for 191424b

• Merge branch 'master' into trt_timing_cache

  chilo-ms

  committed
  d08ea41

  Copy full SHA for d08ea41

• add 'timing_cache_enable' tensorrt provider options

  chilo-ms

  committed
  4fe5a0a

  Copy full SHA for 4fe5a0a

Commits on Jan 15, 2022

• fix bug

  chilo-ms

  committed
  83e251d

  Copy full SHA for 83e251d

• fix bug

  chilo-ms

  committed
  5b52f63

  Copy full SHA for 5b52f63

• revert modification

  chilo-ms

  committed
  4ff502d

  Copy full SHA for 4ff502d

• small modification

  chilo-ms

  committed
  2dd3194

  Copy full SHA for 2dd3194

• remove intrumentation code for recording engine build latency

  chilo-ms

  committed
  8d75a70

  Copy full SHA for 8d75a70

• add timing_cache_enable as additional member of internal TensorRT provider options struct

  chilo-ms

  committed
  58e37fc

  Copy full SHA for 58e37fc

Commits on Jan 17, 2022

• fix warning

  chilo-ms

  committed
  b707c65

  Copy full SHA for b707c65

Commits on Jan 28, 2022

• enable trt timing cache for model tests

  chilo-ms

  committed
  48ecbeb

  Copy full SHA for 48ecbeb

• Merge branch 'master' into trt_timing_cache

  chilo-ms

  committed
  e248193

  Copy full SHA for e248193

Commits on Jan 29, 2022

• enable timing cache for model tests

  chilo-ms

  committed
  9dc0d16

  Copy full SHA for 9dc0d16

• change pool

  chilo-ms

  committed
  0f378b1

  Copy full SHA for 0f378b1

• change back previous pool

  chilo-ms

  committed
  72b7645

  Copy full SHA for 72b7645

Commits on Jan 31, 2022

• change path of trt_timing_cache

  chilo-ms

  committed
  2c5ac28

  Copy full SHA for 2c5ac28

Commits on Feb 4, 2022

• refactor code

  chilo-ms

  committed
  93e61f0

  Copy full SHA for 93e61f0

• Add test cases for timing cache

  chilo-ms

  committed
  c9813c2

  Copy full SHA for c9813c2

• fix bug

  chilo-ms

  committed
  e69723e

  Copy full SHA for e69723e

Commits on Feb 5, 2022

• fix bug for CI

  chilo-ms

  committed
  c371a6d

  Copy full SHA for c371a6d

• Merge branch 'master' into trt_timing_cache

  chilo-ms

  committed
  8da55b5

  Copy full SHA for 8da55b5

• fix bug

  chilo-ms

  committed
  e513740

  Copy full SHA for e513740

• fix bug

  chilo-ms

  committed
  4a45c30

  Copy full SHA for 4a45c30

Commits on Feb 1, 2023

• Merge branch 'trt_timing_cache'

  Show description for be0da22
  gedoensmax

  committed
  be0da22

  Copy full SHA for be0da22

Commits on Feb 8, 2023

• timing cache test

  gedoensmax

  committed
  e38556a

  Copy full SHA for e38556a

Commits on Feb 22, 2023

• append compute capability to cache and add force option

  gedoensmax

  committed
  bf0b880

  Copy full SHA for bf0b880

• Take timing of first warm up inference

  gedoensmax

  committed
  244b437

  Copy full SHA for 244b437

• Merge branch 'main' into tensorrt_timing_cache

  gedoensmax

  committed
  0db18d8

  Copy full SHA for 0db18d8

Commits on Feb 27, 2023

• detailed build log option

  gedoensmax

  committed
  5db55ff

  Copy full SHA for 5db55ff

Commits on Mar 1, 2023

• format changes and adding force timing cache to provider options

  gedoensmax

  committed
  6b0be1d

  Copy full SHA for 6b0be1d

Commits on Mar 6, 2023

• fix pybind OrtTensorRTProviderOptionsV2

  gedoensmax

  committed
  c1c3f71

  Copy full SHA for c1c3f71

Commits on Mar 8, 2023

• reset OrtTensorRTProviderOptions

  gedoensmax

  committed
  b888fc3

  Copy full SHA for b888fc3