Skip to content

Commit

Permalink
Bump goldentime values for mi250 sdxl benchmarks. (#17860)
Browse files Browse the repository at this point in the history
Seeing some variance causing CI failures with unrelated changes:
*
https://github.com/iree-org/iree/actions/runs/9879301822/job/27286342282#step:15:46
  * `VAE Decode Benchmark Time: 295.0 ms (golden time 291.0 ms)`
  * `Prompt Encoder Benchmark Time: 17.2 ms (golden time 17.0 ms)`
*
https://github.com/iree-org/iree/actions/runs/9877397187/job/27279465007
  * `VAE Decode Benchmark Time: 295.0 ms (golden time 291.0 ms)`
  * `Prompt Encoder Benchmark Time: 17.1 ms (golden time 17.0 ms)`

Aside: we might want to move the benchmarks to a `pkgci_benchmarks.yml`
workflow instead of chaining them on to the end of
`pkgci_regression_test.yml`.

ci-exactly: build_packages,regression_test
  • Loading branch information
ScottTodd authored Jul 11, 2024
1 parent f7f930d commit b67fef7
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions .github/workflows/pkgci_regression_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -314,8 +314,8 @@ jobs:
pytest SHARK-TestSuite/iree_tests/benchmarks/sdxl/benchmark_sdxl_rocm.py \
--goldentime-rocm-e2e-ms 1336.0 \
--goldentime-rocm-unet-ms 340.0 \
--goldentime-rocm-clip-ms 17.0 \
--goldentime-rocm-vae-ms 291.0 \
--goldentime-rocm-clip-ms 17.5 \
--goldentime-rocm-vae-ms 300.0 \
--goldendispatch-rocm-unet 1714 \
--goldendispatch-rocm-clip 1569 \
--goldendispatch-rocm-vae 248 \
Expand Down

0 comments on commit b67fef7

Please sign in to comment.