Code

Cherry pick 1.17.3 - Round 2#20178

Code

Merged

tianleiwu merged 4 commits intorel-1.17.3microsoft/onnxruntime:rel-1.17.3from yguo/cherry-pick-1.17.3-round2microsoft/onnxruntime:yguo/cherry-pick-1.17.3-round2Copy head branch name to clipboardApr 3, 2024

+386-91

Commits

Commits on Apr 2, 2024

• Perf improvement for Intel MTL CPUs (#19524)

  Show description for 9bf6302
  

  snnn

  authored and

  rachguo

  committed
  9bf6302

• Add flash attention v2 and INT4 CUDA for LLaMA E2E benchmarking (#20149)

  Show description for 1c4ea87
  

  kunal-vaishnavi

  authored and

  rachguo

  committed
  1c4ea87

Commits on Apr 3, 2024

• #19921 [Dup] LLC Core count calculations updated (#20171)

  Show description for 611a19f
  

  4 peopleauthored and

  rachguo

  committed
  611a19f

• Export of Openai Whisper with batched prompts (#19854)

  Show description for 059e13a
  

  2 peopleauthored and

  rachguo

  committed
  059e13a