Code

Multi head attention#22143

Code

Closed

xhcao wants to merge 83 commits intomicrosoft:mainmicrosoft/onnxruntime:mainfrom xhcao:multi_head_attentionxhcao/onnxruntime:multi_head_attentionCopy head branch name to clipboard

+8,622-55

Commits

Commits on Aug 28, 2024

• [WIP] WebGPU EP initial commit

  fs-eire

  committed
  4037bd4

  Copy full SHA for 4037bd4

• update C-API

  fs-eire

  committed
  9c36250

  Copy full SHA for 9c36250

• fix build break

  fs-eire

  committed
  3a0756d

  Copy full SHA for 3a0756d

• add an empty symbols.txt file

  fs-eire

  committed
  5199e98

  Copy full SHA for 5199e98

Commits on Aug 29, 2024

• fix an error in doc

  fs-eire

  committed
  1c68dbd

  Copy full SHA for 1c68dbd

• remove string_join.h in favor of absl::StrJoin

  fs-eire

  committed
  7db03de

  Copy full SHA for 7db03de

• fix DLL copy

  fs-eire

  committed
  6a373c2

  Copy full SHA for 6a373c2

• update doc: require --skip_tests

  fs-eire

  committed
  ee42bba

  Copy full SHA for ee42bba

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  5fac202

  Copy full SHA for 5fac202

• update dawn version

  fs-eire

  committed
  3f46e5c

  Copy full SHA for 3f46e5c

• disable Tint tests

  fs-eire

  committed
  9f61279

  Copy full SHA for 9f61279

• fix one build break in Linux

  fs-eire

  committed
  6bb6335

  Copy full SHA for 6bb6335

Commits on Aug 30, 2024

• remove unused variables

  fs-eire

  committed
  d839dbc

  Copy full SHA for d839dbc

• make webgpu build on linux and known to most tools (microsoft#21937)

  Show description for b70943d
  

  guschmue

  and

  fs-eire

  authored
  b70943d

  Copy full SHA for b70943d

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  c33ac2e

  Copy full SHA for c33ac2e

• revert type of ShaderVariable::rank_ to int

  fs-eire

  committed
  8437267

  Copy full SHA for 8437267

• output Impl() for variables

  fs-eire

  committed
  3caf032

  Copy full SHA for 3caf032

• code formatting

  fs-eire

  committed
  84494c4

  Copy full SHA for 84494c4

• better format of Uniform

  fs-eire

  committed
  aa70163

  Copy full SHA for aa70163

• revise document

  fs-eire

  committed
  d772db7

  Copy full SHA for d772db7

Commits on Aug 31, 2024

• more build fix for linux

  fs-eire

  committed
  6ef3dad

  Copy full SHA for 6ef3dad

• apply formatter

  fs-eire

  committed
  a56f6c3

  Copy full SHA for a56f6c3

• simple test runner

  fs-eire

  committed
  12cd79d

  Copy full SHA for 12cd79d

• Program macros update - allow extend

  fs-eire

  committed
  14c8966

  Copy full SHA for 14c8966

Commits on Sep 1, 2024

• fix BucketCacheManager

  fs-eire

  committed
  4fff35f

  Copy full SHA for 4fff35f

• add a method to get logger from ComputeContext

  fs-eire

  committed
  4fd8ad1

  Copy full SHA for 4fd8ad1

• add verbose log for cache key

  fs-eire

  committed
  3bd92ad

  Copy full SHA for 3bd92ad

• revise suite test

  fs-eire

  committed
  6a1bbfe

  Copy full SHA for 6a1bbfe

• device lost handler

  fs-eire

  committed
  947aee1

  Copy full SHA for 947aee1

• add '-a' and '-t' to test runner

  fs-eire

  committed
  99b2578

  Copy full SHA for 99b2578

• atol/rtol 0.0001 -> 0.001

  fs-eire

  committed
  aa7b3f5

  Copy full SHA for aa7b3f5

Commits on Sep 2, 2024

• Fix uniform

  fs-eire

  committed
  e659acd

  Copy full SHA for e659acd

• add some unary ops

  fs-eire

  committed
  6ad89c5

  Copy full SHA for 6ad89c5

• various of fixes

  fs-eire

  committed
  8361fc3

  Copy full SHA for 8361fc3

Commits on Sep 3, 2024

• fix workgroup_size, cache key stringnify and indices type

  fs-eire

  committed
  c89159d

  Copy full SHA for c89159d

• shape_uniforms preparation

  fs-eire

  committed
  5ea5936

  Copy full SHA for 5ea5936

• allow uniforms of input/output shape/stride being added automatically

  fs-eire

  committed
  7d83054

  Copy full SHA for 7d83054

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  7a64cc7

  Copy full SHA for 7a64cc7

• fix build (linux)

  fs-eire

  committed
  1d53ac8

  Copy full SHA for 1d53ac8

• fix stride

  fs-eire

  committed
  4d52602

  Copy full SHA for 4d52602

• fix "{res_name}_bi2o_{name}"

  fs-eire

  committed
  3761aad

  Copy full SHA for 3761aad

• Add Expand operator (microsoft#21933)

  Show description for 351da84
  qjia7

  authored
  351da84

  Copy full SHA for 351da84

• support onnxruntime_test_all

  fs-eire

  committed
  0b7ce77

  Copy full SHA for 0b7ce77

• reflect change in WebGpuProviderFactoryCreator::Create signature (microsoft#21971)

  Show description for 33726b1
  guschmue

  authored
  33726b1

  Copy full SHA for 33726b1

• compare the content of WEBGPU_BUFFER, not the address (microsoft#21967)

  Show description for 50ea9eb
  guschmue

  authored
  50ea9eb

  Copy full SHA for 50ea9eb

• fix tanh

  fs-eire

  committed
  d6f6148

  Copy full SHA for d6f6148

Commits on Sep 4, 2024

• support size==0 for element wise operators

  fs-eire

  committed
  626edaf

  Copy full SHA for 626edaf

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  8913da1

  Copy full SHA for 8913da1

• use shared ComputeBroadcastOutputShape()

  fs-eire

  committed
  bacc54c

  Copy full SHA for bacc54c

• add workgroup_idx

  fs-eire

  committed
  7ecc5bb

  Copy full SHA for 7ecc5bb

• expose name for shader variable

  fs-eire

  committed
  ae836b1

  Copy full SHA for ae836b1

Commits on Sep 5, 2024

• add uniform for 1D variable

  fs-eire

  committed
  243078b

  Copy full SHA for 243078b

• fix GetElementAt with uniform

  fs-eire

  committed
  4d48d28

  Copy full SHA for 4d48d28

• document update folder

  fs-eire

  committed
  dbe673b

  Copy full SHA for dbe673b

• fix adapter/device creating: add toggles

  fs-eire

  committed
  38f182e

  Copy full SHA for 38f182e

Commits on Sep 6, 2024

• more strict shape&stride usage check

  fs-eire

  committed
  eb80f7c

  Copy full SHA for eb80f7c

• fix vector realloc

  fs-eire

  committed
  39d5509

  Copy full SHA for 39d5509

• simplify cache hint interface.

  fs-eire

  committed
  cd961c3

  Copy full SHA for cd961c3

• revise expand

  fs-eire

  committed
  ddc2fbb

  Copy full SHA for ddc2fbb

• revise unary

  fs-eire

  committed
  e8be835

  Copy full SHA for e8be835

• Elu/Relu/LeakyRelu/ThresholdedRelu/Gelu

  fs-eire

  committed
  bd7d592

  Copy full SHA for bd7d592

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  eecac18

  Copy full SHA for eecac18

• remove unused field in class Gelu

  fs-eire

  committed
  601e50f

  Copy full SHA for 601e50f

• remove out-of-dated comments

  fs-eire

  committed
  8f36da2

  Copy full SHA for 8f36da2

Commits on Sep 7, 2024

• Clip

  fs-eire

  committed
  72ebd85

  Copy full SHA for 72ebd85

• fix rank in shader helper

  fs-eire

  committed
  a3244ae

  Copy full SHA for a3244ae

Commits on Sep 9, 2024

• fix shader variable

  fs-eire

  committed
  5a2ae8c

  Copy full SHA for 5a2ae8c

• move components number from variable to program

  fs-eire

  committed
  aa54ff8

  Copy full SHA for aa54ff8

• mark components in cache key

  fs-eire

  committed
  969384d

  Copy full SHA for 969384d

Commits on Sep 10, 2024

• Add FastGelu op (microsoft#21991)

  Show description for 6b82486
  

  qjia7

  and

  fs-eire

  authored
  6b82486

  Copy full SHA for 6b82486

• use 'set/add' as prefix for some functions

  fs-eire

  committed
  2b3e7c2

  Copy full SHA for 2b3e7c2

• remove unnecessary cache hint for FastGelu

  fs-eire

  committed
  ef0d53b

  Copy full SHA for ef0d53b

• revise unary - expose consts in header

  fs-eire

  committed
  c4ca47f

  Copy full SHA for c4ca47f

• use path for header file

  fs-eire

  committed
  8806d57

  Copy full SHA for 8806d57

Commits on Sep 11, 2024

• a few revises to the code (microsoft#22047)

  fs-eire

  committed
  0568e2b

  Copy full SHA for 0568e2b

• use OrtMutex

  fs-eire

  committed
  b7a9c0e

  Copy full SHA for b7a9c0e

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  f65ade9

  Copy full SHA for f65ade9

• [webgpu-native] Add transpose op (microsoft#21986)

  Show description for d4a963d
  

  axinging

  and

  fs-eire

  authored
  d4a963d

  Copy full SHA for d4a963d

• PushErrorScope and PopErrorScope

  fs-eire

  committed
  8b61532

  Copy full SHA for 8b61532

Commits on Sep 12, 2024

• placeholder for setting proc table

  fs-eire

  committed
  dce0f18

  Copy full SHA for dce0f18

• Revert "placeholder for setting proc table"

  Show description for 8978d89
  fs-eire

  committed
  8978d89

  Copy full SHA for 8978d89

• allow setting "ValidationMode"

  fs-eire

  committed
  43ccaf4

  Copy full SHA for 43ccaf4

Commits on Sep 19, 2024

• webgpu: support MultiHeadAttention operator

  xhcao

  committed
  409ac5c

  Copy full SHA for 409ac5c