Code

Implement PReLU backward#3152

Code

Merged

junliume merged 79 commits intodevelopROCm/MIOpen:developfrom impl_PReLUROCm/MIOpen:impl_PReLUCopy head branch name to clipboardAug 21, 2024

+2,532-3

Commits

Commits on Jun 4, 2024

• added PReLU api skeleton code

  long10024070

  committed
  f77ec05

  Copy full SHA for f77ec05

Commits on Jun 6, 2024

• impl PReLU with GTest

  long10024070

  committed
  101c4ad

  Copy full SHA for 101c4ad

Commits on Jun 7, 2024

• added Driver for PReLU

  long10024070

  committed
  120bacc

  Copy full SHA for 120bacc

• make PReLU benchmark more stable

  long10024070

  committed
  b3d7d2d

  Copy full SHA for b3d7d2d

Commits on Jun 12, 2024

• relocated prelu.hpp

  long10024070

  committed
  c37b08a

  Copy full SHA for c37b08a

• removed uneccesary #include

  long10024070

  committed
  4d4c8f6

  Copy full SHA for 4d4c8f6

• added more requirement to IsApplicable and fixed miopen doc comment

  long10024070

  committed
  c4137da

  Copy full SHA for c4137da

• improved perf by balancing computation to threads

  long10024070

  committed
  5a10bdc

  Copy full SHA for 5a10bdc

• used double instead of FLOAT_ACCUM for better precision

  long10024070

  committed
  86c198b

  Copy full SHA for 86c198b

• potential bug fixed: using float instead of T datatype for workspace memory space

  long10024070

  committed
  21148b8

  Copy full SHA for 21148b8

Commits on Jun 13, 2024

• changed ulong to uint64_t

  long10024070

  committed
  19e13f8

  Copy full SHA for 19e13f8

• changed \n to std::endl

  long10024070

  committed
  f466fdb

  Copy full SHA for f466fdb

• used static_cast instead of Type casting

  long10024070

  committed
  a699069

  Copy full SHA for a699069

• Seperated backward_prelu for each solvers

  long10024070

  committed
  70716d2

  Copy full SHA for 70716d2

• added contiguous check for weight and dweight tensor

  long10024070

  committed
  ff851a7

  Copy full SHA for ff851a7

• added static_cast<>

  long10024070

  committed
  582c1a7

  Copy full SHA for 582c1a7

Commits on Jul 23, 2024

• merge brach into impl_PReLU

  long10024070

  committed
  5a5bead

  Copy full SHA for 5a5bead

• up-to-date with branch

  long10024070

  committed
  4baade9

  Copy full SHA for 4baade9

• update tensor_view

  long10024070

  committed
  7a96642

  Copy full SHA for 7a96642

Commits on Jul 24, 2024

• added more data to NetworkConfig str

  long10024070

  committed
  fb7cbea

  Copy full SHA for fb7cbea

• Merge remote-tracking branch 'rocm/develop' into impl_PReLU

  long10024070

  committed
  317e9e8

  Copy full SHA for 317e9e8

• add MIOPEN_INTERNALS_EXPORT

  long10024070

  committed
  eef821a

  Copy full SHA for eef821a

• using int32_t and int64_t in kernels

  long10024070

  committed
  a5860f5

  Copy full SHA for a5860f5

• use half_float::half instead of half in GTtest

  long10024070

  committed
  7da8549

  Copy full SHA for 7da8549

Commits on Jul 25, 2024

• Merge remote-tracking branch 'rocm/develop' into impl_PReLU

  long10024070

  committed
  53cca97

  Copy full SHA for 53cca97

• update GTest runner

  long10024070

  committed
  f4c783a

  Copy full SHA for f4c783a

• try remove unused code in Gtest PReLU

  long10024070

  committed
  67cee9e

  Copy full SHA for 67cee9e

• rollback state

  long10024070

  committed
  61cdc9a

  Copy full SHA for 61cdc9a

• try remove unused code in Gtest PReLU

  long10024070

  committed
  639af57

  Copy full SHA for 639af57

• try remove unused code in Gtest PReLU

  long10024070

  committed
  32b5ce8

  Copy full SHA for 32b5ce8

• rollback state

  long10024070

  committed
  01b4a61

  Copy full SHA for 01b4a61

• shorten check float argument

  long10024070

  committed
  0e0fab0

  Copy full SHA for 0e0fab0

• try remove unused code in Gtest PReLU

  long10024070

  committed
  5a58dcb

  Copy full SHA for 5a58dcb

• try remove unused code in Gtest PReLU

  long10024070

  committed
  7343d1f

  Copy full SHA for 7343d1f

Commits on Jul 26, 2024

• update prelu_driver

  long10024070

  committed
  e6cc24e

  Copy full SHA for e6cc24e

• update prelu test check, using ASSERT_EQ and EXPECT_LT instead of EXPECT_TRUE

  long10024070

  committed
  8f60362

  Copy full SHA for 8f60362

• update prelu test to new naming scheme

  long10024070

  committed
  0b50c3c

  Copy full SHA for 0b50c3c

Commits on Jul 30, 2024

• use MultiBufferWorkspaceTraits to handle workspace memory

  long10024070

  committed
  e0a685b

  Copy full SHA for e0a685b

• use miopenFloat instead of float

  long10024070

  committed
  07de0bb

  Copy full SHA for 07de0bb

Commits on Jul 31, 2024

• Merge remote-tracking branch 'rocm/develop' into impl_PReLU

  long10024070

  committed
  427125e

  Copy full SHA for 427125e

• fix error

  long10024070

  committed
  59f19b7

  Copy full SHA for 59f19b7

• remove MakeForwardNetworkConfig

  long10024070

  committed
  a8748db

  Copy full SHA for a8748db

• remove unused code

  long10024070

  committed
  d5e2332

  Copy full SHA for d5e2332

Commits on Aug 1, 2024

• remove unused code

  long10024070

  committed
  24748ec

  Copy full SHA for 24748ec

• remove #define FLOAT_ACCUM

  long10024070

  committed
  c98530b

  Copy full SHA for c98530b

• reduce number and size of testcases

  long10024070

  committed
  4972e0d

  Copy full SHA for 4972e0d

• add full test to FullTestConfig

  long10024070

  committed
  6f6c4fd

  Copy full SHA for 6f6c4fd

• Merge remote-tracking branch 'rocm/develop' into impl_PReLU

  long10024070

  committed
  8595889

  Copy full SHA for 8595889

Commits on Aug 2, 2024

• fix error

  long10024070

  committed
  bf7332c

  Copy full SHA for bf7332c

• fix 'Window Build' error, previous commit is 'fix Jenkins - Fp32 Hip Debug gfx90a error'

  long10024070

  committed
  cf2007b

  Copy full SHA for cf2007b

Commits on Aug 5, 2024

• update get warpSize automatically from context

  long10024070

  committed
  e9e60e4

  Copy full SHA for e9e60e4

• Merge branch 'develop' into impl_PReLU

  junliume

  authored
  3778448

  Copy full SHA for 3778448

• update doxygen

  long10024070

  committed
  3f06347

  Copy full SHA for 3f06347

Commits on Aug 6, 2024

• Merge remote-tracking branch 'rocm/develop' into impl_PReLU

  long10024070

  committed
  417cdf3

  Copy full SHA for 417cdf3

• update doxygen

  long10024070

  committed
  e588d2d

  Copy full SHA for e588d2d

Commits on Aug 7, 2024

• remove unused code

  long10024070

  committed
  1f2f385

  Copy full SHA for 1f2f385

• update doxygen

  long10024070

  committed
  b7f4ed6

  Copy full SHA for b7f4ed6

• change prelu/solvers header included location

  long10024070

  committed
  d848252

  Copy full SHA for d848252

• Merge remote-tracking branch 'rocm/develop' into impl_PReLU

  long10024070

  committed
  41469fe

  Copy full SHA for 41469fe

Commits on Aug 9, 2024

• Merge remote-tracking branch 'rocm/develop' into impl_PReLU

  long10024070

  committed
  05791df

  Copy full SHA for 05791df

• Merge branch 'develop' into impl_PReLU

  junliume

  committed
  86a1c94

  Copy full SHA for 86a1c94

• fix clang format issue

  junliume

  committed
  f5f7cfd

  Copy full SHA for f5f7cfd

Commits on Aug 11, 2024

• Merge branch 'develop' into impl_PReLU

  long10024070

  authored
  2dab3e6

  Copy full SHA for 2dab3e6

Commits on Aug 12, 2024

• Merge branch 'develop' into impl_PReLU

  long10024070

  authored
  d493d1e

  Copy full SHA for d493d1e

Commits on Aug 13, 2024

• return miopenStatusNotImplemented instead of miopenStatusSuccess in un-implemented Driver function

  long10024070

  committed
  6aa0432

  Copy full SHA for 6aa0432

• correct Forward and Fwd to Backward and Bwd

  long10024070

  committed
  f24a302

  Copy full SHA for f24a302

• fuse PReLUBackward kernels (Single weight and Multiple weight)

  long10024070

  committed
  26b5d8f

  Copy full SHA for 26b5d8f

• simplify kernels profiling

  long10024070

  committed
  fad7f3f

  Copy full SHA for fad7f3f

• remove excessive input tensor ndim check

  long10024070

  committed
  6c8fbf7

  Copy full SHA for 6c8fbf7

• solve problem with non-packed weight and non-packed dweight

  long10024070

  committed
  7789811

  Copy full SHA for 7789811

• Merge branch 'develop' into impl_PReLU

  long10024070

  authored
  8e611f5

  Copy full SHA for 8e611f5

Commits on Aug 14, 2024

• Merge branch 'develop' into impl_PReLU

  long10024070

  authored
  1dfadfa

  Copy full SHA for 1dfadfa

• diversify block_reduce and move block/warp reduce to seperated function for reuse

  long10024070

  committed
  69d43db

  Copy full SHA for 69d43db

Commits on Aug 15, 2024

• make block/warp reduce can be used for more pupose, not just sum reduction

  long10024070

  committed
  fdd2933

  Copy full SHA for fdd2933

• Merge branch 'impl_PReLU' of https://github.com/ROCm/MIOpen into impl_PReLU

  long10024070

  committed
  ab4086b

  Copy full SHA for ab4086b

• bug fixxed: non-contiguous weight gradient tensor

  long10024070

  committed
  dfe865b

  Copy full SHA for dfe865b

Commits on Aug 16, 2024

• add more smoke testcases

  long10024070

  committed
  65e531b

  Copy full SHA for 65e531b

• Merge remote-tracking branch 'rocm/develop' into impl_PReLU

  long10024070

  committed
  d95d58a

  Copy full SHA for d95d58a

Commits on Aug 17, 2024

• Merge branch 'develop' into impl_PReLU

  long10024070

  authored
  5516f45

  Copy full SHA for 5516f45