Code

Support for Mixed Input TensorOp #1084

Code

Merged

hwu36 merged 21 commits intoNVIDIA:mainNVIDIA/cutlass:mainfrom manishucsd:mixed_input_tensor_op_sm80manishucsd/cutlass:mixed_input_tensor_op_sm80Copy head branch name to clipboardSep 27, 2023

+2,065-14

Commits

Commits on Sep 26, 2023

• Passing warp-level mixed input F16*(S8/U8) tests

  

  Manish Gupta

  committed
  690cf40

  Copy full SHA for 690cf40

• passing device-level mixed input F16*(S8/U8) tests

  

  Manish Gupta

  committed
  7bad2c2

  Copy full SHA for 7bad2c2

• add to profiler - I8 (111 TFLOPs), U (123 TFLOPs)

  

  Manish Gupta

  committed
  7ce9cd3

  Copy full SHA for 7ce9cd3

• fast numeric conversions (I8 = 132 TFLOPs, U8 = 148 TFLOPs)

  

  Manish Gupta

  committed
  9730b08

  Copy full SHA for 9730b08

• Speedup reference compilation (REVERT THIS COMMIT)

  

  Manish Gupta

  committed
  1ba241c

  Copy full SHA for 1ba241c

• wider_add.u32_packed_sub.f16x2 (I8 = 132TFLOP/s, U8 = 170 TFLOP/s)

  

  Manish Gupta

  committed
  19aa4f5

  Copy full SHA for 19aa4f5

• Improve s8->f16 cvt and support bf16*u8 @158 TFLOPs

  

  Manish Gupta

  committed
  461b965

  Copy full SHA for 461b965

• BF16 * S8 (142 TFLOPs)

  

  Manish Gupta

  committed
  72eef5d

  Copy full SHA for 72eef5d

• Handle mixed-input upcast on OperandA (Support [S8|U8]*[F16|BF16]

  

  Manish Gupta

  committed
  f3a3a6a

  Copy full SHA for f3a3a6a

• rename OpMultiplyAddMixedInput to OpMultiplyAddMixedInputUpcast

  

  Manish Gupta

  committed
  45c4450

  Copy full SHA for 45c4450

• Add device-level test and profiler support for upcast on operand A

  

  Manish Gupta

  committed
  071c338

  Copy full SHA for 071c338

• Move shfl before the cvt and reduce #shfls by 1/2

  

  Manish Gupta

  committed
  84e9d9f

  Copy full SHA for 84e9d9f

• fix smem_usage calculation for mixed_input types

  

  Manish Gupta

  committed
  3c7fe3d

  Copy full SHA for 3c7fe3d

• uncomment the stuff (getting ready for merge)

  

  Manish Gupta

  committed
  70929da

  Copy full SHA for 70929da

• profiler changes and mixed-input reference

  

  Manish Gupta

  committed
  3a0dec8

  Copy full SHA for 3a0dec8

• mixed input reference are in a new file

  

  Manish Gupta

  committed
  39cace9

  Copy full SHA for 39cace9

• use platform instead of std

  

  Manish Gupta

  committed
  3e1c314

  Copy full SHA for 3e1c314

• comments and typo only

  

  Manish Gupta

  committed
  325df55

  Copy full SHA for 325df55

• Use CreateGemmOperator and delete CreateMixedInputGemmOperator

  

  Manish Gupta

  committed
  2520373

  Copy full SHA for 2520373

• copyright for new files

  

  Manish Gupta

  committed
  da44e43

  Copy full SHA for da44e43

• rebase follow-up

  

  Manish Gupta

  committed
  d9c85e1

  Copy full SHA for d9c85e1