[Speculative Decoding] MLPSpeculator Tensor Parallel support (1/2)#6050

Merged

njhill merged 5 commits intovllm-project:mainfrom sirejdua:tp_mlp

Jul 2, 2024

+35-25

Commits on Jul 1, 2024

Commits on Jul 2, 2024

fix test config
sirejdua-db
committed
remove erroneous change to format.sh

Sirej Dua
authored and
Sirej Dua
committed