Skip to content

Commit

Permalink
.
Browse files Browse the repository at this point in the history
  • Loading branch information
MahmoudAshraf97 committed Jul 10, 2024
1 parent c8222e2 commit 97a975d
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions examples/whisper/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ trtllm-build --checkpoint_dir ${checkpoint_dir}/decoder \
--gemm_plugin ${INFERENCE_PRECISION} \
--bert_attention_plugin ${INFERENCE_PRECISION} \
--gpt_attention_plugin ${INFERENCE_PRECISION} \
--remove_input_padding disable
--remove_input_padding enable
```

### Run
Expand Down Expand Up @@ -121,7 +121,7 @@ WEIGHT_ONLY_PRECISION=int8
MAX_BEAM_WIDTH=4
MAX_BATCH_SIZE=8
checkpoint_dir=distil_whisper_medium_en_weights_${WEIGHT_ONLY_PRECISION}
output_dir=distil_whisper_medium_en${WEIGHT_ONLY_PRECISION}
output_dir=distil_whisper_medium_en_${WEIGHT_ONLY_PRECISION}

python3 convert_checkpoint.py \
--use_weight_only \
Expand Down

0 comments on commit 97a975d

Please sign in to comment.