Skip to content

Commit

Permalink
Update TensorRT_whisper.md
Browse files Browse the repository at this point in the history
fix: typo in bash script name to build tensorrt engine
makaveli10 authored Jan 29, 2024
1 parent 703263b commit 2f3c1cd
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions TensorRT_whisper.md
Original file line number Diff line number Diff line change
@@ -37,10 +37,10 @@ python -c "import torch; import tensorrt; import tensorrt_llm"
- We build `small.en` and `small` multilingual TensorRT engine. The script logs the path of the directory with Whisper TensorRT engine. We need the model_path to run the server.
```bash
# convert small.en
bash build_whisper_tensorrt /root/TensorRT-LLM-examples small.en
bash scripts/build_whisper_tensorrt.sh /root/TensorRT-LLM-examples small.en

# convert small multilingual model
bash build_whisper_tensorrt /root/TensorRT-LLM-examples small
bash scripts/build_whisper_tensorrt.sh /root/TensorRT-LLM-examples small
```

## Run WhisperLive Server with TensorRT Backend

0 comments on commit 2f3c1cd

Please sign in to comment.