Skip to content

Commit

Permalink
Add gooput CLI doc which was missing from the main
Browse files Browse the repository at this point in the history
Readme for Genai-Perf.
  • Loading branch information
ganeshku1 committed Feb 5, 2025
1 parent 3416d4f commit 6ac2d75
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions genai-perf/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -617,6 +617,11 @@ An option to enable verbose mode. (default: `False`)

An option to print the version and exit.

##### `--goodput <options>`

Benchmark and measure goodput with GenAI-Perf by tracking completed requests per second that meet performance constraints like time-to-first-token and inter-token latency. Use it to assess model efficiency and optimize deployments.
For more details please follow this [goodput doc](docs/goodput.md) .

</br>

<!--
Expand Down

0 comments on commit 6ac2d75

Please sign in to comment.