Updated README_template file.

triton-inference-server · Feb 5, 2025 · 70d4550 · 70d4550
1 parent a13b984
commit 70d4550
Show file tree

Hide file tree

Showing 2 changed files with 13 additions and 3 deletions.
diff --git a/genai-perf/README.md b/genai-perf/README.md
@@ -617,8 +617,8 @@ An option to enable verbose mode. (default: `False`)
 
 An option to print the version and exit.
 
-##### `--goodput <key:value>`
-##### `--g <key:value>`
+##### `--g <list>`
+##### `--goodput <list>`
 
 An option to provide constraints in order to compute goodput. Specify goodput
 constraints as 'key:value' pairs, where the key is a valid metric name, and the

diff --git a/templates/genai-perf-templates/README_template b/templates/genai-perf-templates/README_template
@@ -1,5 +1,5 @@
 <!--
-Copyright (c) 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
+Copyright (c) 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
 
 Redistribution and use in source and binary forms, with or without
 modification, are permitted provided that the following conditions
@@ -617,6 +617,16 @@ An option to enable verbose mode. (default: `False`)
 
 An option to print the version and exit.
 
+##### `--g <list>`
+##### `--goodput <list>`
+
+An option to provide constraints in order to compute goodput. Specify goodput
+constraints as 'key:value' pairs, where the key is a valid metric name, and the
+value is a number representing either milliseconds or a throughput value per
+second. For example, 'request_latency:300' or
+'output_token_throughput_per_request:600'. Multiple key:value pairs can be
+provided, separated by spaces. (default: `None`)
+
 </br>
 
 <!--