Updated docs

mlcommons · Dec 11, 2023 · fc08ed0 · fc08ed0
1 parent b9bf376
commit fc08ed0
Show file tree

Hide file tree

Showing 3 changed files with 49 additions and 3 deletions.
diff --git a/cm-mlops/script/app-mlperf-inference-reference/README.md b/cm-mlops/script/app-mlperf-inference-reference/README.md
@@ -309,6 +309,11 @@ ___
         - *CM_MLPERF_BACKEND*: `pytorch`
         - *CM_MLPERF_BACKEND_VERSION*: `<<<CM_TORCH_VERSION>>>`
       - Workflow:
+    * `_ray`
+      - Environment variables:
+        - *CM_MLPERF_BACKEND*: `ray`
+        - *CM_MLPERF_BACKEND_VERSION*: `<<<CM_TORCH_VERSION>>>`
+      - Workflow:
     * `_tf`
       - Aliases: `_tensorflow`
       - Environment variables:
@@ -624,17 +629,33 @@ ___
        * CM names: `--adr.['ml-engine-pytorch', 'pytorch']...`
        - CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
      * get,generic-python-lib,_torch_cuda
-       * `if (CM_MLPERF_BACKEND in ['pytorch', 'tvm-pytorch'] AND CM_MLPERF_DEVICE  == gpu)`
+       * `if (CM_MLPERF_BACKEND in ['pytorch', 'tvm-pytorch', 'ray'] AND CM_MLPERF_DEVICE  == gpu)`
        * CM names: `--adr.['ml-engine-pytorch', 'pytorch']...`
        - CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
      * get,generic-python-lib,_torchvision
        * `if (CM_MLPERF_BACKEND in ['pytorch', 'tvm-pytorch'] AND CM_MLPERF_DEVICE  == cpu)`
        * CM names: `--adr.['ml-engine-torchvision']...`
        - CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
      * get,generic-python-lib,_torchvision_cuda
-       * `if (CM_MLPERF_BACKEND in ['pytorch', 'tvm-pytorch'] AND CM_MLPERF_DEVICE  == gpu)`
+       * `if (CM_MLPERF_BACKEND in ['pytorch', 'tvm-pytorch', 'ray'] AND CM_MLPERF_DEVICE  == gpu)`
        * CM names: `--adr.['ml-engine-torchvision']...`
        - CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
+     * get,generic-python-lib,_tensorrt
+       * `if (CM_MLPERF_BACKEND  == ray)`
+       * CM names: `--adr.['ml-engine-tensorrt']...`
+       - CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
+     * get,generic-python-lib,_torch_tensorrt
+       * `if (CM_MLPERF_BACKEND  == ray)`
+       * CM names: `--adr.['ml-engine-torch_tensorrt']...`
+       - CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
+     * get,generic-python-lib,_ray
+       * `if (CM_MLPERF_BACKEND  == ray)`
+       * CM names: `--adr.['ray']...`
+       - CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
+     * get,generic-python-lib,_async_timeout
+       * `if (CM_MLPERF_BACKEND  == ray)`
+       * CM names: `--adr.['async_timeout']...`
+       - CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
      * get,generic-python-lib,_transformers
        * `if (CM_MODEL in ['bert-99', 'bert-99.9', 'gptj-99', 'gptj-99.9'])`
        * CM names: `--adr.['ml-engine-transformers']...`
@@ -663,7 +684,6 @@ ___
        * `if (CM_MODEL in ['gptj-99', 'gptj-99.9'])`
        * CM names: `--adr.['ml-model', 'gptj-model', 'gpt-j-model']...`
        - CM script: [get-ml-model-gptj](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-gptj)
-       - CM script: [get-ml-model-stable-diffusion](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-stable-diffusion)
      * get,ml-model,object-detection,resnext50,fp32,_pytorch-weights
        * `if (CM_MLPERF_BACKEND  == pytorch AND CM_MLPERF_IMPLEMENTATION  == nvidia AND CM_MODEL  == retinanet)`
        * CM names: `--adr.['ml-model', 'retinanet-model']...`

diff --git a/cm-mlops/script/app-mlperf-inference/README.md b/cm-mlops/script/app-mlperf-inference/README.md
@@ -244,6 +244,10 @@ ___
       - Environment variables:
         - *CM_MLPERF_BACKEND*: `pytorch`
       - Workflow:
+    * `_ray`
+      - Environment variables:
+        - *CM_MLPERF_BACKEND*: `ray`
+      - Workflow:
     * `_tensorrt`
       - Environment variables:
         - *CM_MLPERF_BACKEND*: `tensorrt`

diff --git a/cm-mlops/script/get-generic-python-lib/README.md b/cm-mlops/script/get-generic-python-lib/README.md
@@ -119,6 +119,10 @@ ___
       - Environment variables:
         - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `apex`
       - Workflow:
+    * `_async_timeout`
+      - Environment variables:
+        - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `async_timeout`
+      - Workflow:
     * `_attr`
       - Environment variables:
         - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `attr`
@@ -350,6 +354,10 @@ ___
            * get,cuda
              * CM names: `--adr.['cuda']...`
              - CM script: [get-cuda](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-cuda)
+    * `_ray`
+      - Environment variables:
+        - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `ray[default]`
+      - Workflow:
     * `_requests`
       - Environment variables:
         - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `requests`
@@ -424,6 +432,13 @@ ___
       - Environment variables:
         - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `tensorflow-rocm`
       - Workflow:
+    * `_tensorrt`
+      - Environment variables:
+        - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `tensorrt`
+        - *CM_GENERIC_PYTHON_PIP_EXTRA_INDEX_URL*: `https://download.pytorch.org/whl/${CM_TORCH_CUDA}`
+        - *CM_TORCH_CUDA*: `cu118`
+        - *CM_TORCH_VERSION_EXTRA*: `CUDA`
+      - Workflow:
     * `_tflite`
       - Environment variables:
         - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `tflite`
@@ -487,6 +502,13 @@ ___
              - CM script: [get-cuda](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-cuda)
            * get,generic-python-lib,_numpy
              - CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
+    * `_torch_tensorrt`
+      - Environment variables:
+        - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `torch-tensorrt`
+        - *CM_GENERIC_PYTHON_PIP_EXTRA_INDEX_URL*: `https://download.pytorch.org/whl/${CM_TORCH_CUDA}`
+        - *CM_TORCH_CUDA*: `cu118`
+        - *CM_TORCH_VERSION_EXTRA*: `CUDA`
+      - Workflow:
     * `_torchaudio`
       - Environment variables:
         - *CM_GENERIC_PYTHON_PACKAGE_NAME*: `torchaudio`