From 832abd8bfdf0ba8483bdaf7f51fc74f5ac16ba92 Mon Sep 17 00:00:00 2001 From: Gil Forsyth Date: Wed, 5 Feb 2025 14:50:13 -0500 Subject: [PATCH] Use `rapids-pip-retry` in CI jobs that might need retries (#6293) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Uses a retry wrapper for `pip` commands to try to alleviate CI failures due to hash mismatches that result from network hiccups xref rapidsai/build-planning#148 This will retry failures that show up in CI like: ``` Collecting nvidia-cublas-cu12 (from libraft-cu12==25.2.*,>=0.0.0a0) Downloading https://pypi.nvidia.com/nvidia-cublas-cu12/nvidia_cublas_cu12-12.8.3.14-py3-none-manylinux_2_27_aarch64.whl (604.9 MB) ━━━━━━━━━━━━━━━━━━━━━ 350.2/604.9 MB 229.2 MB/s eta 0:00:02 ERROR: THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them. nvidia-cublas-cu12 from https://pypi.nvidia.com/nvidia-cublas-cu12/nvidia_cublas_cu12-12.8.3.14-py3-none-manylinux_2_27_aarch64.whl#sha256=93a4e0e386cc7f6e56c822531396de8170ed17068a1e18f987574895044cd8c3 (from libraft-cu12==25.2.*,>=0.0.0a0): Expected sha256 93a4e0e386cc7f6e56c822531396de8170ed17068a1e18f987574895044cd8c3 Got 849c88d155cb4b4a3fdfebff9270fb367c58370b4243a2bdbcb1b9e7e940b7be ``` Authors: - Gil Forsyth (https://github.com/gforsyth) Approvers: - Bradley Dice (https://github.com/bdice) URL: https://github.com/rapidsai/cuml/pull/6293 --- ci/build_wheel.sh | 2 +- ci/build_wheel_libcuml.sh | 2 +- ci/test_wheel.sh | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/ci/build_wheel.sh b/ci/build_wheel.sh index 3c840d9849..c7c7eccfb9 100755 --- a/ci/build_wheel.sh +++ b/ci/build_wheel.sh @@ -16,7 +16,7 @@ cd "${package_dir}" sccache --zero-stats rapids-logger "Building '${package_name}' wheel" -python -m pip wheel \ +rapids-pip-retry wheel \ -w dist \ -v \ --no-deps \ diff --git a/ci/build_wheel_libcuml.sh b/ci/build_wheel_libcuml.sh index ad38eab617..7c719a6380 100755 --- a/ci/build_wheel_libcuml.sh +++ b/ci/build_wheel_libcuml.sh @@ -18,7 +18,7 @@ rapids-dependency-file-generator \ | tee /tmp/requirements-build.txt rapids-logger "Installing build requirements" -python -m pip install \ +rapids-pip-retry install \ -v \ --prefer-binary \ -r /tmp/requirements-build.txt diff --git a/ci/test_wheel.sh b/ci/test_wheel.sh index 8027876005..7e1feff80a 100755 --- a/ci/test_wheel.sh +++ b/ci/test_wheel.sh @@ -9,7 +9,7 @@ RAPIDS_PY_WHEEL_NAME="cuml_${RAPIDS_PY_CUDA_SUFFIX}" rapids-download-wheels-from RAPIDS_PY_WHEEL_NAME="libcuml_${RAPIDS_PY_CUDA_SUFFIX}" rapids-download-wheels-from-s3 cpp ./dist # echo to expand wildcard before adding `[extra]` requires for pip -python -m pip install \ +rapids-pip-retry install \ ./dist/libcuml*.whl \ "$(echo ./dist/cuml*.whl)[test]"