[py 3.13t] Fix for vision nightly failure on MacOS M1 machines (#6358)

Follow up after:
#6242

Newer conda is having trouble installing py3.13t artifacts, please see:

https://github.com/pytorch/vision/actions/runs/13659383307/job/38186887882#step:10:98

```
Could not solve for environment specs
The following packages are incompatible
├─ libpng =* * is installable with the potential options
│  ├─ libpng 1.6.37 would require
│  │  └─ zlib >=1.2.11,<1.3.0a0 *, which can be installed;
│  └─ libpng 1.6.39 would require
│     └─ zlib >=1.2.13,<1.3.0a0 *, which can be installed;
└─ python-freethreading =* * is not installable because it requires
   ├─ cpython =3.13.2 *, which requires
   │  └─ python =3.13.2 * with the potential options
   │     ├─ python 3.13.2 would require
   │     │  └─ libzlib >=1.3.1,<2.0a0 *, which requires
   │     │     └─ zlib ==1.3.1 *_2, which conflicts with any installable versions previously reported;
   │     └─ python 3.13.2, which can be installed;
   └─ python_abi =* *_cp313t, which requires
      └─ python =3.13 *_cp313t, which conflicts with any installable versions previously reported.
```

As a consequence vision is compiled without png support and failing
smoke tests

Test PR: #6356

.github/actions/setup-binary-builds/action.yml

@@ -144,12 +144,16 @@ runs:
           if [[ "${PYTHON_VERSION:-}" == "3.13t" ]]; then
             export PYTHON_VERSION=3.13
             export CONDA_EXTRA_PARAM=" python-freethreading -c conda-forge"
-            if [[ "$(uname)" != Darwin ]]; then
-              # Pin conda and conda-libmamba-solver for 3.13t linux build
-              # this solver allows us to install anaconda dependencies on
-              # python-freethreading on conda-forge environment
-              conda install conda==24.7.1 conda-libmamba-solver=24.1.0
+
+            # downgrade conda version for python 3.13t install.
+            # TODO: remove this once python 3.13t is fully suported on conda
+            # Please see : https://github.com/conda/conda/issues/14554
+            if [[ "$(uname)" == Darwin ]]; then
+              # required to be able to downgrade on MacOS m1 side
+              conda install -y python=3.9
+              conda uninstall -y conda-anaconda-telemetry conda-anaconda-tos
             fi
+            conda install -y conda=24.7.1 conda-libmamba-solver=24.1.0
           fi
 
           conda create \