Skip to content

Commit

Permalink
Cache key documentation
Browse files Browse the repository at this point in the history
  • Loading branch information
atharva-2001 committed Jan 24, 2025
1 parent f0c3dbb commit 2a1c80e
Show file tree
Hide file tree
Showing 2 changed files with 25 additions and 1 deletion.
24 changes: 24 additions & 0 deletions docs/contributing/development/continuous_integration.rst
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,30 @@ TARDIS Pipelines

Brief description of pipelines already implemented on TARDIS

Cache Keys in TARDIS CI
-----------------------

TARDIS uses specific cache key formats to efficiently store and retrieve data during CI runs:

1. **Regression Data Cache Keys**
- Format: ``tardis-regression-<data-type>-<hash>-v1``
- Examples:
- ``tardis-regression-atom-data-sparse-<hash>-v1`` - For atomic data cache
- ``tardis-regression-full-data-<hash>-v1`` - For full TARDIS regression data cache
- Used in: ``setup_lfs`` action

2. **Environment Cache Keys**
- Format: ``tardis-conda-env-<os-label>-<hash>-v1``
- Examples:
- ``tardis-conda-env-linux-<hash>-v1`` - For Linux conda environment
- ``tardis-conda-env-macos-<hash>-v1`` - For macOS conda environment
- Used in: ``setup_env`` action

.. warning::
- The version suffix (-v1) allows for future cache invalidation if needed.
- Sometimes the cache might not be saved due to race conditions between parallel jobs. Please check workflow runs when testing new regression data for cache misses to avoid consuming LFS quota.


Streamlined Steps for TARDIS Pipelines
========================================

Expand Down
2 changes: 1 addition & 1 deletion docs/contributing/development/running_tests.rst
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ Or, to run tests for a particular file or directory
To prevent leaking LFS quota, tests have been disabled on forks.
If, by any chance, you need to run tests on your fork, make sure to run the tests workflow on master branch first.
The LFS cache generated in the master branch should be available in all child branches.
You can check if cache was generated by looking in the ``Restore LFS Cache`` step of the workflow run.
You can check if cache was generated by looking in the ``Setup LFS`` step of the workflow run.
Cache can also be found under the "Management" Section under "Actions" tab.

Generating Plasma Reference
Expand Down

0 comments on commit 2a1c80e

Please sign in to comment.