Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Value-View Interface #289

Open
wants to merge 60 commits into
base: develop
Choose a base branch
from
Open

Value-View Interface #289

wants to merge 60 commits into from

Conversation

mdavis36
Copy link
Collaborator

@mdavis36 mdavis36 commented Jul 23, 2024

Summary

  • This PR introduces the foundational features necessary for refactoring our current classes & objects in a way that is not too obstructive to the codebase.
    • A working ManagedVector (MV) implementation.
      • MV unit testing.
      • This currently lives within the Spheral headers. It will need to be refactored in the future and moved into CHAI with a better implementation.
    • The Value-View Interface Pattern (VVI) that is based around the experimental chai::ManagedSharedPtr.
      • Documentation on VVI in Spheral RTD. Preview here.
      • Example class patterns for:
        • Basic class w/ MV member.
        • CRTP pattern.
        • Abstract interface iheritance w/ MV member.
      • Implementation of VVI for Spheral::QuadraticInterpolator.
    • ctest c++ unit testing for ensuring semantic behavior of classes is working as expected with VVI.
      • Unit testing for Spheral::QuadraticInterpolator w/ and w/o VVI.
      • The start of unit tests for Spheral::Field. Incomplete
    • Gitlab CI:
      • make test at the end of the build stage.
      • SPHERAL_ENABLE_VVI=On for +cuda builds.

ToDo :

  • Annotate RELEASE_NOTES.md with notable changes.
  • Create LLNLSpheral PR pointing at this branch. (PR#105)
  • LLNLSpheral PR has passed all tests.

mdavis36 added 29 commits July 22, 2024 17:54
…; Moving SphArray.hh to Utilities/ManagedVector.hh
…d organization for VVI macros; Differentiating between Ptr and Ref syntax metaclasses with vvi pattern.
…o provide a clearer API for using VVI to users.
…Better default behavior for Value Interfaces, def copy-ctor, assign op and eq op behavior is baked in for free in the ValueInterface class.
…or defining default Ctor, Copy, Ass and Eq operations.
ldowen
ldowen previously approved these changes Oct 14, 2024
Comment on lines +211 to +213
mInterp(0.0, kernel.kernelExtent(), numPoints, Wlookup<KernelType>(kernel)),
mGradInterp(0.0, kernel.kernelExtent(), numPoints, gradWlookup<KernelType>(kernel)),
mGrad2Interp(0.0, kernel.kernelExtent(), numPoints, grad2Wlookup<KernelType>(kernel)),
Copy link
Collaborator Author

@mdavis36 mdavis36 Nov 22, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jmikeowen These are the changes I needed to revert. NVCC isn't happy with the local variable kernel in the lambda captures when compiling for the device.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah I see, so you have to go back to externally defined functors. This is harmless enough, but kind of a bummer since I like the compact (and I think clearer) lambda function version. Do we think this is something that newer versions of nvcc can/will correct? Seems like they're not supporting standard C++ things here.

Also, since RAJA relies on lamda functions for it's trickery as well, what's teh salient difference here? Is it the reference capturing [&] version?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

RAJA requires capturing by value [=] so a copy of the object must be taken into a host-device lambda.

In this specific case the lambda is used for construction of the Interpreter. When VVI + Cuda are enabled the underlying ManagedSharedPtr tries to invoke the constructor on both the host and device. Meaning kernel isn't available to the lambda invoked on the device, we need a copy of it to be passed over to the device in order to be able to call it correctly.

There are a couple of ways of getting back to an interface where we provide a lambda:

  1. Construct interpreters from factory functions that are able to construct w/ appropriate size on Host + Device, then fill the interpreter on the host and copy the contents to the device.
  2. Have the interprter take a handle to the kernel object then define the lambda as [=](const double, const kernel) { return kernel ... } so the interpreter can pass the kernel internally in it's constructor.

@mdavis36 mdavis36 force-pushed the feature/value-view-interface branch from c139e99 to 1aca95c Compare February 3, 2025 20:17
commit b0080e6
Merge: 0f8e3e7 543925b
Author: Michael Davis <[email protected]>
Date:   Thu Jan 30 13:13:14 2025 -0800

    Merge pull request #314 from LLNL/feature/pip-runtime-deps

    Pip Runtime Dependencies & CRAY AMD Support

commit 543925b
Author: mdavis36 <[email protected]>
Date:   Thu Jan 30 09:24:17 2025 -0800

    Syncing gitlab/os file.

commit 4bd1e57
Author: Landon Owen <[email protected]>
Date:   Wed Jan 29 16:08:20 2025 -0800

    Removed py-ats spack packaged, added -N option for spheral_ats node number specs

commit 2181ec9
Author: Mike Owen <[email protected]>
Date:   Wed Jan 29 15:30:44 2025 -0800

    Further changes to Classic ASPH algorithm to more closely match original

commit 6a85d09
Author: Mike Owen <[email protected]>
Date:   Wed Jan 29 15:30:11 2025 -0800

    Updating our very out of date gas-gun expanding tube problem for
    current code

commit f5064e0
Merge: b85df2f 77ed9b2
Author: Mike Owen <[email protected]>
Date:   Wed Jan 29 11:10:35 2025 -0800

    Merge branch 'feature/pip-runtime-deps' into HEAD

commit b85df2f
Author: Mike Owen <[email protected]>
Date:   Wed Jan 29 11:05:59 2025 -0800

    Fixing building the integrator with a list of packages

commit 77ed9b2
Author: Landon Owen <[email protected]>
Date:   Wed Jan 29 09:51:15 2025 -0800

    Added Thicket and IPython to the list of pip dependencies and changed documentation

commit b5b5eb4
Author: Landon Owen <[email protected]>
Date:   Mon Jan 27 11:39:32 2025 -0800

    Missed a perf stage for cray_shell2

commit 7366837
Author: Landon Owen <[email protected]>
Date:   Mon Jan 27 11:36:32 2025 -0800

    Remove resource constraint for shell init stages

commit 0f07be2
Author: Landon Owen <[email protected]>
Date:   Mon Jan 27 10:37:42 2025 -0800

    Updated PYB11Generator submodule

commit 9d5812f
Author: Landon Owen <[email protected]>
Date:   Mon Jan 27 10:35:57 2025 -0800

    Added an init stage to allow rerunning of tpl stage

commit 0737e48
Merge: f82f386 a7b924e
Author: Landon Owen <[email protected]>
Date:   Fri Jan 24 15:11:20 2025 -0800

    Merge with spec-list changes

commit f82f386
Merge: 37e4654 0f8e3e7
Author: Landon Owen <[email protected]>
Date:   Fri Jan 24 15:08:32 2025 -0800

    Updated ATS version, removed blue os info from ci and ats scripts, added proc per node limit to flux ATS runs, removed hip part of CI spec, added cray specs to devtools/spec-list.json, removed mpi module call from performance ats, added cray resource group for doing performance tests

commit a7b924e
Author: mdavis36 <[email protected]>
Date:   Thu Jan 23 18:42:22 2025 -0800

    Adding specs for Cray systems in the spec list.

commit 0f8e3e7
Merge: 0ad6173 9e382a1
Author: ldowen <[email protected]>
Date:   Wed Jan 22 12:44:38 2025 -0800

    Merge pull request #323 from LLNL/bugfix/perf_ci

    CI Performance Test Bugfix

commit 37e4654
Author: mdavis36 <[email protected]>
Date:   Wed Jan 22 07:26:28 2025 -0800

    Remove MPI include

commit 3613f9c
Author: mdavis36 <[email protected]>
Date:   Tue Jan 21 21:12:44 2025 -0800

    Passing CMake option directly to SpheralConfig for MPI

commit 9e382a1
Author: Landon Owen <[email protected]>
Date:   Tue Jan 21 15:51:07 2025 -0800

    Up blueos time limit to 2 hours

commit fac728c
Author: mdavis36 <[email protected]>
Date:   Tue Jan 21 15:41:24 2025 -0800

    Try reverting the mpi change in spheral_ats.py

commit 1e8c2ac
Author: mdavis36 <[email protected]>
Date:   Tue Jan 21 15:40:56 2025 -0800

    Adding SPHERAL_PIP_CACHE_DIR as an optional env variable to install-from-dev-pkg.

commit 3df499a
Author: mdavis36 <[email protected]>
Date:   Tue Jan 21 12:02:46 2025 -0800

    generate buildcache script cleanup and comments; adding ability to wrap pip-cache dir as well.

commit 5fd37c9
Author: Landon Owen <[email protected]>
Date:   Tue Jan 21 09:20:04 2025 -0800

    Add spaces for command line options in spheral_ats.py

commit 9a6f64f
Merge: de480cb dbdbd39
Author: mdavis36 <[email protected]>
Date:   Tue Jan 21 08:38:31 2025 -0800

    Merge branch 'feature/pip-runtime-deps' of github.com:LLNL/spheral into feature/pip-runtime-deps

commit de480cb
Author: mdavis36 <[email protected]>
Date:   Fri Jan 17 15:53:25 2025 -0800

    Updating release notes for pip & cray PR.

commit 7864885
Author: mdavis36 <[email protected]>
Date:   Fri Jan 17 15:26:01 2025 -0800

    Documenting SPHERAL_NETWORK_CONNECTED and SPHERAL_PIP_CACHE_DIR CMake options.

commit 9faf247
Author: mdavis36 <[email protected]>
Date:   Fri Jan 17 15:08:11 2025 -0800

    Removing cce compiler.

commit 953f57b
Author: mdavis36 <[email protected]>
Date:   Fri Jan 17 15:07:54 2025 -0800

    Removing redundant blueos python env logic.

commit dbdbd39
Author: mdavis36 <[email protected]>
Date:   Fri Jan 17 13:14:51 2025 -0800

    Squashing clang18 WasErr issues.

commit 52eded2
Author: mdavis36 <[email protected]>
Date:   Fri Jan 17 13:14:13 2025 -0800

    Adding tioga to spheral-ats script

commit 5ca0171
Author: Landon Owen <[email protected]>
Date:   Thu Jan 16 16:01:29 2025 -0800

    Bring back default time limit in spheral_ats.py and in machine.yaml

commit 215cd57
Author: Landon Owen <[email protected]>
Date:   Thu Jan 16 14:30:30 2025 -0800

    Increased number of nodes used on ruby to 2 since the time limit is shorter and we are allowed up to 12 nodes at a time

commit 7225834
Author: Landon Owen <[email protected]>
Date:   Thu Jan 16 11:09:36 2025 -0800

    Fix incorrect proc count on ruby in performance test, fix bug in performance_analysis.py

commit 5d9324c
Author: Mike Owen <[email protected]>
Date:   Wed Jan 15 14:47:43 2025 -0800

    Remove debug print

commit 4235970
Author: Mike Owen <[email protected]>
Date:   Wed Jan 15 09:57:43 2025 -0800

    Bugfix for atomic weight in ANEOS

commit daeb774
Author: Landon Owen <[email protected]>
Date:   Tue Jan 14 11:13:44 2025 -0800

    Removed default time limit from spheral_ats.py

commit f02bad0
Author: Landon Owen <[email protected]>
Date:   Tue Jan 14 11:00:42 2025 -0800

    Reduce toss machine node count from 2 to 1, add another resource, reduce the default time limit for toss machines to 1 hour, only have 1 toss shell resource

commit 9f21a76
Author: Landon Owen <[email protected]>
Date:   Mon Jan 13 14:44:40 2025 -0800

    Ensure CI queue command is only added if ciRun is enabled

commit 099ea7c
Author: mdavis36 <[email protected]>
Date:   Mon Jan 13 14:28:23 2025 -0800

    Rename Spheral_CUDA_Test to spheral_offload_test.

commit 48df86e
Author: Landon Owen <[email protected]>
Date:   Mon Jan 13 13:38:12 2025 -0800

    Update TaylorImpact command line options from previous merge

commit 350a863
Merge: 228beb4 0ad6173
Author: Landon Owen <[email protected]>
Date:   Mon Jan 13 10:47:52 2025 -0800

    Merge branch 'develop' into bugfix/perf_ci

commit 228beb4
Author: Landon Owen <[email protected]>
Date:   Mon Jan 13 10:47:28 2025 -0800

    Increase default time limit, try to prevent iotcl error message for ci perf runs

commit 0ad6173
Merge: 69b1459 5f2c63d
Author: Mike Owen <[email protected]>
Date:   Thu Jan 9 09:53:30 2025 -0800

    Merge pull request #322 from LLNL/feature/ASPHClassic

    Bringing back our old ASPH idealH algorithm as a new option, ASPHClassic

commit 5f2c63d
Author: Mike Owen <[email protected]>
Date:   Wed Jan 8 16:28:18 2025 -0800

    Fixing reference state generation from TaylorAnvil for SpheralC

commit fb68fbb
Author: Mike Owen <[email protected]>
Date:   Wed Jan 8 16:27:57 2025 -0800

    Valgrind found some uninitialized variables

commit 083ffb9
Author: Mike Owen <[email protected]>
Date:   Wed Jan 8 09:46:39 2025 -0800

    One more damn BlueOS tolerance difference

commit 82a6eab
Author: Mike Owen <[email protected]>
Date:   Tue Jan 7 16:36:55 2025 -0800

    Test tolerance for BlueOS fix

commit 2f4a65f
Author: Mike Owen <[email protected]>
Date:   Tue Jan 7 13:25:37 2025 -0800

    Allowing a big more flexibility when specifying ASPHClassic

commit 56243ca
Author: Mike Owen <[email protected]>
Date:   Tue Jan 7 11:27:10 2025 -0800

    Reducing the run time for the Noh-RZ ATS tests

commit 1285b4a
Author: Mike Owen <[email protected]>
Date:   Mon Jan 6 16:39:07 2025 -0800

    Updating RELEASE_NOTES

commit 7517f87
Author: Mike Owen <[email protected]>
Date:   Mon Jan 6 16:26:49 2025 -0800

    Adding classic ASPH to TaylorImpact tests

commit a53d399
Author: Landon Owen <[email protected]>
Date:   Mon Jan 6 16:25:26 2025 -0800

    Made independent=true always on for spheral_ats.py

commit 601aa8f
Author: Mike Owen <[email protected]>
Date:   Mon Jan 6 15:56:52 2025 -0800

    Adding Noh-RZ with ASPH and ASPHClassic versions to the ATS test suite

commit 1d5c7e2
Author: Mike Owen <[email protected]>
Date:   Mon Jan 6 14:32:18 2025 -0800

    Cleanup

commit c41459a
Author: Mike Owen <[email protected]>
Date:   Mon Jan 6 14:00:16 2025 -0800

    Checkpoint

commit 2117fa9
Author: Mike Owen <[email protected]>
Date:   Mon Jan 6 13:31:36 2025 -0800

    Checkpoint

commit 150b1a0
Author: Mike Owen <[email protected]>
Date:   Mon Jan 6 13:31:17 2025 -0800

    Cleaning up hourglass options a bit

commit b3c6a1f
Author: Landon Owen <[email protected]>
Date:   Mon Jan 6 11:56:45 2025 -0800

    Swapped the quotation marks for the ats commands, added exit code check for performance test stage

commit f07fd8c
Author: Landon Owen <[email protected]>
Date:   Mon Jan 6 09:50:36 2025 -0800

    Undo the previous commit

commit d42271d
Merge: f45a048 69b1459
Author: Mike Owen <[email protected]>
Date:   Fri Jan 3 16:48:13 2025 -0800

    Merge branch 'develop' into feature/ASPHClassic

commit f45a048
Author: Mike Owen <[email protected]>
Date:   Fri Jan 3 16:38:54 2025 -0800

    Initial implementation of our "classic" ASPH idealH option in new code

commit 0665d0f
Author: Landon Owen <[email protected]>
Date:   Fri Jan 3 12:51:03 2025 -0800

    Temporary changes to test some CI functions in place

commit be00257
Author: Landon Owen <[email protected]>
Date:   Fri Jan 3 12:48:40 2025 -0800

    Removed perf artifact

commit 981c606
Author: Landon Owen <[email protected]>
Date:   Fri Jan 3 12:46:39 2025 -0800

    Add shell resource job pipelines for performance test to use, remove need for cleanups

commit 69b1459
Merge: 9a039f7 bfb5c1d
Author: Mike Owen <[email protected]>
Date:   Fri Jan 3 11:30:12 2025 -0800

    Merge pull request #321 from LLNL/bugfix/PorosityDamage

    Fix for porosity interaction with damage when starting with zero porosity

commit ebb979e
Author: mdavis36 <[email protected]>
Date:   Fri Jan 3 09:49:16 2025 -0800

    adams -> tioga

commit e76b591
Author: mdavis36 <[email protected]>
Date:   Fri Jan 3 09:46:02 2025 -0800

    Adding tioga machine to gitlab ci

commit aaeadf9
Author: mdavis36 <[email protected]>
Date:   Fri Jan 3 09:39:41 2025 -0800

    Updating gitlab scripts to run cray & hip jobs.

commit bfb5c1d
Author: Mike Owen <[email protected]>
Date:   Thu Jan 2 15:15:53 2025 -0800

    Copy/paste name dependency errors in ATS test names for Noh-cylindrical

commit 7ed15d9
Author: Mike Owen <[email protected]>
Date:   Thu Jan 2 13:52:55 2025 -0800

    Adding unit tests for porosity model and damage with zero initial porosity

commit d544ab0
Author: mdavis36 <[email protected]>
Date:   Thu Jan 2 11:55:34 2025 -0800

    CRAY pre allocated ats runs.

commit c468000
Author: Mike Owen <[email protected]>
Date:   Thu Jan 2 11:19:29 2025 -0800

    Correcting porous damage evolution to handle limit of no initial porosity

commit 5884d73
Author: Mike Owen <[email protected]>
Date:   Thu Jan 2 11:04:18 2025 -0800

    Robustness changes for setting phi=0 (alpha=1) in the porosity model

commit 07ecaee
Author: mdavis36 <[email protected]>
Date:   Fri Dec 27 19:19:26 2024 -0800

    treat raja and umpire as system includes.

commit be8b126
Author: mdavis36 <[email protected]>
Date:   Fri Dec 27 19:19:03 2024 -0800

    clang 18 warning suppression w/ old boost.

commit 9a039f7
Merge: 721c079 e4edecd
Author: ldowen <[email protected]>
Date:   Fri Dec 20 13:03:31 2024 -0800

    Merge pull request #319 from LLNL/feature/perf_assess

    Performance Testing and Assessment

commit e4edecd
Author: Landon Owen <[email protected]>
Date:   Thu Dec 19 16:41:43 2024 -0800

    Fix bug with benchmark file group ownership command

commit 1c9d56d
Author: Landon Owen <[email protected]>
Date:   Thu Dec 19 16:34:27 2024 -0800

    Fix bug with Taylor Impact nr and nz initial guess, fix incorrect Taylor Impact configuration for FSI and SPH performance tests

commit 4775041
Author: mdavis36 <[email protected]>
Date:   Thu Dec 19 10:32:51 2024 -0800

    Getting CRAY HIP builds working and passing all tests.

commit 7a37aeb
Author: Landon Owen <[email protected]>
Date:   Wed Dec 18 15:19:45 2024 -0800

    Removed old docs related to spheral-atstest, fixed bug in performance_analysis

commit 7de2f5b
Author: Landon Owen <[email protected]>
Date:   Wed Dec 18 14:38:51 2024 -0800

    Added performance_analysis.py to scripts install directory, added --threads option to spheral_ats for use in performance.py, removed MPI restriction for performance.py and added logic to thread all cores in that case, added Solid SPH Taylor Impact test configuration, changed 1 and 2 thread 3D convection performance test to just be a single general test, changed all gitlab builds to use -DENABLE_TIMER, updated performance_analysis to better handle non-benchmark reference data, updated documentation accordingly

commit 4b986f3
Author: Landon Owen <[email protected]>
Date:   Tue Dec 17 10:11:28 2024 -0800

    Fix cmake bugs

commit 6b78495
Merge: a652fe4 721c079
Author: mdavis36 <[email protected]>
Date:   Mon Dec 16 19:08:13 2024 -0800

    Merge branch 'develop' into feature/pip-runtime-deps

commit a652fe4
Author: mdavis36 <[email protected]>
Date:   Mon Dec 16 17:54:21 2024 -0800

    Getting HIP device code running on GPU for spheral_cuda_test; revert boost back to 1.74.0; rocmcc error mitigation for building older boost.

commit e787c7a
Author: Landon Owen <[email protected]>
Date:   Mon Dec 16 16:58:31 2024 -0800

    Fix test path for performance.py

commit cdd1e72
Author: Landon Owen <[email protected]>
Date:   Mon Dec 16 16:56:06 2024 -0800

    Add cmake function for installing python tests, make performance.py always be installed in top tests directory in installation, add call in performance.py for llnlperformance.py

commit 004872e
Author: mdavis36 <[email protected]>
Date:   Mon Dec 16 13:19:33 2024 -0800

    spack package fixes for required CRAY / ROCM CMake flags.

commit 6ef2ac6
Merge: aad13c2 721c079
Author: Landon Owen <[email protected]>
Date:   Fri Dec 13 14:47:42 2024 -0800

    Merge branch 'develop' into feature/perf_assess

commit aad13c2
Author: Landon Owen <[email protected]>
Date:   Fri Dec 13 14:46:44 2024 -0800

    Removed unused CXXTests files, added documentation for running performance tests, reconfigured how benchmark data directory is stored and passed around, moved performance_analysis.py from scripts/gitlab to scripts/devtools, added new Adiak metadata

commit 721c079
Merge: e282594 3de3310
Author: Brody Bassett <[email protected]>
Date:   Wed Dec 11 17:00:12 2024 -0800

    Merge pull request #313 from LLNL/feature/bassett4/nodelist-index

    Added NodeList index to DataBase

commit 1bb48e0
Author: mdavis36 <[email protected]>
Date:   Wed Dec 11 16:43:33 2024 -0800

    Building on cray systems w/ HIP.

commit e98186a
Author: mdavis36 <[email protected]>
Date:   Wed Dec 11 16:34:41 2024 -0800

    Fixing bad merge...

commit 6b19cda
Author: mdavis36 <[email protected]>
Date:   Wed Dec 11 16:32:46 2024 -0800

    Use stamp files to stop pip from re-running every single build.

commit 3de3310
Author: Brody Richard Bassett <[email protected]>
Date:   Wed Dec 11 14:33:45 2024 -0800

    Added minloc and maxloc to fakempi

commit 87e953b
Author: Landon Owen <[email protected]>
Date:   Tue Dec 10 09:45:04 2024 -0800

    Fix TaylorImpact directory bug from previous commit

commit e5fef7e
Author: Landon Owen <[email protected]>
Date:   Mon Dec 9 17:03:16 2024 -0800

    Fix more bugs in tests

commit e3023c5
Author: Landon Owen <[email protected]>
Date:   Mon Dec 9 16:57:01 2024 -0800

    Fix bugs in tests, add multiple test runs for ci tests of performance

commit 4f16696
Merge: 5041f3e 045d728
Author: Landon Owen <[email protected]>
Date:   Mon Dec 9 15:50:45 2024 -0800

    Merge branch 'bugfix/gsph_fsisph_ci_fix' into feature/perf_assess

commit 5041f3e
Author: Landon Owen <[email protected]>
Date:   Mon Dec 9 15:48:50 2024 -0800

    Changed timer_start to timer_begin, added more performance tests, added functions to estimate number of SPH nodes for cylindrical distributions, added git hash, spheral version, and git branch to adiak data

commit 933719a
Merge: b9cfc4b e282594
Author: Brody Richard Bassett <[email protected]>
Date:   Fri Dec 6 12:50:16 2024 -0800

    Merge branch 'develop' into feature/bassett4/nodelist-index

commit 045d728
Author: jmpearl <[email protected]>
Date:   Thu Dec 5 21:42:03 2024 -0800

    updating CRKSPH constructor in Noh 3d

commit 29711ac
Author: jmpearl <[email protected]>
Date:   Thu Dec 5 21:38:06 2024 -0800

    fixing Noh tests for MFV and FSISPH

    fsisph had a bad input, mfv needed the update in the GSPHHydros.py file for the new H-update package paradigm

commit 9c1d3bb
Merge: a0c50e3 e282594
Author: mdavis36 <[email protected]>
Date:   Mon Dec 2 09:25:05 2024 -0800

    Merge branch 'develop' into feature/pip-runtime-deps

commit e282594
Merge: 4e27343 1673bb2
Author: ldowen <[email protected]>
Date:   Tue Nov 26 15:27:52 2024 -0800

    Merge pull request #309 from LLNL/feature/performance_tests

    CI Overhaul

commit 1673bb2
Author: Landon Owen <[email protected]>
Date:   Fri Nov 22 14:01:54 2024 -0800

    Cleaned up performance.py, reverted some changes to gitlab/scripts.yaml and install-from-dev-pkg, fixed recursive module bug from last commit

commit a0c50e3
Merge: ee54e3a 4e27343
Author: Michael Davis <[email protected]>
Date:   Fri Nov 22 07:05:42 2024 -0800

    Merge branch 'develop' into feature/pip-runtime-deps

commit ee54e3a
Author: mdavis36 <[email protected]>
Date:   Thu Nov 21 20:36:48 2024 -0800

    Use the ATS submodule to dictate the ATS pip build w/o git control

commit 70f56cd
Author: mdavis36 <[email protected]>
Date:   Wed Nov 20 10:43:16 2024 -0800

    Assume network connectivity, unless defined by SPHERAL_NETWORK_CONNECTED.

commit fd8f8e6
Author: mdavis36 <[email protected]>
Date:   Wed Nov 20 09:00:56 2024 -0800

    Adding ATS submodule; Fulll req file paths.

commit 500bd61
Author: mdavis36 <[email protected]>
Date:   Wed Nov 20 08:32:55 2024 -0800

    Locking pip version; Updating Dokerfile for pip changes;

commit b9cfc4b
Merge: 919283c 4e27343
Author: Brody Richard Bassett <[email protected]>
Date:   Tue Nov 19 13:23:57 2024 -0800

    Merge branch 'develop' into feature/bassett4/nodelist-index

commit 411c9c1
Author: mdavis36 <[email protected]>
Date:   Mon Nov 18 13:10:13 2024 -0800

    Using a network test to possibly skip pip download step on air-gapped systems.

commit 230c1e2
Merge: f966013 4e27343
Author: Landon Owen <[email protected]>
Date:   Mon Nov 18 11:21:43 2024 -0800

    Merge with develop

commit f966013
Author: Landon Owen <[email protected]>
Date:   Mon Nov 18 11:19:07 2024 -0800

    Fix bug where default adiak data was incorrect if mpi module had not been loaded

commit 6c5514f
Author: mdavis36 <[email protected]>
Date:   Mon Nov 18 06:39:42 2024 -0800

    Make build & runtime venv targets to perform first time install of pip package dependencies.

commit 4379c85
Merge: 5d9ea27 224c6ef
Author: Landon Owen <[email protected]>
Date:   Fri Nov 15 10:00:41 2024 -0800

    C       Merge branch 'develop' into feature/performance_tests

commit 5d9ea27
Author: Landon Owen <[email protected]>
Date:   Fri Nov 15 09:56:29 2024 -0800

    Added 3d periodic test, removed perftest option from spheral_ats.py

commit 502cf51
Author: mdavis36 <[email protected]>
Date:   Thu Nov 14 16:23:50 2024 -0800

    Nees Quotes around possible env var contents.

commit 48893dc
Merge: 4cd4016 224c6ef
Author: mdavis36 <[email protected]>
Date:   Thu Nov 14 11:26:53 2024 -0800

    Merge branch 'develop' into feature/pip-runtime-deps

commit e351eb4
Author: Landon Owen <[email protected]>
Date:   Thu Nov 14 10:28:28 2024 -0800

    Fix bugs in performance.py

commit 4cd4016
Author: mdavis36 <[email protected]>
Date:   Wed Nov 13 22:06:36 2024 -0800

    $ ENV var

commit 50289d6
Author: mdavis36 <[email protected]>
Date:   Wed Nov 13 15:58:02 2024 -0800

    Logical check when SYS_TYPE is not defined in environment.

commit 789987e
Author: mdavis36 <[email protected]>
Date:   Wed Nov 13 15:41:40 2024 -0800

    blueos pip fixes.

commit 6ad28e4
Author: Landon Owen <[email protected]>
Date:   Wed Nov 13 14:19:53 2024 -0800

    Removed lcats script

commit 10d27a4
Author: Landon Owen <[email protected]>
Date:   Wed Nov 13 14:15:41 2024 -0800

    Updated release notes

commit 50afffd
Author: mdavis36 <[email protected]>
Date:   Wed Nov 13 10:20:39 2024 -0800

    Two stage download & install process for pip into SPHERAL_PIP_CACHE_DIR; System + compiler specific cache directories; Clean targets for pip cache and envs.

commit 919283c
Author: Brody Richard Bassett <[email protected]>
Date:   Tue Nov 12 13:47:07 2024 -0800

    Added additional MPI operations

commit d8f21a2
Author: mdavis36 <[email protected]>
Date:   Tue Nov 12 12:56:04 2024 -0800

    Install pip requirements in spheral-build-env.

commit 17b12a6
Author: Landon Owen <[email protected]>
Date:   Tue Nov 12 09:29:47 2024 -0800

    Trying to fix slowdown of builds on rzgenie

commit 9edfe44
Author: mdavis36 <[email protected]>
Date:   Mon Nov 11 14:35:49 2024 -0800

    PYB11Generator, fixing broken target dependency.

commit 0ab37f3
Author: mdavis36 <[email protected]>
Date:   Mon Nov 11 14:35:20 2024 -0800

    Cleaning up spheral package.py

commit eb30005
Author: mdavis36 <[email protected]>
Date:   Mon Nov 11 14:34:48 2024 -0800

    Use system pythons on blueos + toss.

commit 72800a7
Author: mdavis36 <[email protected]>
Date:   Mon Nov 11 14:34:04 2024 -0800

    Remove hard version constraints; Pip will try to use the latest available to it.

commit 0ea7fde
Author: mdavis36 <[email protected]>
Date:   Mon Nov 11 14:33:34 2024 -0800

    Environments will utilize system installed packages if available.

commit 7786494
Author: mdavis36 <[email protected]>
Date:   Mon Nov 11 14:32:37 2024 -0800

    REQUIRE python; Stop pybind11 changing the python interpreter.

commit d6e8787
Author: Brody Richard Bassett <[email protected]>
Date:   Mon Nov 11 12:58:42 2024 -0800

    Changed assert to verify

commit 6e6d0bb
Author: Landon Owen <[email protected]>
Date:   Mon Nov 11 12:49:49 2024 -0800

    Make alloc and timeout times coincident

commit 0ddd853
Author: Landon Owen <[email protected]>
Date:   Mon Nov 11 12:48:15 2024 -0800

    Moved timeout to be part of the machine specs

commit 076f8d3
Author: Landon Owen <[email protected]>
Date:   Mon Nov 11 12:41:52 2024 -0800

    Added allocation time variable and timeout for gitlab ci

commit a6776c8
Author: Landon Owen <[email protected]>
Date:   Mon Nov 11 09:33:49 2024 -0800

    Fix typo in gitlab script

commit 609b9b3
Author: Landon Owen <[email protected]>
Date:   Mon Nov 11 09:18:41 2024 -0800

    Switched back to using cmake build for simplicity

commit b7be579
Author: Landon Owen <[email protected]>
Date:   Fri Nov 8 16:49:33 2024 -0800

    Changed build and test back to be after_script even though after_script cannot trigger a fail

commit 06da230
Author: Landon Owen <[email protected]>
Date:   Fri Nov 8 14:33:46 2024 -0800

    Split up host-config CI command to not include build call, added no-clean to host-config call in CI to avoid completely rebuilding when test is rerun

commit ffad34f
Author: mdavis36 <[email protected]>
Date:   Fri Nov 8 07:31:53 2024 -0800

    Spheral_python_env takes multiple args for requirements files; Separating build and docs requirements;

commit a6758a3
Author: mdavis36 <[email protected]>
Date:   Thu Nov 7 22:08:14 2024 -0800

    Removing python packages; Removing netlib-lapack requirement.

commit cce4461
Author: mdavis36 <[email protected]>
Date:   Thu Nov 7 21:40:39 2024 -0800

    Removing commented code; Adding build-requirements.txt; Edit gitignore to track build-requirements.

commit 7b0c7a4
Author: mdavis36 <[email protected]>
Date:   Thu Nov 7 21:34:02 2024 -0800

    Passing VIRTUAL_ENV as an argument to PYB11Generator.

commit 27ada9e
Author: mdavis36 <[email protected]>
Date:   Thu Nov 7 20:40:48 2024 -0800

    Using Python environments and pip to manage python dependencies for the build and runtime.

commit 66f8915
Merge: abedc94 7104104
Author: Brody Bassett <[email protected]>
Date:   Thu Nov 7 20:07:03 2024 -0800

    Merge branch 'develop' into feature/bassett4/nodelist-index

commit 42a1217
Author: Landon Owen <[email protected]>
Date:   Thu Nov 7 14:42:20 2024 -0800

    Explicitly set them to batch runners

commit 8b7c046
Author: Landon Owen <[email protected]>
Date:   Thu Nov 7 14:31:10 2024 -0800

    Removed shell input for machines.yaml

commit 57f644b
Author: Landon Owen <[email protected]>
Date:   Thu Nov 7 14:19:06 2024 -0800

    Fix bug in machine.yaml

commit 514f6a6
Author: Landon Owen <[email protected]>
Date:   Thu Nov 7 13:52:13 2024 -0800

    Fix issue where allocations are scheduled inside of allocations, have spheral_ats check if we are inside an allocation

commit d4c9bf7
Author: Landon Owen <[email protected]>
Date:   Wed Nov 6 16:10:04 2024 -0800

    Adding -l options to spheral-ats to hopefully remove stty error messages

commit 356c54f
Merge: 4e1d42d 7104104
Author: Landon Owen <[email protected]>
Date:   Wed Nov 6 15:19:20 2024 -0800

    Merge with develop

commit abedc94
Author: Brody Richard Bassett <[email protected]>
Date:   Wed Nov 6 14:03:06 2024 -0800

    Added NodeList index to DataBase

commit 4e1d42d
Author: Landon Owen <[email protected]>
Date:   Wed Nov 6 13:59:06 2024 -0800

    Remove pdebug queue setting in spheral-ats

commit 5ae0f31
Merge: 0db33f4 50eec5f
Author: Landon Owen <[email protected]>
Date:   Wed Nov 6 09:10:23 2024 -0800

    Merge branch 'develop' into feature/performance_tests

commit 0db33f4
Author: Landon Owen <[email protected]>
Date:   Thu Oct 31 14:52:21 2024 -0700

    Add line to docs about valgrind, fix typo in dockerfile

commit 10a4121
Author: Landon Owen <[email protected]>
Date:   Thu Oct 31 11:52:49 2024 -0700

    Added SpheralConfigs.py.in to remove files configured by CMake, brought bash executable back for spheral_ats

commit d881ac1
Author: Landon Owen <[email protected]>
Date:   Tue Oct 29 17:13:08 2024 -0700

    Added mpi for docker ats tests, improved machine config tests for spheral ats

commit 02b432f
Author: Landon Owen <[email protected]>
Date:   Tue Oct 29 09:20:51 2024 -0700

    Fix issue for running ATS on non-LC machines

commit 9f300b2
Author: Landon Owen <[email protected]>
Date:   Mon Oct 28 15:32:43 2024 -0700

    Another attempt to fix job launch ats stuff

commit a8f85c4
Author: Landon Owen <[email protected]>
Date:   Mon Oct 28 11:11:31 2024 -0700

    Make sure entire run command is in quotes to avoid bsub issue with inputs using less than symbol

commit 1ca7d9d
Author: Landon Owen <[email protected]>
Date:   Mon Oct 28 07:21:06 2024 -0700

    More bug fixes for ats arguments

commit ef2b1db
Author: Landon Owen <[email protected]>
Date:   Fri Oct 25 15:37:22 2024 -0700

    Fix ats filters passed from CMake

commit 7e89b24
Author: Landon Owen <[email protected]>
Date:   Fri Oct 25 14:31:37 2024 -0700

    Added failing test to ensure tests are working, more fixes for option parsing, removed use of None string in all existing tests, removed py-ats patch

commit 78af0ba
Author: Landon Owen <[email protected]>
Date:   Thu Oct 24 10:51:47 2024 -0700

    Updated py-ats version and added proper patch

commit b311adf
Merge: c63f8f0 6210f6d
Author: Landon Owen <[email protected]>
Date:   Wed Oct 23 17:10:57 2024 -0700

    Merge with develop

commit c63f8f0
Author: Landon Owen <[email protected]>
Date:   Wed Oct 23 17:07:01 2024 -0700

    More minor changes to tests and builds

commit 09aeaa1
Author: Landon Owen <[email protected]>
Date:   Wed Oct 23 13:20:55 2024 -0700

    Removed vector, tensor etc types as possible adiak inputs

commit 48d585d
Author: Landon Owen <[email protected]>
Date:   Wed Oct 23 13:08:14 2024 -0700

    Overhaul of interactions with ATS system, fixed hacky install of test files, changed SPHERAL_TEST_INSTALL_PREFIX to include tests directory, added tests for viz and restart files in SpheralController, created separate performance analysis python file

commit 958ebef
Merge: 4c2807b 5dd6f94
Author: Landon Owen <[email protected]>
Date:   Tue Oct 15 15:56:05 2024 -0700

    Merge branch 'develop' into feature/performance_tests

commit 4c2807b
Author: Landon Owen <[email protected]>
Date:   Mon Oct 14 15:13:45 2024 -0700

    Change cout to cerr for iterate ideal h

commit 6e2cdbd
Merge: 2622667 22c5853
Author: Landon Owen <[email protected]>
Date:   Mon Oct 14 11:02:45 2024 -0700

    Merge branch 'develop' into feature/performance_tests

commit 2622667
Author: Landon Owen <[email protected]>
Date:   Mon Oct 14 10:55:56 2024 -0700

    Fix typo in Noh-planar-1d.py

commit b297eae
Author: Landon Owen <[email protected]>
Date:   Wed Oct 9 16:54:20 2024 -0700

    Reconfigured lcats, removed cerr output for distributed files, added some new options for Noh tests, slight changes to performance.py

commit 482c5f9
Author: Landon Owen <[email protected]>
Date:   Tue Oct 8 14:11:06 2024 -0700

    Move performance.py to the correct place

commit b01e5ef
Author: Landon Owen <[email protected]>
Date:   Tue Oct 8 13:56:40 2024 -0700

    Fix issues with non-typical types being given to adiak

commit d4c1144
Author: Landon Owen <[email protected]>
Date:   Mon Oct 7 16:55:33 2024 -0700

    Slight change to testTimers

commit 1248ea6
Author: Landon Owen <[email protected]>
Date:   Mon Oct 7 16:46:59 2024 -0700

    Moved Caliper and Adiak parsing and init routines to a new SpheralTimingParser.py file instead of SpheralOptionParser.py, added ability to specify Adiak data directly from command line as a dictionary, update testTimer with adiakData tests and improved layout

commit 4b581fd
Author: Landon Owen <[email protected]>
Date:   Thu Oct 3 14:25:31 2024 -0700

    Fix testTimers

commit 064004b
Merge: 6e15a5a 8f84b7e
Author: Landon Owen <[email protected]>
Date:   Thu Oct 3 13:48:40 2024 -0700

    Merge with develop

commit 6e15a5a
Author: Landon Owen <[email protected]>
Date:   Thu Oct 3 13:46:21 2024 -0700

    Made adiak python wrapping more general, automatically add commandLine inputs to adiak, updated testTimer to reflect these changes

commit 4fd9292
Author: Landon Owen <[email protected]>
Date:   Thu Oct 3 08:47:35 2024 -0700

    Removed yaml method and TPL, fixed missed variable in spheraloptionparser from previous commit

commit 2565a85
Author: Landon Owen <[email protected]>
Date:   Tue Oct 1 14:20:31 2024 -0700

    Add configuration strings to host config file through spack, begin creation of test_list.yaml, add py-pyyaml as a new TPL to be able to read in the performance test list
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants