Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Server vs local #38

Open
fnattino opened this issue May 12, 2023 · 1 comment
Open

Server vs local #38

fnattino opened this issue May 12, 2023 · 1 comment

Comments

@fnattino
Copy link
Contributor

fnattino commented May 12, 2023

Right now this repository needs to be cloned on both server and local sides. It would be ideal if one would have to dowload it only locally, so that users can tune parameters and scripts (dask configuration files, job submission scripts, environment file), with these being pushed to the supercomputer.

Also, right now it is not super clear which components are needed for the local setting and which for the remote:

  • the environment requirements for the local system are not specified, and one can mistakenly assume the environment.yml is for local settings. For this, we should improve the packaging of the installation/deployment scripts and maybe place the environment file is some subdirectory.
  • the platform config file (needed locally) is stored together with the config file of Dask/Jupyter (needed remotely)
@fnattino
Copy link
Contributor Author

Related: the environment file here should probably only contain the minimal dependencies (Jupyter, Dask, dCache-related tools). User-specific packages could be added by modifying the local environment file, if this is then pushed to the remote for configuration. A different question is can we support multiple environments (#40 )?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant