Skip to content

meeting July 2nd 2020

Kenneth Hoste edited this page Jul 2, 2020 · 12 revisions
  • date & time: July 2nd 2020 - 3pm CEST (1pm UTC)
  • venue: (online)
  • agenda:
    1. Short introduction by new partners (if any)
      • ...
    2. Logo, website, docs, Twitter
    3. Feedback on HPCKP'20 talk [Kenneth]
    4. Update on filesystem layer [Bob, Thomas, Jaco]
    5. Update on compatibility layer [Bob, Peter]
    6. Update on software layer [Kenneth, Caspar, Alan]
    7. Pilot setup [Kenneth]
      1. Applying for resources within the Fenix Infrastructure (deadline 13 July) [Alan]
    8. Software licenses [Kenneth]
    9. What to do with our new members (meetings/mailing list)? [All]
    10. Who does what the coming weeks?

Slides

Short introduction by new people

  • Maxim (SURF) briefly introduced himself, planned to help out with software layer (together with Caspar)
  • Davide (Microsoft) joining as EasyBuild maintainer

Feedback on HPCKP'20 talk

Progress in last month

Logo, website, docs, Twitter

Filesystem layer (Bob)

Compatibility layer (Bob, Peter)

  • experimenting with Gentoo Prefix bootstrap installation
    • bootstrap script is not 100% reliable
      • ran into issues with broken bzip2 installation, circular dependency, silly typos, ...
      • not all problems are caught upstream quickly (although they do have some CI setup)
      • but response from Prefix developers in case of problems is really quick
    • we may need a better way of controlling the Prefix, especially for a production setup
      • Alex: using snapshot of Prefix repository may help
      • current approach of getting Prefix installed with bootstrap script and hoping for the best is good enough for pilot setup?
      • contact Prefix mailing list to ask about how we could get more control over the installation mechanism if we wanted to?
  • Prefix installation for pilot setup now available at /cvmfs/pilot.eessi-hpc.org/test/gentoo/2020/startprefix
  • planning to leverage ComputeCanada's gentoo-overlay repository for additional Gentoo packages (ebuilds)
  • Lua + Lmod is now a manual installation (not part of Prefix)

Software layer (Kenneth, Caspar, Alan)

  • brainstorm sessions with Kenneth/Caspar/Alan on June 9th and June 26th on organizing software-layer repo
    • planning to leverage easyconfigs/easyblocks from EasyBuild release as much as possible
    • customization specific to EESSI project via EasyBuild hooks
    • only include easyconfigs/easyblocks in software-layer repo if we have to
      • try to actively contribute back to central EasyBuild repositories
  • working on script that consumes a "build list" which defines the software stack + script to process it
  • also working on init script to easily set up environment to start using the EESSI software stack

Pilot setup

Software licenses

  • Which license do we use for the scripts we produce ourselves?
    • need to take into account projects we leverage (anything that leverages EasyBuild => GPLv2)
  • Some control mechanism to ensure we don't redistribute software we're not allowed to?

New project members

  • Anyone who submits a join request via https://www.eessi-hpc.org/join/ is added to Slack + mailing list and is welcome to join the meetings
  • also outside of Europe
  • active contributors can get write permissions to GitHub repositories at some point

Who works on what in coming weeks?

  • Kenneth: software layer (driver script + init script), but also 3 weeks of vacation
  • Caspar/Maxim: software layer
  • Xavier: testing in different layers
    • has expertise with OpenFOAM, useful for pilot setup
  • Mark: test filesystem in OpenStack cloud env
  • Thomas: more testing with filesystem and compatibility layer
    • national project in Norway w.r.t. setting up shared software stack
    • hope to get people involved in EESSI in that context
  • Henk-Jan:
    • University of Groningen has agreed to fund infrastructure for pilot phase of EESSI w.r.t. hosting Stratum-0
Clone this wiki locally