Checklist for release

[mschubert]

This all concerns the develop branch and should not impact users on master or the stable CRAN release.

• Q(... template=list(...)) does not submit jobs issue with ~ expansion on log files, using normalizePath to avoid
• Ctrl+c hangs when used to interrupt polling was locked in compiled code for excessive memory test, beyond the scope of this release
• multiprocess test is "unable to terminate some child processes" (cf. e.g. Error while shutting down parallel: unable to terminate some child processes r-lib/processx#240, Error while shutting down parallel: unable to terminate some child processes r-lib/processx#236)
  • mclapply makes callr "Error while shutting down parallel" r-lib/callr#158
  • Test on Windows can not test multicore, callr together because of Error while shutting down parallel: unable to terminate some child processes r-lib/processx#236
• Consider QSys automatically adding log splitters (e.g. %a on Slurm)
• Clean up doc references to rzmq
• Make sure qsys_impl tests do not create logs with CRAN tests
• Check fix issue with formating of object size #199
• foreach may export objects twice #200
• Manually test SSH in real setting
• Clean up "run in container" docs
• Check Winbuilder
• Check if PBS/Torque default log file names work

Optional

• Enable logging for multicore (Enable logging of multicore workers #169), multiprocess
• Test and document SSH from Windows (Make ssh work on Windows #84, Trying to run clustermq on Windows 10 using SSH and Slurm #166)
• Document all available options in one place
• Add Contributing section to README

[mschubert]

@mstr3336 I've updated the PBS scheduler to produce cmq-specific default log names, using $PBS_ARRAY_INDEX as per PBS User Guide, page 160. Can you confirm this works?

remotes::install_github("mschubert/clustermq", ref="develop")
clustermq::Q(function(x) x*2, x=1:5, n_jobs=1, log_worker=T) # should create cmqXXXX-1.log in $(pwd)

[strazto]

Looks awesome, I'll test it out on the HPC soon