Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Option to delete input files in sourceFileSystem #77

Open
kretep opened this issue Nov 4, 2021 · 1 comment
Open

Option to delete input files in sourceFileSystem #77

kretep opened this issue Nov 4, 2021 · 1 comment
Assignees

Comments

@kretep
Copy link
Contributor

kretep commented Nov 4, 2021

I would like to be able to delete the input files that are in the sourceFileSystem, after a job has completed or failed.

@bpmweel bpmweel self-assigned this Nov 4, 2021
@bpmweel
Copy link
Contributor

bpmweel commented Nov 5, 2021

I have implemented this in the main branch, please try it out before I make a release out of it.

You can add clearOnJobDone: true to the sourceFileSystem block in the config file. It deletes any files that are actual inputs to the workflow from that directory. So I wouldn't use it if you reuse files in the sourceFileSystem.

It does not (and cannot) delete any directories you may have created in the sourceFileSystem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants