Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch processing interface #288

Merged
merged 22 commits into from
Jan 29, 2025
Merged

Batch processing interface #288

merged 22 commits into from
Jan 29, 2025

Conversation

thobson88
Copy link
Collaborator

Adds a BatchJob class and batch-job script.

After activating the environment with poetry shell and installing T-Res with poetry install, the batch processing script can be called with the batch-job command.

Call with the -h flag to see the list of required arguments:

$ batch-job -h
usage: batch-job [-h] config_file input_file resources_path results_path [place_of_pub_file]

Run a T-Res batch job.

positional arguments:
  config_file        Path to the YAML batch job config file.
  input_file         Path to the input CSV data file.
  resources_path     Path to the resources directory.
  results_path       Path to the results directory.
  place_of_pub_file  [Optional] Path to the place of publication CSV data file. Must include
                     columns named "Wikidata ID" and "Location"

optional arguments:
  -h, --help         show this help message and exit

@thobson88 thobson88 merged commit 5bd701e into 276-refactor Jan 29, 2025
1 check passed
@thobson88 thobson88 deleted the 286-batch-processing branch January 29, 2025 09:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant