Skip to content

Commit

Permalink
Merge pull request #305 from alimaredia/mmlu-branch-yaml-group-to-tag
Browse files Browse the repository at this point in the history
fix: change "group" to "tag" for mmlu_branch task config
  • Loading branch information
mergify[bot] authored Oct 14, 2024
2 parents 288dbaf + e87062c commit ac63e8c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/instructlab/sdg/eval_data.py
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ def _create_mmlu_evaluation_task(task_name, eval_data_file_path, yaml_file_path)
}
],
"dataset_kwargs": {"data_files": {"test": eval_data_file_path}},
"group": "mmlu_pr",
"tag": "mmlu_pr",
}
with open(yaml_file_path, "w", encoding="utf-8") as yaml_file:
yaml.dump(task_yaml, yaml_file, default_flow_style=False)
Expand Down

0 comments on commit ac63e8c

Please sign in to comment.