Skip to content

Commit

Permalink
Merge pull request #100 from danmcp/mergesystemusermessage
Browse files Browse the repository at this point in the history
Default to merge_system_user_message if mistral model detected
  • Loading branch information
danmcp authored Aug 19, 2024
2 parents 716e7b1 + 58f7c9d commit 515263a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/instructlab/eval/mt_bench_common.py
Original file line number Diff line number Diff line change
Expand Up @@ -254,7 +254,7 @@ def chat_completion_openai(
try:
messages = conv.to_openai_api_messages()
if (
merge_system_user_message
(merge_system_user_message or conv.name == "mistral")
and messages[0]["role"] == "system"
and messages[1]["role"] == "user"
):
Expand Down

0 comments on commit 515263a

Please sign in to comment.