Skip to content

Commit

Permalink
Faithfulness prompt update to avoid having single quotes in response
Browse files Browse the repository at this point in the history
  • Loading branch information
michaelromagne committed Jan 23, 2025
1 parent f5bc2b5 commit ef8a536
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/ragas/metrics/_faithfulness.py
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ class NLIStatementInput(BaseModel):


class NLIStatementPrompt(PydanticPrompt[NLIStatementInput, NLIStatementOutput]):
instruction = "Your task is to judge the faithfulness of a series of statements based on a given context. For each statement you must return verdict as 1 if the statement can be directly inferred based on the context or 0 if the statement can not be directly inferred based on the context."
instruction = "Your task is to judge the faithfulness of a series of statements based on a given context. For each statement you must return verdict as 1 if the statement can be directly inferred based on the context or 0 if the statement can not be directly inferred based on the context. Do not use single quotes in your response but double quotes, properly escaped with a backslash."
input_model = NLIStatementInput
output_model = NLIStatementOutput
examples = [
Expand Down

0 comments on commit ef8a536

Please sign in to comment.