Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Wrong tool prompt format for RAG examples #195

Open
2 tasks
dmartinol opened this issue Feb 28, 2025 · 0 comments · May be fixed by #196
Open
2 tasks

Wrong tool prompt format for RAG examples #195

dmartinol opened this issue Feb 28, 2025 · 0 comments · May be fixed by #196

Comments

@dmartinol
Copy link

System Info

not relevant

Information

  • The official example scripts
  • My own modified scripts

🐛 Describe the bug

Due to changes in meta-llama/llama-stack#937, the expected tool prompt format has changed to python_list.

Error replicated with rag_as_attachments.py and rag_with_vector_db.py

Error logs

  File "../llama_stack/providers/utils/inference/prompt_adapter.py", line 424, in augment_messages_for_tools_llama_3_2
    raise ValueError(f"Non supported ToolPromptFormat {request.tool_config.tool_prompt_format}")
ValueError: Non supported ToolPromptFormat ToolPromptFormat.json

Expected behavior

Examples should work with no errors.
@dmartinol dmartinol linked a pull request Feb 28, 2025 that will close this issue
Open
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: Fixing tool prompt format dmartinol/llama-stack-apps
1 participant
@dmartinol