fix: Fixing tool prompt format

[dmartinol]

What does this PR do?

Closes #195

Feature/Issue validation/testing/test plan

Start llama-stack server, then:

 python -m examples.agents.rag_with_vector_db localhost 8321
 python -m examples.agents.rag_as_attachments localhost 8321

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline,
  Pull Request section?
• Was this discussed/approved via a Github issue? Please add a link
  to it if that's the case.
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?

Thanks for contributing 🎉!

[ehhuang]

You should be able to just remove this since we added meta-llama/llama-stack#1214

[dmartinol]

I see, thank you! I will update it asap
BTW: is there any way to be informed of the ongoing/planned changes before pushing PRs that are already out-of-date? 😬

[ehhuang]

I don't know if there's a better way but I just look at open PRs periodically and check github notifications.

BTW I do plan to do a full clean up of tool_prompt_format as well.

[dmartinol]

BTW: I tried to remove the prompt format but resolve_model fails to resolve the model so the default prompt is still json 😞

These are the models I'm using:

% llama-stack-client models list

Available Models

┏━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ model_type ┃ identifier       ┃ provider_resource_id ┃ metadata                 ┃ provider_id ┃
┡━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ embedding  │ all-MiniLM-L6-v2 │ all-minilm:latest    │ {'embedding_dimension':  │ ollama      │
│            │                  │                      │ 384.0}                   │             │
├────────────┼──────────────────┼──────────────────────┼──────────────────────────┼─────────────┤
│ llm        │ llama3.2:1b      │ llama3.2:1b          │                          │ ollama      │
└────────────┴──────────────────┴──────────────────────┴──────────────────────────┴─────────────┘

Total models: 2

Changing the check to compare lower-cased strings seems to work, but I'm not sure it may break something else:

    for m in all_registered_models():
        if descriptor.lower in (m.descriptor().lower(), m.huggingface_repo):
            return m
    return None

[ehhuang]

ok let's get this in first

[ehhuang]

@dmartinol where are you getting llama3.2:1b? It seems to be in the wrong format

[ehhuang]

[dmartinol]

ollama run llama3.2:1b, is that wrong?

[ehhuang]

anyhow meta-llama/llama-stack#1360 should fix this

[dmartinol]

I will try again and clear the setting.