Demo application doesn't run

[Tejaswgupta]

I setup the demo using gpt-4o-mini and BraveSearch but it never goes ahead of the first step.

The server terminal just keeps printing blank spaces.

Am i missing something?

[braisedpork1964]

The default system prompts with tool invocation protocol are not easy for models other than InternLM2.5-Chat to follow. I think someone got the same problem after switching to GPT4.

A possible solution is to concatenate the system prompt and fewshot prompt, and loosen the begin and end pattern of tool parsers. See #249 (comment)