onMessage in React SDK isn't firing

[rblalock]

Below is the hook call. The other hooks fire correctly

  const conversation = useConversation({
    onConnect: () => {
      console.log("Connected to ElevenLabs voice agent");
      toast({
        title: "Connected",
        description: "Voice agent is ready to chat",
      });
    },
    onDisconnect: () => {
      console.log("Disconnected from ElevenLabs voice agent");
      toast({
        title: "Disconnected",
        description: "Voice agent connection ended",
      });
    },
    onMessage: (message) => {
      console.log("Received message:", message);
    },
    onError: (error) => {
      console.error("Voice agent error:", error);
      toast({
        title: "Error",
        description: "There was an error with the voice agent",
        variant: "destructive",
      });
    },
  });

[simonschmalfeld]

Did you try using a different model? I had the same problem with Gemini 1.5 Flash, but don't have it with e.g. Gemini 1.5 Pro or others.

[louisjoecodes]

We're noticing some issues with Gemini specifically around tool calling as well - recommend switching over to gpt4o for the time being!

Also make sure that the Client Events for these messages types (for example agent_response) are active in the Advanced tab in the dashboard.

[logan-jobzmall]

Having the same issue here. The latency is amazing for Flash, but it does not consistently call client functions. Gemini 1.5 Pro works well but the latency is horrible and it feels like I am waiting for quite a while as well.

We're noticing some issues with Gemini specifically around tool calling as well - recommend switching over to gpt4o for the time being!

Also make sure that the Client Events for these messages types (for example agent_response) are active in the Advanced tab in the dashboard.