You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I set up Neo4j KGBuilder on my Ubuntu22, and find that the answer relevancy metric is worse with Chinese, and I find out at last that the cause is that the questions generated by LLM is in English, not in Chinese, so the embedding of them are quite different with the original question in Chinese.
I'v posted an issue and the solution to the ragas project's home page at here: Answer relevancy metric is worse in languages other than English, please read it for details.
I think a solution for all languages and all metrics is needed.
Best regards
Jean from China
The text was updated successfully, but these errors were encountered:
I set up Neo4j KGBuilder on my Ubuntu22, and find that the answer relevancy metric is worse with Chinese, and I find out at last that the cause is that the questions generated by LLM is in English, not in Chinese, so the embedding of them are quite different with the original question in Chinese.
I'v posted an issue and the solution to the ragas project's home page at here: Answer relevancy metric is worse in languages other than English, please read it for details.
I think a solution for all languages and all metrics is needed.
Best regards
Jean from China
The text was updated successfully, but these errors were encountered: