You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
First of tall thank you so much for releasing this awesome model.
We want to include Snowflake-Arctic in our study, and we need to have detailed accuracy metrics for individual benchmarks. The official article syas that the "Common Sense" metric is an average of 11 metrics, and the "Coding" category also appears to be an average of HumanEval and MBPP. Could you provide the detailed scores for these individual benchmarks?
Thanks!
The text was updated successfully, but these errors were encountered:
Hi,
First of tall thank you so much for releasing this awesome model.
We want to include Snowflake-Arctic in our study, and we need to have detailed accuracy metrics for individual benchmarks. The official article syas that the "Common Sense" metric is an average of 11 metrics, and the "Coding" category also appears to be an average of HumanEval and MBPP. Could you provide the detailed scores for these individual benchmarks?
Thanks!
The text was updated successfully, but these errors were encountered: