Chinese Performance
Chinese Scores by Model
 8B 75 |
 9B 68.52 |
0.6B 67.45 |
 0.6B 61.96 |
 0.6B 60.79 |
 7B 60.51 |
0.6B 60.47 |
0.6B 58.24 |
0.3B 58.20 |
0.6B - |
6B - |
 7B - |
 0.3B - |
0.5B - |
0.1B - |
 0.3B - |
 - |
 - |
 - |
Chinese Competencies
Model | ZH | Retrieval | Reranking | Semantic Textual Similarity | Pair Classification | Clustering | Classification |
|---|---|---|---|---|---|---|---|
Qwen3 Embedding 8B Alibaba | 75.00 | 78.21 | 66.99 | 63.53 | 84.23 | 80.08 | 76.97 |
 BGE-Multilingual-Gemma2 9B Beijing Academy of Artificial Intelligence | 68.52 | 73.73 | 68.28 | 55.19 | 79.30 | 59.30 | 75.31 |
Qwen3 Embedding 0.6B Alibaba | 67.45 | 71.03 | 62.58 | 54.52 | 76.42 | 68.74 | 71.40 |
jina-embeddings-v3 0.6B Jina AI | 61.96 | 68.54 | 60.72 | 55.13 | 67.22 | 50.22 | 69.92 |
SEA-LION Embedding E5 0.6B AISG | 60.79 | 65.02 | 60.67 | 48.79 | 66.56 | 52.69 | 71.02 |
E5 Mistral Instruct (e5-mistral-7b-instruct) 7B Microsoft | 60.51 | 61.75 | 61.38 | 48.34 | 66.31 | 52.30 | 72.96 |
SEA-LION ModernBERT Embedding 0.6B AISG | 60.47 | 63.85 | 59.55 | 48.24 | 66.80 | 52.98 | 71.42 |
Multilingual E5 (multilingual-e5-large) 0.6B Microsoft | 58.24 | 63.65 | 57.45 | 45.81 | 64.52 | 48.23 | 69.80 |
SEA-LION ModernBERT Embedding 0.3B AISG | 58.20 | 59.04 | 56.27 | 46.37 | 65.05 | 51.17 | 71.28 |
Multilingual E5 Instruct (multilingual-e5-large-instruct) 0.6B Microsoft | — | 6494.00 | 6066.00 | 5040.00 | — | — | 70.74 |
BGE-M3 6B Beijing Academy of Artificial Intelligence | — | 55.65 | 73.01 | 80.60 | — | — | — |
GritLM 7B GritLM | — | 65.08 | 61.37 | 49.28 | — | — | 74.81 |
paraphrase-multilingual-mpnet-base-v2 0.3B UKP Lab | — | 22.92 | 44.91 | 38.10 | — | — | 66.04 |
LaBSE 0.5B UKP Lab | — | 21.83 | 39.33 | 36.84 | — | — | 66.90 |
paraphrase-multilingual-MiniLM-L12-v2 0.1B UKP Lab | — | 24.51 | 44.33 | 37.37 | — | — | 63.06 |
EmbeddingGemma 0.3B | — | 78.93 | 67.54 | 80.17 | — | — | — |
Cohere embed-multilingual-v3.0 CohereLabs | — | 53.66 | 70.91 | 80.81 | — | — | — |
voyage-3 Voyage AI | — | 61.65 | 73.25 | 64.81 | — | — | — |
 text-embedding-3-small OpenAI | — | 41.45 | 65.12 | 75.24 | — | — | — |