SEA-HELM Leaderboard

SEA Performance

Jul 10, 2026

Overall SEA Average

Language Performance by Model

Model	ID	TH	VI	FIL	MY	TA	KM	MS	LO	TET
SEA-LION Embedding E5 0.6B AISG	80.82	81.34	79.54	80.77	78.46	80.64	79.68	85.29	84.05	69.67
GritLM 7B Contextual AI	80.47	72.84	77.37	45.05	77.49	60.42	52.58	78.41	30.07	69.66
EmbeddingGemma 0.3B Google	80.19	80.58	76.40	70.42	57.11	76.10	64.07	79.19	53.01	67.32
Qwen3 Embedding 8B Alibaba	79.73	81.49	78.99	74.91	78.05	75.95	75.46	82.39	78.20	67.44
Embed v3 Multilingual CohereLabs	79.72	80.98	78.93	76.13	78.99	78.87	77.01	82.42	83.34	66.75
Multilingual E5 Large Instruct 0.6B Microsoft	79.50	81.11	78.00	78.37	79.19	77.09	78.13	84.60	83.94	69.40
text-embedding-3-small OpenAI	78.34	55.24	70.06	32.79	68.08	35.38	30.15	69.78	23.97	65.09
BGE M3 6B Beijing Academy of Artificial Intelligence	78.09	77.59	75.91	73.12	75.78	77.51	76.23	82.54	82.26	65.53
Jina Embeddings v3 0.6B Jina AI	77.35	78.64	76.10	75.11	74.25	76.14	74.73	77.91	77.91	65.11
KaLM Embedding v2.5 0.5B Harbin Institute of Technology	76.80	74.00	74.80	40.30	64.30	51.30	34.20	69.10	25.90	66.60
voyage-3 Voyage AI	75.56	69.78	73.68	48.19	71.43	67.28	35.02	69.13	24.27	61.48
LaBSE 0.5B UKP Lab	73.98	70.20	72.60	73.63	76.99	76.59	74.06	82.87	79.84	69.11

No records

SEA Competencies

Model	SEA	Multilabel Classification	Bitext Mining	Instruction Retrieval	QA Retrieval	Reranking	Classification	Semantic Textual Similarity	Pair Classification	Clustering
SEA-LION Embedding E5 0.6B AISG	80.03	89.41	89.59	69.98	77.78	78.11	76.06	76.52	67.28	53.98
Multilingual E5 Large Instruct 0.6B Microsoft	78.93	87.84	87.86	69.10	77.16	77.24	77.70	75.59	66.58	58.09
Embed v3 Multilingual CohereLabs	78.31	89.98	88.32	65.59	78.17	77.77	78.52	73.11	66.11	48.99
Qwen3 Embedding 8B Alibaba	77.26	90.57	84.78	70.81	81.99	78.51	78.60	75.31	63.10	52.93
BGE M3 6B Beijing Academy of Artificial Intelligence	76.46	89.89	86.18	58.51	73.56	75.98	75.98	73.27	68.73	42.23
Jina Embeddings v3 0.6B Jina AI	75.33	88.97	81.86	69.11	76.28	72.49	77.40	73.17	63.61	50.90
LaBSE 0.5B UKP Lab	74.99	86.65	86.84	39.73	53.72	61.23	75.19	68.32	62.32	41.39
EmbeddingGemma 0.3B Google	70.44	89.19	72.87	70.72	77.13	78.44	77.25	68.13	69.60	40.22
GritLM 7B Contextual AI	64.44	88.76	63.63	67.60	65.97	73.37	77.47	64.69	63.86	46.29
voyage-3 Voyage AI	59.58	88.70	55.62	61.77	62.91	74.62	75.72	61.97	60.23	45.15
KaLM Embedding v2.5 0.5B Harbin Institute of Technology	57.70	72.30	61.00	87.50	63.50	73.10	74.20	51.50	45.90	62.30
text-embedding-3-small OpenAI	52.89	88.19	43.12	52.87	65.18	71.25	72.88	52.31	60.16	39.34

No records