Filipino Performance

Filipino Scores by Model

Average of 30 bootstraps. 95% CI are shown.

Model Size: ≤200B

Open instruct models only

AISG logo
AISG logo
SEA-LION v4 (Gemma)
27B
68.10±0.14
Google logo
Google logo
Gemma 3
27B
67.70±0.12
Alibaba logo
Alibaba logo
Qwen 3 Next
80B
MoE
66.48±0.13
AISG logo
AISG logo
SEA-LION v3 (Llama)
70B
66.38±0.17
AISG logo
AISG logo
SEA-LION v4 (Qwen)
32B
65.35±0.14
Google logo
Google logo
Gemma 3
12B
65.00±0.11
Meta logo
Meta logo
Llama 3.3
70B
63.21±0.11
AI2 logo
AI2 logo
Tulu 3
70B
62.96±0.24
Alibaba logo
Alibaba logo
Qwen 3
32B
62.23±0.13
Alibaba logo
Alibaba logo
Qwen 2.5
72B
61.94±0.13
Meta logo
Meta logo
Llama 4 Scout
109B
MoE
61.84±0.11
Meta logo
Meta logo
Llama 3.1
70B
61.82±0.17
Alibaba logo
Alibaba logo
Qwen 3
30B
MoE
61.39±0.12
Google logo
Google logo
Gemma 2
27B
61.19±0.16
AISG logo
AISG logo
SEA-LION v3 (Gemma 2)
9B
60.75±0.22
Mistral AI logo
Mistral AI logo
Mistral Large 2411
123B
58.98±0.15
Alibaba logo
Alibaba logo
Qwen 3
14B
57.37±0.13
Alibaba logo
Alibaba logo
Qwen 2.5
32B
56.49±0.16
Google logo
Google logo
Gemma 2
9B
53.79±0.17
AI2 logo
AI2 logo
Olmo 2 0325
32B
53.00±0.24
Meta logo
Meta logo
Llama 3
70B
52.32±0.14
A*STAR logo
A*STAR logo
MERaLiON 2
10B
52.26±0.20
SAIL logo
SAIL logo
Sailor2
20B
51.82±0.15
Alibaba logo
Alibaba logo
Qwen 2.5
14B
51.62±0.12
SAIL logo
SAIL logo
Sailor2
8B
51.41±0.16
Alibaba logo
Alibaba logo
Qwen 3
8B
50.42±0.16
CohereLabs logo
CohereLabs logo
Command A 03-2025
111B
49.22±0.21
AISG logo
AISG logo
SEA-LION v3 (Llama)
8B
49.07±0.22
CohereLabs logo
CohereLabs logo
Aya Expanse
32B
47.65±0.13
Mistral AI logo
Mistral AI logo
Mistral Small 3.1 2503
24B
47.51±0.33
Baidu logo
Baidu logo
ERNIE 4.5
21B
MoE
45.78±0.35
CohereLabs logo
CohereLabs logo
Command R+ 08-2024
104B
45.26±0.29
Meta logo
Meta logo
Llama 3.1
8B
39.63±0.22
CohereLabs logo
CohereLabs logo
Command R 08-2024
32B
38.24±0.25
Alibaba logo
Alibaba logo
Qwen 2.5
7B
38.20±0.16
AI2 logo
AI2 logo
Olmo 2 1124
13B
35.13±0.29
Swiss AI logo
Swiss AI logo
Apertus
70B
34.68±0.29
AI2 logo
AI2 logo
Tulu 3
8B
33.94±0.24
Meta logo
Meta logo
Llama 3
8B
30.16±0.15
Alibaba-DAMO logo
Alibaba-DAMO logo
Babel
83B
29.79±0.41
Microsoft logo
Microsoft logo
phi-4
14B
29.72±0.23
CohereLabs logo
CohereLabs logo
Aya Expanse
8B
29.70±0.16
Alibaba-DAMO logo
Alibaba-DAMO logo
Babel
9B
27.56±0.27
Alibaba-DAMO logo
Alibaba-DAMO logo
SeaLLMs V3
7B
26.67±0.34
CohereLabs logo
CohereLabs logo
Command R7B 12-2024
7B
25.28±0.33
Swiss AI logo
Swiss AI logo
Apertus
8B
23.09±0.39
Mistral AI logo
Mistral AI logo
Ministral 2410
8B
19.24±0.35
AI2 logo
AI2 logo
Olmo 2 1124
7B
14.84±0.19

Filipino Competencies

Average of 30 bootstraps. 95% CI are shown.

Model Size: ≤200B

Open instruct models only

Model
TL
Cultural
Instruction Following
Multi-Turn Chat
NLG
NLR
NLU
Safety
Knowledge
AISG logo
AISG logo
SEA-LION v4 (Gemma)
27B

AISG

68.10

± 0.14

82.98

± 0.17

88.86

± 0.75

47.05

± 0.62

55.60

± 0.05

72.06

± 0.12

70.56

± 0.29

62.67

± 0.42

65.01

± 0.33

Google logo
Google logo
Gemma 3
27B

Google

67.70

± 0.12

82.56

± 0.18

87.49

± 0.69

45.07

± 0.59

55.54

± 0.05

71.77

± 0.15

70.64

± 0.18

63.20

± 0.34

65.34

± 0.23

Alibaba logo
Alibaba logo
Qwen 3 Next
80B
MoE

Alibaba

66.48

± 0.13

83.11

± 0.19

87.27

± 0.53

49.71

± 0.67

51.76

± 0.05

70.82

± 0.13

73.20

± 0.11

49.55

± 0.31

66.38

± 0.25

AISG logo
AISG logo
SEA-LION v3 (Llama)
70B

AISG

66.38

± 0.17

87.63

± 0.55

92.79

± 0.63

26.57

± 0.70

57.66

± 0.07

72.94

± 0.34

67.54

± 0.38

54.65

± 0.87

71.22

± 0.34

AISG logo
AISG logo
SEA-LION v4 (Qwen)
32B

AISG

65.35

± 0.14

82.94

± 0.26

87.05

± 0.62

38.46

± 0.74

54.04

± 0.05

73.68

± 0.12

73.37

± 0.18

52.93

± 0.48

60.32

± 0.14

Google logo
Google logo
Gemma 3
12B

Google

65.00

± 0.11

82.03

± 0.25

87.56

± 0.68

42.67

± 0.71

54.69

± 0.06

70.81

± 0.16

67.30

± 0.17

56.23

± 0.45

58.72

± 0.19

Meta logo
Meta logo
Llama 3.3
70B

Meta

63.21

± 0.11

83.08

± 0.16

91.43

± 0.33

14.99

± 0.52

55.51

± 0.07

73.40

± 0.15

68.79

± 0.19

49.95

± 0.46

68.52

± 0.24

AI2 logo
AI2 logo
Tulu 3
70B

AI2

62.96

± 0.24

82.12

± 0.47

82.76

± 0.81

27.63

± 0.74

53.46

± 0.10

74.86

± 0.24

73.84

± 0.32

47.35

± 0.87

61.67

± 0.52

Alibaba logo
Alibaba logo
Qwen 3
32B

Alibaba

62.23

± 0.13

77.81

± 0.38

82.32

± 0.58

34.02

± 0.78

51.44

± 0.07

67.39

± 0.24

72.85

± 0.35

52.45

± 0.44

59.58

± 0.31

Alibaba logo
Alibaba logo
Qwen 2.5
72B

Alibaba

61.94

± 0.13

82.11

± 0.28

83.33

± 0.68

28.75

± 0.61

49.53

± 0.05

67.88

± 0.23

72.49

± 0.25

43.55

± 0.50

67.90

± 0.32

Meta logo
Meta logo
Llama 4 Scout
109B
MoE

Meta

61.84

± 0.11

86.63

± 0.00

92.76

± 0.57

22.08

± 0.65

54.96

± 0.04

62.99

± 0.09

66.60

± 0.09

38.83

± 0.17

69.90

± 0.11

Meta logo
Meta logo
Llama 3.1
70B

Meta

61.82

± 0.17

83.46

± 0.52

86.19

± 0.89

12.03

± 0.50

56.99

± 0.10

71.91

± 0.32

67.39

± 0.31

49.98

± 0.77

66.61

± 0.42

Alibaba logo
Alibaba logo
Qwen 3
30B
MoE

Alibaba

61.39

± 0.12

87.98

± 0.16

83.84

± 0.52

42.05

± 0.54

50.60

± 0.06

66.06

± 0.13

68.75

± 0.18

33.43

± 0.11

58.43

± 0.23

Google logo
Google logo
Gemma 2
27B

Google

61.19

± 0.16

82.65

± 0.35

77.40

± 0.80

16.15

± 0.65

56.00

± 0.07

68.27

± 0.29

71.20

± 0.28

59.33

± 0.43

58.55

± 0.52

AISG logo
AISG logo
SEA-LION v3 (Gemma 2)
9B

AISG

60.75

± 0.22

85.99

± 0.56

84.38

± 0.70

22.60

± 0.67

54.56

± 0.06

66.13

± 0.35

71.44

± 0.37

49.42

± 0.54

51.50

± 0.49

Mistral AI logo
Mistral AI logo
Mistral Large 2411
123B

Mistral AI

58.98

± 0.15

82.90

± 0.50

76.19

± 1.03

16.93

± 0.60

53.92

± 0.11

67.63

± 0.44

67.46

± 0.43

50.85

± 0.72

55.93

± 0.44

Alibaba logo
Alibaba logo
Qwen 3
14B

Alibaba

57.37

± 0.13

78.53

± 0.31

77.52

± 0.66

23.13

± 0.53

50.19

± 0.07

61.24

± 0.21

70.68

± 0.23

46.93

± 0.23

50.74

± 0.26

Alibaba logo
Alibaba logo
Qwen 2.5
32B

Alibaba

56.49

± 0.16

78.61

± 0.23

78.35

± 0.99

14.70

± 0.35

46.52

± 0.09

59.49

± 0.15

68.54

± 0.19

46.73

± 0.28

59.01

± 0.21

Google logo
Google logo
Gemma 2
9B

Google

53.79

± 0.17

76.23

± 0.58

78.32

± 0.93

10.96

± 0.41

52.66

± 0.10

60.91

± 0.26

63.52

± 0.47

36.77

± 0.26

50.93

± 0.41

AI2 logo
AI2 logo
Olmo 2 0325
32B

AI2

53.00

± 0.24

81.47

± 0.60

69.17

± 0.96

11.12

± 0.42

46.45

± 0.14

55.24

± 0.37

69.10

± 0.43

43.80

± 0.65

47.60

± 0.59

Meta logo
Meta logo
Llama 3
70B

Meta

52.32

± 0.14

83.01

± 0.38

30.60

± 0.73

10.56

± 0.58

55.48

± 0.06

66.65

± 0.18

64.82

± 0.21

48.33

± 0.52

59.07

± 0.28

A*STAR logo
A*STAR logo
MERaLiON 2
10B

A*STAR

52.26

± 0.20

76.42

± 0.72

75.17

± 1.05

9.20

± 0.38

52.15

± 0.11

62.30

± 0.41

64.57

± 0.27

28.78

± 0.31

49.48

± 0.41

SAIL logo
SAIL logo
Sailor2
20B

SAIL

51.82

± 0.15

78.69

± 0.00

40.92

± 0.90

25.00

± 0.69

25.88

± 0.13

70.11

± 0.12

74.42

± 0.24

48.57

± 0.36

50.98

± 0.36

Alibaba logo
Alibaba logo
Qwen 2.5
14B

Alibaba

51.62

± 0.12

74.19

± 0.31

71.97

± 0.95

10.70

± 0.39

43.52

± 0.07

51.72

± 0.17

68.11

± 0.22

44.63

± 0.35

48.15

± 0.19

SAIL logo
SAIL logo
Sailor2
8B

SAIL

51.41

± 0.16

66.82

± 0.41

40.63

± 0.73

25.32

± 0.67

50.27

± 0.07

67.21

± 0.24

65.53

± 0.39

45.17

± 0.28

50.31

± 0.27

Alibaba logo
Alibaba logo
Qwen 3
8B

Alibaba

50.42

± 0.16

72.37

± 0.45

72.10

± 0.86

17.93

± 0.48

47.08

± 0.07

40.04

± 0.28

65.19

± 0.17

42.43

± 0.28

46.21

± 0.34

CohereLabs logo
CohereLabs logo
Command A 03-2025
111B

CohereLabs

49.22

± 0.21

72.14

± 0.89

74.92

± 0.88

35.50

± 0.77

52.43

± 0.05

44.47

± 0.11

0.33

± 0.26

52.12

± 0.60

61.83

± 0.36

AISG logo
AISG logo
SEA-LION v3 (Llama)
8B

AISG

49.07

± 0.22

70.37

± 0.64

71.30

± 1.02

20.00

± 0.74

53.19

± 0.11

54.24

± 0.49

59.40

± 0.39

19.58

± 0.46

44.50

± 0.54

CohereLabs logo
CohereLabs logo
Aya Expanse
32B

CohereLabs

47.65

± 0.13

66.20

± 0.26

62.03

± 0.83

8.42

± 0.35

44.64

± 0.07

53.71

± 0.25

59.38

± 0.45

44.55

± 0.36

42.26

± 0.17

Mistral AI logo
Mistral AI logo
Mistral Small 3.1 2503
24B

Mistral AI

47.51

± 0.33

74.70

± 0.77

59.65

± 1.36

9.18

± 0.53

46.49

± 0.12

51.40

± 0.71

65.33

± 0.41

19.77

± 1.50

53.55

± 0.61

Baidu logo
Baidu logo
ERNIE 4.5
21B
MoE

Baidu

45.78

± 0.35

37.95

± 1.51

73.65

± 0.93

22.39

± 0.75

51.99

± 0.05

56.19

± 0.50

45.27

± 0.90

31.68

± 0.36

47.11

± 0.51

CohereLabs logo
CohereLabs logo
Command R+ 08-2024
104B

CohereLabs

45.26

± 0.29

70.43

± 0.91

54.63

± 1.18

4.64

± 0.32

48.63

± 0.11

50.73

± 0.44

60.74

± 0.55

33.08

± 1.14

39.15

± 0.63

Meta logo
Meta logo
Llama 3.1
8B

Meta

39.63

± 0.22

62.07

± 0.71

57.05

± 0.75

5.24

± 0.38

51.94

± 0.11

34.19

± 0.71

53.04

± 0.47

18.87

± 0.75

34.69

± 0.52

CohereLabs logo
CohereLabs logo
Command R 08-2024
32B

CohereLabs

38.24

± 0.25

63.09

± 1.07

50.73

± 1.08

3.03

± 0.28

40.73

± 0.08

38.29

± 0.93

45.52

± 0.73

35.07

± 1.02

29.49

± 0.72

Alibaba logo
Alibaba logo
Qwen 2.5
7B

Alibaba

38.20

± 0.16

51.56

± 0.44

52.89

± 0.98

7.18

± 0.37

32.20

± 0.09

37.20

± 0.23

57.42

± 0.15

29.22

± 0.17

37.93

± 0.23

AI2 logo
AI2 logo
Olmo 2 1124
13B

AI2

35.13

± 0.29

57.04

± 0.95

60.86

± 1.24

5.22

± 0.40

33.28

± 0.17

22.06

± 0.51

32.31

± 0.56

44.95

± 0.99

25.37

± 0.46

Swiss AI logo
Swiss AI logo
Apertus
70B

Swiss AI

34.68

± 0.29

54.44

± 1.56

55.84

± 1.29

10.33

± 0.61

47.20

± 0.08

13.06

± 0.95

49.91

± 0.68

26.03

± 1.24

20.63

± 0.72

AI2 logo
AI2 logo
Tulu 3
8B

AI2

33.94

± 0.24

53.89

± 0.86

65.78

± 1.00

8.23

± 0.44

23.82

± 0.08

38.05

± 0.54

27.52

± 0.43

23.27

± 0.64

30.92

± 0.44

Meta logo
Meta logo
Llama 3
8B

Meta

30.16

± 0.15

52.39

± 0.48

20.25

± 0.74

4.21

± 0.29

48.49

± 0.12

27.55

± 0.56

49.12

± 0.35

8.32

± 0.42

30.93

± 0.46

Alibaba-DAMO logo
Alibaba-DAMO logo
Babel
83B

Alibaba-DAMO

29.79

± 0.41

48.59

± 1.41

38.41

± 1.38

2.92

± 0.37

32.33

± 0.18

36.05

± 0.77

28.50

± 0.94

25.30

± 1.03

26.20

± 0.91

Microsoft logo
Microsoft logo
phi-4
14B

Microsoft

29.72

± 0.23

65.93

± 0.90

52.92

± 1.54

12.80

± 0.35

36.22

± 0.11

26.77

± 0.45

0.00

± 0.00

0.00

± 0.00

43.15

± 0.56

CohereLabs logo
CohereLabs logo
Aya Expanse
8B

CohereLabs

29.70

± 0.16

49.27

± 0.32

42.95

± 0.87

2.72

± 0.28

33.88

± 0.08

24.77

± 0.26

42.85

± 0.34

17.12

± 0.52

24.05

± 0.38

Alibaba-DAMO logo
Alibaba-DAMO logo
Babel
9B

Alibaba-DAMO

27.56

± 0.27

18.49

± 1.68

43.81

± 1.07

3.02

± 0.34

46.30

± 0.12

19.69

± 0.75

54.89

± 0.68

24.53

± 0.51

9.79

± 0.47

Alibaba-DAMO logo
Alibaba-DAMO logo
SeaLLMs V3
7B

Alibaba-DAMO

26.67

± 0.34

52.02

± 1.35

42.06

± 1.05

6.91

± 0.32

40.18

± 0.12

16.06

± 0.67

35.61

± 0.92

12.10

± 1.51

8.43

± 0.52

CohereLabs logo
CohereLabs logo
Command R7B 12-2024
7B

CohereLabs

25.28

± 0.33

35.33

± 1.57

44.73

± 1.26

1.70

± 0.30

27.46

± 0.08

11.44

± 0.72

36.20

± 0.78

26.00

± 1.25

19.39

± 0.69

Swiss AI logo
Swiss AI logo
Apertus
8B

Swiss AI

23.09

± 0.39

15.44

± 1.68

56.83

± 1.32

3.84

± 0.35

43.11

± 0.12

7.31

± 0.90

23.89

± 0.72

26.53

± 1.09

7.79

± 0.63

Mistral AI logo
Mistral AI logo
Ministral 2410
8B

Mistral AI

19.24

± 0.35

47.59

± 1.39

20.83

± 1.02

1.75

± 0.28

25.30

± 0.15

7.58

± 0.83

25.12

± 1.07

10.10

± 1.89

15.65

± 0.71

AI2 logo
AI2 logo
Olmo 2 1124
7B

AI2

14.84

± 0.19

0.00

± 0.00

45.87

± 1.41

2.07

± 0.31

34.93

± 0.11

2.96

± 0.58

29.34

± 0.79

0.00

± 0.00

3.56

± 0.35

No records

Filipino Tasks

Average of 30 bootstraps. 95% CI are shown.

Model Size: ≤200B

Open instruct models only

Model
TL
Cultural
Kalahi
AISG logo
AISG logo
SEA-LION v4 (Gemma)
27B

AISG

68.10

± 0.14

82.98

± 0.17

82.98

± 0.17

Google logo
Google logo
Gemma 3
27B

Google

67.70

± 0.12

82.56

± 0.18

82.56

± 0.18

Alibaba logo
Alibaba logo
Qwen 3 Next
80B
MoE

Alibaba

66.48

± 0.13

83.11

± 0.19

83.11

± 0.19

AISG logo
AISG logo
SEA-LION v3 (Llama)
70B

AISG

66.38

± 0.17

87.63

± 0.55

87.63

± 0.55

AISG logo
AISG logo
SEA-LION v4 (Qwen)
32B

AISG

65.35

± 0.14

82.94

± 0.26

82.94

± 0.26

Google logo
Google logo
Gemma 3
12B

Google

65.00

± 0.11

82.03

± 0.25

82.03

± 0.25

Meta logo
Meta logo
Llama 3.3
70B

Meta

63.21

± 0.11

83.08

± 0.16

83.08

± 0.16

AI2 logo
AI2 logo
Tulu 3
70B

AI2

62.96

± 0.24

82.12

± 0.47

82.12

± 0.47

Alibaba logo
Alibaba logo
Qwen 3
32B

Alibaba

62.23

± 0.13

77.81

± 0.38

77.81

± 0.38

Alibaba logo
Alibaba logo
Qwen 2.5
72B

Alibaba

61.94

± 0.13

82.11

± 0.28

82.11

± 0.28

Meta logo
Meta logo
Llama 4 Scout
109B
MoE

Meta

61.84

± 0.11

86.63

± 0.00

86.63

± 0.00

Meta logo
Meta logo
Llama 3.1
70B

Meta

61.82

± 0.17

83.46

± 0.52

83.46

± 0.52

Alibaba logo
Alibaba logo
Qwen 3
30B
MoE

Alibaba

61.39

± 0.12

87.98

± 0.16

87.98

± 0.16

Google logo
Google logo
Gemma 2
27B

Google

61.19

± 0.16

82.65

± 0.35

82.65

± 0.35

AISG logo
AISG logo
SEA-LION v3 (Gemma 2)
9B

AISG

60.75

± 0.22

85.99

± 0.56

85.99

± 0.56

Mistral AI logo
Mistral AI logo
Mistral Large 2411
123B

Mistral AI

58.98

± 0.15

82.90

± 0.50

82.90

± 0.50

Alibaba logo
Alibaba logo
Qwen 3
14B

Alibaba

57.37

± 0.13

78.53

± 0.31

78.53

± 0.31

Alibaba logo
Alibaba logo
Qwen 2.5
32B

Alibaba

56.49

± 0.16

78.61

± 0.23

78.61

± 0.23

Google logo
Google logo
Gemma 2
9B

Google

53.79

± 0.17

76.23

± 0.58

76.23

± 0.58

AI2 logo
AI2 logo
Olmo 2 0325
32B

AI2

53.00

± 0.24

81.47

± 0.60

81.47

± 0.60

Meta logo
Meta logo
Llama 3
70B

Meta

52.32

± 0.14

83.01

± 0.38

83.01

± 0.38

A*STAR logo
A*STAR logo
MERaLiON 2
10B

A*STAR

52.26

± 0.20

76.42

± 0.72

76.42

± 0.72

SAIL logo
SAIL logo
Sailor2
20B

SAIL

51.82

± 0.15

78.69

± 0.00

78.69

± 0.00

Alibaba logo
Alibaba logo
Qwen 2.5
14B

Alibaba

51.62

± 0.12

74.19

± 0.31

74.19

± 0.31

SAIL logo
SAIL logo
Sailor2
8B

SAIL

51.41

± 0.16

66.82

± 0.41

66.82

± 0.41

Alibaba logo
Alibaba logo
Qwen 3
8B

Alibaba

50.42

± 0.16

72.37

± 0.45

72.37

± 0.45

CohereLabs logo
CohereLabs logo
Command A 03-2025
111B

CohereLabs

49.22

± 0.21

72.14

± 0.89

72.14

± 0.89

AISG logo
AISG logo
SEA-LION v3 (Llama)
8B

AISG

49.07

± 0.22

70.37

± 0.64

70.37

± 0.64

CohereLabs logo
CohereLabs logo
Aya Expanse
32B

CohereLabs

47.65

± 0.13

66.20

± 0.26

66.20

± 0.26

Mistral AI logo
Mistral AI logo
Mistral Small 3.1 2503
24B

Mistral AI

47.51

± 0.33

74.70

± 0.77

74.70

± 0.77

Baidu logo
Baidu logo
ERNIE 4.5
21B
MoE

Baidu

45.78

± 0.35

37.95

± 1.51

37.95

± 1.51

CohereLabs logo
CohereLabs logo
Command R+ 08-2024
104B

CohereLabs

45.26

± 0.29

70.43

± 0.91

70.43

± 0.91

Meta logo
Meta logo
Llama 3.1
8B

Meta

39.63

± 0.22

62.07

± 0.71

62.07

± 0.71

CohereLabs logo
CohereLabs logo
Command R 08-2024
32B

CohereLabs

38.24

± 0.25

63.09

± 1.07

63.09

± 1.07

Alibaba logo
Alibaba logo
Qwen 2.5
7B

Alibaba

38.20

± 0.16

51.56

± 0.44

51.56

± 0.44

AI2 logo
AI2 logo
Olmo 2 1124
13B

AI2

35.13

± 0.29

57.04

± 0.95

57.04

± 0.95

Swiss AI logo
Swiss AI logo
Apertus
70B

Swiss AI

34.68

± 0.29

54.44

± 1.56

54.44

± 1.56

AI2 logo
AI2 logo
Tulu 3
8B

AI2

33.94

± 0.24

53.89

± 0.86

53.89

± 0.86

Meta logo
Meta logo
Llama 3
8B

Meta

30.16

± 0.15

52.39

± 0.48

52.39

± 0.48

Alibaba-DAMO logo
Alibaba-DAMO logo
Babel
83B

Alibaba-DAMO

29.79

± 0.41

48.59

± 1.41

48.59

± 1.41

Microsoft logo
Microsoft logo
phi-4
14B

Microsoft

29.72

± 0.23

65.93

± 0.90

65.93

± 0.90

CohereLabs logo
CohereLabs logo
Aya Expanse
8B

CohereLabs

29.70

± 0.16

49.27

± 0.32

49.27

± 0.32

Alibaba-DAMO logo
Alibaba-DAMO logo
Babel
9B

Alibaba-DAMO

27.56

± 0.27

18.49

± 1.68

18.49

± 1.68

Alibaba-DAMO logo
Alibaba-DAMO logo
SeaLLMs V3
7B

Alibaba-DAMO

26.67

± 0.34

52.02

± 1.35

52.02

± 1.35

CohereLabs logo
CohereLabs logo
Command R7B 12-2024
7B

CohereLabs

25.28

± 0.33

35.33

± 1.57

35.33

± 1.57

Swiss AI logo
Swiss AI logo
Apertus
8B

Swiss AI

23.09

± 0.39

15.44

± 1.68

15.44

± 1.68

Mistral AI logo
Mistral AI logo
Ministral 2410
8B

Mistral AI

19.24

± 0.35

47.59

± 1.39

47.59

± 1.39

AI2 logo
AI2 logo
Olmo 2 1124
7B

AI2

14.84

± 0.19

0.00

± 0.00

0.00

± 0.00

No records