Benchmarks / Knowledge

UGI NatInt

A private-question evaluation of general knowledge and reasoning across textbook, popular-culture and world-model topics. Maintained by DontPlanToEnd. Score: NatInt ๐Ÿ’ก.

166models
โ€“Open Index weight
โ€“last updated

UGI NatInt

Higher is better ยท best effort per model

Chart settings
166 of 166 selected

full table below

#ModelEffortScoreCost / taskHarness
1GPT-6 Astramax79โ€“โ€“
2Gemini 3.1 Prohigh76โ€“โ€“
3Gemini 3.7 Flashmax76โ€“โ€“
4GPT-6 Solmax74โ€“โ€“
5Gemini 3.5 Flashxhigh72โ€“โ€“
6GPT-6.1 Solmax71โ€“โ€“
7Gemini 3 Flashhigh70โ€“โ€“
8Opus 5.5max70โ€“โ€“
9GPT-5.6 Solmax70โ€“โ€“
10Gemini 3.8 Flashmax70โ€“โ€“
11Fable 5max68โ€“โ€“
12Gemini 3 Prohigh67โ€“โ€“
13GPT-5.2025high67โ€“โ€“
14Gemini 3.6 Flashxhigh66โ€“โ€“
15o3high66โ€“โ€“
16Grok 4.0709โ€“65โ€“โ€“
17Fable 5.1max65โ€“โ€“
18o1high64โ€“โ€“
19Gemini 2.5 Prohigh64โ€“โ€“
20Opus 4.5high64โ€“โ€“
21GPT-5.3xhigh64โ€“โ€“
22Opus 4.6max63โ€“โ€“
23GPT-5.5xhigh63โ€“โ€“
24Grok 4.6max61โ€“โ€“
25Opus 4.8max61โ€“โ€“
26Kimi K2.5max60โ€“โ€“
27Grok 4.5max60โ€“โ€“
28GPT-4.1high60โ€“โ€“
29Kimi K2.6max59โ€“โ€“
30DeepSeek V4 Promax59โ€“โ€“
31GPT-4ohigh59โ€“โ€“
32Grok 4.7max59โ€“โ€“
33GPT-5.1high58โ€“โ€“
34Opus 4.1high58โ€“โ€“
35Opus 4medium58โ€“โ€“
36GPT-5.4xhigh57โ€“โ€“
37GPT-5high57โ€“โ€“
38Grok 3none57โ€“โ€“
39Grok 4.20xhigh56โ€“โ€“
40GPT-5.2xhigh56โ€“โ€“
41GLM 5.2max55โ€“โ€“
42Opus 4.7max55โ€“โ€“
43Grok 4.3xhigh54โ€“โ€“
44Sonnet 4.5high54โ€“โ€“
45Sonnet 4.6max53โ€“โ€“
46GPT-5.6 Terramax53โ€“โ€“
47DeepSeek R1xhigh52โ€“โ€“
48Sonnet 4high51โ€“โ€“
49Opus 3none50โ€“โ€“
50GLM 5.1max50โ€“โ€“
51DeepSeek V3.1none49โ€“โ€“
52GLM 5high49โ€“โ€“
53Kimi K2medium49โ€“โ€“
54DeepSeek V4 Flashmax48โ€“โ€“
55DeepSeek R1.0528โ€“48โ€“โ€“
56Qwen 3.5 397B-A17Bmax48โ€“โ€“
57DeepSeek V3.0324โ€“47โ€“โ€“
58GLM 4.5xhigh47โ€“โ€“
59DeepSeek V3.2high46โ€“โ€“
60GPT-5.6 Lunamax46โ€“โ€“
61DeepSeek V3none46โ€“โ€“
62o4 minihigh46โ€“โ€“
63GLM 4.6none45โ€“โ€“
64Qwen 3 Maxmax44โ€“โ€“
65Gemini 2.5 Flashmedium44โ€“โ€“
66Llama 3.1 405bnone43โ€“โ€“
67GLM 4.7none43โ€“โ€“
68Qwen 3.6 Plusmax42โ€“โ€“
69Mistral Medium 3.5high41โ€“โ€“
70MiMo V2.5 Proxhigh41โ€“โ€“
71Sonnet 5max40โ€“โ€“
72Mistral Large 3none40โ€“โ€“
73Mistral Medium 3.1none40โ€“โ€“
74Gemma 4 31B IThigh39โ€“โ€“
75MiniMax M2.5high39โ€“โ€“
76Mistral Large 2407โ€“38โ€“โ€“
77Hy3xhigh38โ€“โ€“
78Qwen 3 235B-A22Bxhigh36โ€“โ€“
79Mistral Large 2411โ€“36โ€“โ€“
80Qwen 3.5 27Bhigh36โ€“โ€“
81Haiku 4.5xhigh35โ€“โ€“
82Mistral Medium 3none35โ€“โ€“
83Gemma 3 27B ITmedium34โ€“โ€“
84Gemma 4 26Bxhigh34โ€“โ€“
85MiniMax M2.7high34โ€“โ€“
86MiniMax M2.1โ€“34โ€“โ€“
87Gemma 3 27Bnone34โ€“โ€“
88gpt-oss-120bhigh34โ€“โ€“
89Qwen 3.6 27Bmax33โ€“โ€“
90Grok 4 Fastnone33โ€“โ€“
91Llama 3โ€“33โ€“โ€“
92GLM 4.6 Vlow32โ€“โ€“
93MiMo V2.5xhigh32โ€“โ€“
94Llama 33โ€“32โ€“โ€“
95MiniMax M2โ€“32โ€“โ€“
96Llama 33 70bโ€“31โ€“โ€“
97Grok 4.1 Fasthigh31โ€“โ€“
98Llama 3.3 70bnone31โ€“โ€“
99Qwen 3.5 122B-A10Bnone31โ€“โ€“
100Llama 4 Maverickmedium31โ€“โ€“
101Llama 3.1 70bnone31โ€“โ€“
102MiMo V2 Flashhigh31โ€“โ€“
103Llama 3.3none30โ€“โ€“
104Llama 7 0bโ€“30โ€“โ€“
105Haiku 3medium30โ€“โ€“
106Gemma 2 7Bโ€“29โ€“โ€“
107Llama 10 9bโ€“28โ€“โ€“
108Mistral Small 4high28โ€“โ€“
109Mistral Small 3.1none27โ€“โ€“
110Mistral Smallnone26โ€“โ€“
111Gemma 4 12B ITโ€“26โ€“โ€“
112Qwen 3.6 35B-A3Bmax25โ€“โ€“
113Mistral Small 3none25โ€“โ€“
114Mistral Small 2409โ€“25โ€“โ€“
115Qwen 3.5 35B-A3Blow25โ€“โ€“
116Gemma 2 27B ITโ€“25โ€“โ€“
117Magistral 2509โ€“24โ€“โ€“
118Magistral Small 2509โ€“24โ€“โ€“
119Mistral Small 3.2none24โ€“โ€“
120GLM 4โ€“23โ€“โ€“
121Qwen 2.5 32Bnone22โ€“โ€“
122Devstral Small 2none21โ€“โ€“
123Llama 4 Scoutmedium21โ€“โ€“
124Mistralnone21โ€“โ€“
125Qwen 3 14Bnone21โ€“โ€“
126Qwen 3 32Bnone20โ€“โ€“
127GLM 4.7 Flashnone20โ€“โ€“
128Qwen 2.5 14Bโ€“19โ€“โ€“
129Qwen 2.5 72Bnone19โ€“โ€“
130Gemma 3 12B ITโ€“19โ€“โ€“
131GLM 4.5 Airโ€“18โ€“โ€“
132Llama 2 70bnone18โ€“โ€“
133Llama 3.1 8bmedium18โ€“โ€“
134Qwen 3 Codermedium18โ€“โ€“
135Qwen 3.5 9Blow18โ€“โ€“
136gpt-oss-20bhigh17โ€“โ€“
137Gemma 3 12Bnone17โ€“โ€“
138Gemma 1 2Bโ€“17โ€“โ€“
139Llama 3.3 8bโ€“16โ€“โ€“
140Gemma 2 9Bโ€“16โ€“โ€“
141Qwen 3 30B-A3Bnone16โ€“โ€“
142Qwen 2.5 7Bโ€“16โ€“โ€“
143Qwen 3 8Bnone15โ€“โ€“
144Qwen 3 15B-A2Bโ€“15โ€“โ€“
145Qwen 2.5 Codernone14โ€“โ€“
146Qwen 3.5 4Blow13โ€“โ€“
147Qwen 3high13โ€“โ€“
148Gemma 2 9B ITโ€“13โ€“โ€“
149Qwen 3.1none12โ€“โ€“
150Qwen 3 4Bnone12โ€“โ€“
151Llama 3 8bnone12โ€“โ€“
152Gemma 3 4B ITโ€“11โ€“โ€“
153Llama 3 3bโ€“11โ€“โ€“
154Llama 3.2 3bnone10โ€“โ€“
155Gemma 3 4Bnone10โ€“โ€“
156Gemma 2 2B ITโ€“9โ€“โ€“
157Qwen 3.5 2Blow9โ€“โ€“
158Qwen 2.5โ€“9โ€“โ€“
159Llama 3.1max9โ€“โ€“
160Qwen 3 16B-A3Bโ€“8โ€“โ€“
161Llama 3.2 1bnone7โ€“โ€“
162Llama 3.2โ€“5โ€“โ€“
163Qwen 3.0โ€“5โ€“โ€“
164Qwen 3.5none5โ€“โ€“
165Gemma 3 1B ITโ€“5โ€“โ€“
166Gemma 3 1Bnone3โ€“โ€“