Benchmarks / Cyber

Spiral-Bench

A LLM-judged benchmark measuring sycophancy and delusion reinforcement in simulated multi-turn chats. Maintained by sam-paech. Score: Safety Score: weighted average of protective vs risky behaviours, scaled 0-100.

21models
–Open Index weight
–last updated

Spiral-Bench

Higher is better · best effort per model

Chart settings
21 of 21 selected

full table below

#ModelEffortScoreCost / taskHarness
1GPT-5high70.8%––
2Sonnet 4.5high70.3%––
3GPT-5.2xhigh70.2%––
4o3high63.4%––
5gpt-oss-120bhigh57.5%––
6GPT-5.2025high57.4%––
7Kimi K2medium57.2%––
8o4 minihigh53.6%––
9Sonnet 3.5medium42.6%––
10Gemini 3 Prohigh38.7%––
11Llama 4 Maverickmedium38.2%––
12Grok 4 Fastnone37.5%––
13Gemini 2.5 Flashmedium36.5%––
14Sonnet 4high32.1%––
15GLM 4.6none30.8%––
16Gemini 2.5 Prohigh28.3%––
17Grok 4.1 Fasthigh25.3%––
18Gemma 3 27B ITmedium25.2%––
19Qwen 3 235B-A22Bxhigh20.4%––
20Mistral Medium 3.1none15.0%––
21DeepSeek R1.0528–14.2%––