AGI Labo
...

AGI Lab · Bench

Reversi Bench

Does more thinking make a stronger player?

Reversi matches between the same model at different reasoning efforts, measuring how thinking depth changes playing strength. The referee CLI holds the board and legal moves; players know only their color and an opaque game id — who the opponent is (which model, which effort) is written into the record only after the game ends. Alongside wins, stone margins, and move counts, output-token usage is recorded, publishing the raw relationship between thinking cost and playing strength. Cross-model games share the same ledger.

Loading records…

All scoring is mechanical — no LLM judging. Sample sizes are still small; rankings are provisional.

Every game record, the referee CLI, and the methodology are public at github.com/tempi-tech/reversi-bench (METHOD.md, standings.json).