# Beyond Selected Breakthroughs: Evaluating Language Models on Randomly Sampled Mathematical Conjectures

Source: https://arxiv.org/abs/2610.40382
Published: 2026-10-29
Status: unreviewed source report

## Source excerpt (up to 25 words)

> The last year has seen a shift in AI-assisted mathematics, with frontier language models producing proofs of and counterexamples to long-standing open conjectures. However, studying

## Review question

Check the benchmark version, sampling budget, data contamination controls, human interventions and proof-review method. A final answer or benchmark score is not evidence that every reasoning step is valid.

No independent proof check or claim of peer review.