# SHADOWBENCH: Toward Reliable Automatic Evaluation of Semantic Alignment in Autoformalization

Source: https://arxiv.org/abs/2608.29270
Published: 2026-08-29
Status: unreviewed source report

## Source excerpt (up to 25 words)

> Autoformalization translates informal mathematical theorems into code for proof assistants such as Lean. A central challenge is that current evaluation metrics can accept type-correct but

## Review question

Inspect the formal statement, imported axioms, admitted lemmas, checker version and correspondence with the informal theorem. A successful compiler exit alone does not prove that the intended question was formalized.

No independent proof check or claim of peer review.