# Funding third-party model evaluations

Source: https://www.anthropic.com/news/a-new-initiative-for-developing-third-party-model-evaluations
Published: 2024-07-01
Status: unreviewed source report

## Source excerpt (up to 25 words)

> A new initiative to fund evaluations developed by third-party organizations that can effectively measure advanced AI capabilities.

## Review question

Inspect benchmark version, contamination controls, sample size, held-out tasks, adversarial failures and scoring rules. Higher scores alone do not establish lower production risk.

No independent proof check or claim of peer review.