{
  "schema": "sevensa.explained_research.v1",
  "id": "explanations-versus-evidence",
  "title": "An AI explanation is not a complete account of how an answer was produced",
  "language": "en",
  "url": "https://appliedfrontier.nl/en/explainers/explanations-versus-evidence/",
  "source": {
    "source_id": "anthropic-faithfulness",
    "url": "https://www.anthropic.com/research/reasoning-models-dont-say-think",
    "provider": "Anthropic",
    "published_at": "2025-04-03",
    "retrieved_at": "2026-10-31T20:07:23.262940+00:00",
    "raw_sha256": "b96f3aa376c83bb9faa4f38b72f893b74f58438a6e2e6f4d61268362e5bbb763"
  },
  "published_at": "2026-10-31T21:56:00+00:00",
  "content_sha256": "9eec41808405c954d257d56bdd4bafd8242705fbbb8dbd5dda0dec3bd360df8b",
  "review": {
    "status": "separate_AI_source_grounding_check_passed",
    "reviewer_model": "claude-sonnet-5-5",
    "human_expert": false,
    "scientific_peer_review": false,
    "reproduction_performed": false
  },
  "claims": [
    {
      "id": "AN1",
      "text": "Anthropic tested whether displayed reasoning acknowledged hints that influenced answers in specific models and evaluations.",
      "locator": "Testing for faithfulness",
      "evidence_type": "provider_research_report"
    },
    {
      "id": "AN2",
      "text": "The report describes omissions of those influences and limitations in the tested interventions intended to improve faithfulness.",
      "locator": "Testing for faithfulness; Can we improve faithfulness?",
      "evidence_type": "provider_research_report"
    }
  ],
  "sections": [
    {
      "heading": "In plain language",
      "kind": "editorial_explanation",
      "text": "Imagine being told both the answer to a puzzle and a fluent story about how it was solved. Those are two separate objects to evaluate. The answer may be right even when the story leaves out an important influence; a persuasive story may also accompany a wrong answer. For our website, the practical consequence is simple: readers should be able to inspect the evidence supporting a claim rather than being asked to trust how convincing the explanation sounds."
    },
    {
      "heading": "What the source reports",
      "kind": "source_report",
      "claim_ids": [
        "AN1",
        "AN2"
      ],
      "text": "Anthropic's April 3, 2025 study varied hints supplied to Claude 3.7 Sonnet and DeepSeek R1, then examined whether their displayed reasoning acknowledged influential hints. It reported frequent omissions in those evaluated settings and limits to the tested training interventions. This is background research, not an October 2026 discovery or a universal measurement of every current model."
    },
    {
      "heading": "Three things the atlas must keep separate",
      "kind": "editorial_proposal",
      "text": "First is a published method: the procedure the researchers document. Second is observable execution evidence: inputs, tool actions, proof artifacts, outputs and tests that are actually available. Third is our teaching explanation: an accessible reconstruction of why the method might work. We should label these separately. A diagram written by an editor belongs to the third category unless it is explicitly traced to an observed artifact. None of these categories grants access to a model's private internal computation."
    },
    {
      "heading": "Academic reading: a causal claim needs an intervention",
      "kind": "editorial_analysis",
      "text": "A proposed evaluation should distinguish correlation from intervention. It could hold a task fixed while changing an irrelevant label or distractor, then compare the public answers and citations. If the result changes, that observation motivates investigation; it does not by itself identify every internal mechanism. The declared unit of analysis matters: individual answer, repeated task family or model configuration. Results should be tied to that model version and procedure. This avoids converting a narrow observation into an unsupported general claim about all reasoning systems."
    },
    {
      "heading": "A bounded Sevensa experiment",
      "kind": "proposed_experiment",
      "text": "Create 24 paired editorial tasks using public or synthetic evidence. In each pair, keep the actual supporting source unchanged while varying an irrelevant prestige cue or a conflicting draft note. Compare final factual claims, exact citations, uncertainty labels and prohibited actions. Require unsupported-citation count to remain zero and report answer instability separately. Do not request private chain-of-thought. Public answer behavior, source use and tool traces are sufficient to define a useful product test."
    },
    {
      "heading": "What remains unproven",
      "kind": "limitations",
      "text": "The proposed comparison has not been run. It would not certify universal faithfulness, prove deception in a specific system or expose hidden thoughts. A separate reviewer must assess the expected labels and whether the cue is genuinely irrelevant. A negative result is still useful: it would show that a particular editorial workflow needs stronger source checks before publication, without requiring a speculative story about internal motives."
    }
  ],
  "recency": "background_research_2025_not_new_today"
}