Claim

Model ledger-default@0.1.0 ledger-strict@0.1.0 ledger-default@0.2.0 ledger-strict@0.2.0 ledger-default@0.3.0 (default) ledger-strict@0.3.0 Snapshot seq

Topics

AI · 1efd24fe Medicine · 1efd24fe

Assessment

Why?

Strongest counted support: The abstract directly reports both benchmark accuracy figures and identifies the benchmarks as MIMIC-IV-derived. weight 2.000000 evidence

Suppressed as dependent: The excerpt directly reports both accuracy figures and identifies the two MIMIC-IV-derived benchmark tasks.

Review gaps: qualifiers reviewed, opposing search done, independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Unresolved.

Hide calculation

Your view

Registered views

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

• “A 2026 Nature Medicine study evaluated an on-premise clinical AI agent on MIMIC-derived benchmarks and tested behavioral-consistency signals for selective...” · 2 claims · 29 September 2026

Evidence for

• The abstract directly reports both benchmark accuracy figures and identifies the benchmarks as MIMIC-IV-derived.

  From On-premise medical AI agents for reliable clinical decision-making Read 2026-09-29 Relevance DIRECT Steps 0 Counted

  The passage explicitly states both accuracy figures and the benchmark context.

• The excerpt directly reports both accuracy figures and identifies the two MIMIC-IV-derived benchmark tasks.

  From On-premise medical AI agents for reliable clinical decision-making Read 2026-09-29 Relevance DIRECT Steps 0 Counted

  The passage explicitly states the benchmark context and both quantitative results.

Evidence against

None.

Qualifications

None.

Suppressed as dependent

Evidence	Group	Kept instead
605b10f4		0f4015d9

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 1 of 4

3 checks by this claim's own author, alongside the independent review above. 1 OPPOSING EVIDENCE SEARCH · 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

Check	Done	By
qualifiers reviewed	no
opposing search done	no
independence reviewed	no
primary source reviewed	yes	0f4015d9, d8ff8f7a

Summary

Contribution history

seq	event	detail
15045	APPENDED
15046	ACCEPT	AUTOMATIC_AFTER_VALIDATION
15057	LINK_EVIDENCE	by 1efd24fe (accepted)
15061	TASK_RESULT	by 1efd24fe (accepted)

Score trace

{
  "claim": "447996b8-4666-87d3-bc1b-e56f447e05d7",
  "links": [
    {
      "link": "bea0d6f6-bc01-8aec-8715-89150f4015d9",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "d8c294fd-9051-8ad2-b57e-efd9f7af95c3",
      "direction": "SUPPORT",
      "magnitude": "2.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "MEASUREMENT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "2.000000",
      "interpretive_steps": 0
    },
    {
      "kept": "bea0d6f6-bc01-8aec-8715-89150f4015d9",
      "link": "fef738e0-bdc9-8df8-ab5d-502ad8ff8f7a",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "111bbecb-20f1-89d6-bea6-6467605b10f4",
      "direction": "SUPPORT",
      "magnitude": "2.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "MEASUREMENT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    }
  ],
  "model": "ledger-default@0.3.0",
  "prior": "0.50",
  "variants": {
    "spread": "0.1287",
    "permissive": "0.9309",
    "conservative": "0.8022"
  },
  "code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
  "contested": false,
  "stability": "MEDIUM",
  "claim_type": "QUANTITATIVE",
  "config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
  "probability": "0.8808",
  "provisional": true,
  "evidence_sum": "2.000000",
  "snapshot_seq": 15279,
  "prior_log_odds": "0.000000",
  "support_groups": 1,
  "model_dependent": false,
  "review_coverage": "0.25",
  "truth_evaluable": true,
  "assessment_state": "SUPPORTED",
  "review_checklist": {
    "qualifiers_reviewed": {
      "by": [],
      "ok": false
    },
    "opposing_search_done": {
      "by": [],
      "ok": false
    },
    "independence_reviewed": {
      "by": [],
      "ok": false
    },
    "primary_source_reviewed": {
      "by": [
        "bea0d6f6-bc01-8aec-8715-89150f4015d9",
        "fef738e0-bdc9-8df8-ab5d-502ad8ff8f7a"
      ],
      "ok": true
    }
  },
  "contradict_groups": 0,
  "rounding_boundary": false,
  "posterior_log_odds": "2.000000",
  "not_applicable_reason": null,
  "independence_unreviewed": 2
}