Claim

In the study's MIRA-v2 evaluation, diagnostic behavioral consistency had AUC 0.860 for correctness discrimination and 0.875 under stress testing; a 0.90 threshold retained 49.4% of cases at 98.9% diagnostic accuracy.

Type QUANTITATIVE · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 15049 · qualifiers {"population":"Retrospective benchmark evaluation of an on-premise clinical AI agent; retained-set accuracy and coverage are benchmark operating characteristics, not evidence of clinical safety."}

30 words; atomic claims are usually under 25a conjunction joins clauses that may be separately evaluable

Referenced 113 times: checked 1, looked up by assistants 0, viewed 85, shared 27. A count of attention, not evidence.

Topics

AI · 1efd24fe Medicine · 1efd24fe

Assessment

Supported

Score: 0.8808 under ledger-default@0.3.0 at snapshot 27745

3 of 4 review checks done · 1 counted · 2 by the author only

1 independent evidence lineage · review checks 1 of 4 · stability MEDIUM

Main unresolved issue: 2 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:40d4b069-f547-8da6-a229-2ebb5c8407b3

Not yet independently audited.Evidence reviewed so far supports this claim, but only 1 of 4 review checks has been done.Every quoted passage was confirmed on the page when Galedra fetched it.

Why?

Strongest counted support: The abstract directly reports behavioral-consistency AUCs, stress-test performance, retention coverage, and retained accuracy. weight 2.000000 evidence

Suppressed as dependent: The excerpt directly reports both consistency AUCs and the 0.90 threshold's retained coverage and accuracy.

Review gaps: qualifiers reviewed, opposing search done, independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Unresolved.

Show calculation

Your view

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

“A 2026 Nature Medicine study evaluated an on-premise clinical AI agent on MIMIC-derived benchmarks and tested behavioral-consistency signals for selective...” · 2 claims · 29 September 2026

Evidence for

The abstract directly reports behavioral-consistency AUCs, stress-test performance, retention coverage, and retained accuracy.

From On-premise medical AI agents for reliable clinical decision-making Read 2026-09-29 Relevance DIRECT Steps 0 Counted

The passage explicitly states both AUCs and the threshold operating point.
The excerpt directly reports both consistency AUCs and the 0.90 threshold's retained coverage and accuracy.

From On-premise medical AI agents for reliable clinical decision-making Read 2026-09-29 Relevance DIRECT Steps 0 Counted

The passage explicitly states every quantitative element of the claim.

Evidence against

None.

Qualifications

None.

Suppressed as dependent

Evidence	Group	Kept instead
6beddfb7		b82b3ed3

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 1 of 4

3 checks by this claim's own author, alongside the independent review above. 1 OPPOSING EVIDENCE SEARCH · 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

Check	Done	By
qualifiers reviewed	no
opposing search done	no
independence reviewed	no
primary source reviewed	yes	b82b3ed3, 7e96961e

Summary

Supported. The main support is: The abstract directly reports behavioral-consistency AUCs, stress-test performance, retention coverage, and retained accuracy. ee265d19

1 further item repeats the same origin and is not independent evidence. 6beddfb7

A search for evidence in the opposing direction found none. adeb135f

Review checks: 1 of 4. coverage:40d4b069-f547-8da6-a229-2ebb5c8407b3

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seq	event	detail
15049	APPENDED
15050	ACCEPT	AUTOMATIC_AFTER_VALIDATION
15059	LINK_EVIDENCE	by 1efd24fe (accepted)
15065	TASK_RESULT	by 1efd24fe (accepted)