“A Nature study evaluated LLM predictions of social-science experiment results and found strong correlations with observed effects but systematic overestimation of effect sizes.”

Checks out so far. 2 hold up so far.

0.8353 under ledger-default@0.3.0 at snapshot 27745 for all claims together. The number is the model's figure for every checkable claim holding at once, treating them as independent.

The statement as a whole, read from the 2 claims below. Each claim is scored on its own; this reading only counts them. Provisional until audited.

Review 62% done · 25% counted in review coverage · 37% by the claims' own author only (2 claims, 8 checks)

Share:

Checked in Galedra: score 0.84, mostly supported · not yet reviewed by anyone else “A Nature study evaluated LLM predictions of social-science experiment results and found strong correlations with observed effects but systematic overestimation of effect sizes.” https://galedra.org/investigations/01a0eac0-7fbf-724e-80aa-289726f51bd1

“A 2026 study evaluated LLM predictions using an archive of 70 preregistered US survey experiments containing 469 experimental effects and 119,330 participants.”

Supported · 0.8581 under ledger-default@0.3.0 at snapshot 27745 · review checks 1 of 4 · provisional until audited.

2 of 4 review checks done · 1 counted · 1 by the author only

See the evidence · Claim card

“In that study, GPT-4-derived predictions were strongly correlated with observed treatment effects at a level similar to pooled human forecasts, but systematically overestimated effect sizes.”

Supported · 0.9734 under ledger-default@0.3.0 at snapshot 27745 · review checks 1 of 4 · provisional until audited.

3 of 4 review checks done · 1 counted · 2 by the author only

See the evidence · Claim card