Claim
The Decoder reported that GPT-6 Astra reached 62.7% on ARC-AGI-3 at a test cost of roughly $26,000.
Topics
AI · 1efd24fe Prices and inflation · 1efd24fe
Assessment
Supported
Main unresolved issue: 4 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:3ebea097-3321-889a-a37d-1252a84dd99c
Not yet independently audited.Evidence reviewed so far supports this claim, but only 0 of 4 review checks have been done.
Why?
Strongest counted support: The Decoder reports a 62.7% Astra score on ARC-AGI-3 and a test cost of roughly $26,000. weight 1.800000 evidence
Suppressed as dependent: The passage directly states Astra reached 62.7 percent on ARC-AGI-3 at a roughly $26,000 test cost.
Review gaps: qualifiers reviewed, opposing search done, independence reviewed, primary source reviewed
What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Unresolved.
0.8581 under ledger-default@0.3.0 at snapshot 27745 · state Supported · Review checks: 0 of 4 · stability MEDIUM · 4 sources, 1 independent lineage
How the number was reached
| Link | Working | Weight | Counted as |
|---|---|---|---|
| f306cf23 support | relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 | 1.800000 | 0.000000 (dependent strongest only, kept 788df9ba) |
| 788df9ba support | relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 | 1.800000 | 1.800000 |
| 7d5a2ece qualify | relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 | 1.800000 | 0.000000 (non directional) |
| 57fee915 qualify | relevance STRONG 1.2 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 | 1.080000 | 0.000000 (non directional) |
prior 0.50 → log-odds 0.000000 + 1.800000 (the counted weights) = 1.800000 → probability 0.8581
Your view
Registered views
Nobody has registered a view yet.
Checked as part of
- “The Decoder reported that GPT-6 Astra reached 62.7% on ARC-AGI-3 at a test cost of roughly $26,000.” · 1 claim · 28 September 2026
Evidence for
-
From Benchmarks disagree on GPT-6 Astra, but its human-beating efficiency on ARC-AGI-3 pulls Chollet’s AGI forecast forward Read 2026-09-28 Relevance DIRECT Steps 0 Counted
The excerpt directly states both the benchmark score and approximate test cost, with attribution to the report.
-
From Benchmarks disagree on GPT-6 Astra, but its human-beating efficiency on ARC-AGI-3 pulls Chollet’s AGI forecast forward Read 2026-09-28 Relevance DIRECT Steps 0 Counted
Exact quoted passage covers both the score and approximate cost.
Evidence against
None.
Qualifications
-
From Benchmarks disagree on GPT-6 Astra, but its human-beating efficiency on ARC-AGI-3 pulls Chollet’s AGI forecast forward Read 2026-09-28 Relevance DIRECT Steps 0 Counted
The numerical result is materially narrowed by unspecified benchmark configuration and cost accounting.
-
From OpenAI’s GPT-6 Astra on ARC-AGI-3 Read 2026-09-28 Relevance STRONG Steps 0 Counted
This does not negate the Standard-harness result, but it opposes treating 62.7% and roughly $26,000 as the model’s unqualified ARC-AGI-3 result.
Suppressed as dependent
| Evidence | Group | Kept instead |
|---|---|---|
| a1b8482e | 788df9ba |
Inferences
Concluded from
None.
Used as a premise in
None.
Threads
None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.
Claim edges
None. Edges are stored and displayed; v0.1 does not propagate probability across them.
Review checklist
Review checks: 0 of 4
| Check | Done | By |
|---|---|---|
| qualifiers reviewed | no | |
| opposing search done | no | |
| independence reviewed | no | |
| primary source reviewed | no |
Summary
Supported. The main support is: The Decoder reports a 62.7% Astra score on ARC-AGI-3 and a test cost of roughly $26,000. 0e034bfd
1 further item repeats the same origin and is not independent evidence. a1b8482e
Qualifier: The passage gives 62.7% and roughly $26,000 but omits the test date, exact configuration, denominator, sampling rules, and cost components. c3116613
Qualifier: ARC Prize reports 62.7% for the Standard harness but 99.9% for a Provider Adapter harness, so the score and cost require a harness qualifier. 4ae62e3a
A search for evidence in the opposing direction found something; see the counted evidence. 5cb67ef5
Review checks: 0 of 4. coverage:3ebea097-3321-889a-a37d-1252a84dd99c
Contribution history
| seq | event | detail |
|---|---|---|
| 12391 | APPENDED | |
| 12392 | ACCEPT | AUTOMATIC_AFTER_VALIDATION |
| 12397 | LINK_EVIDENCE | by 1efd24fe (accepted) |
| 12399 | TASK_RESULT | by 1efd24fe (accepted) |
| 12412 | TASK_RESULT | by 1efd24fe (accepted) |
| 12629 | TASK_RESULT | by 1efd24fe (accepted) |
Score trace
{
"claim": "3ebea097-3321-889a-a37d-1252a84dd99c",
"links": [
{
"kept": "4d9f673e-c4e6-8086-a30f-3989788df9ba",
"link": "0e7887ae-daef-83cb-a2ee-ec50f306cf23",
"group": null,
"reason": "dependent_strongest_only",
"edition": "NAMED_OR_UNRELATED",
"evidence": "0339e141-c16f-8b85-aa9e-10dda1b8482e",
"direction": "SUPPORT",
"magnitude": "1.800000",
"relevance": "DIRECT",
"extraction": "UNVERIFIED",
"provenance": "INDEPENDENT",
"observation": "DIRECT_TEXT",
"source_type": "SECONDARY_TEXT",
"authenticity": "UNVERIFIED",
"audit_confirmed": false,
"effective_weight": "0.000000",
"interpretive_steps": 0
},
{
"link": "4d9f673e-c4e6-8086-a30f-3989788df9ba",
"group": null,
"edition": "NAMED_OR_UNRELATED",
"evidence": "053d2fe5-a859-8eca-b458-b25d0e034bfd",
"direction": "SUPPORT",
"magnitude": "1.800000",
"relevance": "DIRECT",
"extraction": "UNVERIFIED",
"provenance": "INDEPENDENT",
"observation": "DIRECT_TEXT",
"source_type": "SECONDARY_TEXT",
"authenticity": "UNVERIFIED",
"audit_confirmed": false,
"effective_weight": "1.800000",
"interpretive_steps": 0
},
{
"link": "5e5bf37d-8a9b-8be1-bc7a-83be7d5a2ece",
"group": null,
"reason": "non_directional",
"edition": "NAMED_OR_UNRELATED",
"evidence": "24d5aaf6-119a-8332-9173-fc37c3116613",
"direction": "QUALIFY",
"magnitude": "1.800000",
"relevance": "DIRECT",
"extraction": "UNVERIFIED",
"provenance": "INDEPENDENT",
"observation": "DIRECT_TEXT",
"source_type": "SECONDARY_TEXT",
"authenticity": "UNVERIFIED",
"audit_confirmed": false,
"effective_weight": "0.000000",
"interpretive_steps": 0
},
{
"link": "93e73b23-b4ab-8d64-94e8-f7ed57fee915",
"group": null,
"reason": "non_directional",
"edition": "NAMED_OR_UNRELATED",
"evidence": "b565e5f2-d788-803b-82e6-c1584ae62e3a",
"direction": "QUALIFY",
"magnitude": "1.080000",
"relevance": "STRONG",
"extraction": "UNVERIFIED",
"provenance": "INDEPENDENT",
"observation": "DIRECT_TEXT",
"source_type": "WEBSITE",
"authenticity": "UNVERIFIED",
"audit_confirmed": false,
"effective_weight": "0.000000",
"interpretive_steps": 0
}
],
"model": "ledger-default@0.3.0",
"prior": "0.50",
"variants": {
"spread": "0.1331",
"permissive": "0.9121",
"conservative": "0.7790"
},
"code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
"contested": false,
"stability": "MEDIUM",
"claim_type": "QUANTITATIVE",
"config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
"probability": "0.8581",
"provisional": true,
"evidence_sum": "1.800000",
"snapshot_seq": 12630,
"prior_log_odds": "0.000000",
"support_groups": 1,
"model_dependent": false,
"review_coverage": "0.00",
"truth_evaluable": true,
"assessment_state": "SUPPORTED",
"review_checklist": {
"qualifiers_reviewed": {
"by": [],
"ok": false
},
"opposing_search_done": {
"by": [],
"ok": false
},
"independence_reviewed": {
"by": [],
"ok": false
},
"primary_source_reviewed": {
"by": [],
"ok": false
}
},
"contradict_groups": 0,
"rounding_boundary": false,
"posterior_log_odds": "1.800000",
"not_applicable_reason": null,
"independence_unreviewed": 4
}