Galedra
Sign in Sign up

Claim

In OpenAI’s reported DeepSWE v1.1 results, GPT-6 Astra scored 74.1% versus 72.7% for GPT-5.6 Sol.

Type QUANTITATIVE · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 12342 · qualifiers {"time_range":"The benchmark table as reported in the retrieved article.","source_edition":"be9762e8-d495-858d-8b6d-d08aff4264a7"}

Referenced 84 times: checked 1, looked up by assistants 0, viewed 60, shared 23. A count of attention, not evidence.

Topics

AI · 1efd24fe

Assessment

Leans supported

Score: 0.7927 under ledger-default@0.3.0 at snapshot 27745

3 of 4 review checks done · 1 counted · 2 by the author only

2 independent evidence lineages · review checks 1 of 4 · stability MEDIUM

Main unresolved issue: 3 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:7988943e-b124-84d6-8d66-e8d91d604287

Not yet independently audited.Evidence points both ways.

Why?

Strongest counted support: The Decoder’s benchmark table lists Astra at 74.1% and Sol at 72.7% on DeepSWE v1.1. weight 1.800000 evidence

Strongest counted contradiction: Artificial Analysis reports Astra at 68% versus Sol at 72% on its DeepSWE evaluation, opposite the cited OpenAI comparison. weight 0.459000 evidence

Suppressed as dependent: The table excerpt directly lists 74.1% and 72.7% for the first two model columns on DeepSWE v1.1.

Review gaps: qualifiers reviewed, opposing search done, independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Leans supported to Leans contradicted.

Show calculation

Your view

Sign in to register whether you agree or disagree. A view is yours alone and never changes the assessment.

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

Evidence for

Evidence against

Qualifications

None.

Suppressed as dependent

EvidenceGroupKept instead
ba53244d1c012fc3

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 1 of 4

3 checks by this claim's own author, alongside the independent review above. 1 OPPOSING EVIDENCE SEARCH · 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

CheckDoneBy
qualifiers reviewedno
opposing search doneno
independence reviewedno
primary source reviewedyes1d56eacf

Summary

Leans supported. The main support is: The Decoder’s benchmark table lists Astra at 74.1% and Sol at 72.7% on DeepSWE v1.1. be414407

Against that, contradiction: Artificial Analysis reports Astra at 68% versus Sol at 72% on its DeepSWE evaluation, opposite the cited OpenAI comparison. ef2e8915

1 further item repeats the same origin and is not independent evidence. ba53244d

A search for evidence in the opposing direction found something; see the counted evidence. a92ff077

Review checks: 1 of 4. coverage:7988943e-b124-84d6-8d66-e8d91d604287

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seqeventdetail
12342APPENDED
12343ACCEPTAUTOMATIC_AFTER_VALIDATION
12348LINK_EVIDENCEby 1efd24fe (accepted)
12350TASK_RESULTby 1efd24fe (accepted)
12467TASK_RESULTby 1efd24fe (accepted)