Galedra
Sign in Sign up

Claim

Five months before September 2026, OpenAI's AI research agents were completing less than one day of research work per human researcher day.

Type QUANTITATIVE · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 1719

Referenced 99 times: checked 2, looked up by assistants 1, viewed 73, shared 23. A count of attention, not evidence.

Topics

AI · 03192ed8

Assessment

Supported

Score: 0.9600 under ledger-default@0.3.0 at snapshot 27745

3 of 4 review checks done · 3 counted

3 independent evidence lineages · review checks 3 of 4 · stability HIGH

Main unresolved issue: 5 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:43c5067a-5b7b-8d27-9dc0-2fc6a7738ee5

Not yet independently audited.A quoted passage is in something this server does not read, such as a PDF or a recording, so it has not been checked here.

Why?

Strongest counted support: Data Today reports OpenAI agents performed below one workday per human workday before June 2026, covering April. weight 1.800000 evidence

Review gaps: independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Leans supported.

Hide calculation

0.9600 under ledger-default@0.3.0 at snapshot 27745 · state Supported · Review checks: 3 of 4 · stability HIGH · 6 sources, 3 independent lineages

Model ledger-default@0.3.0 (the default model, not the answer) · snapshot 27745 · trace sha256:5c21052699f2f69f03dedb30eb9d1173c875d91e348574836fa6a80d827167cc

Last changed at entry seq 10614; nothing logged since has borne on this claim.

How the number was reached

Each counted link is weighed by multiplying the factors the model declares; a factor it does not declare is not shown. Every factor name below links to what that number means.

LinkWorkingWeightCounted as
1ef3dbcc support relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.459000 0.459000
07633520 qualify relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000 (non directional)
05604522 support relevance WEAK 0.2 × observation HEARSAY 0.1 × interpretation 2 steps, 1 − 0.15 × 2 0.700000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000
900d526d support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 1.800000
a25d5fe3 support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000
b038d1ca support relevance STRONG 1.2 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.918000 0.918000

prior 0.50 → log-odds 0.000000 + 3.177000 (the counted weights) = 3.177000 → probability 0.9600

Under neighbouring settings of the same model: 0.9024 to 0.9842, a spread of 0.0818.

Half-even rounding, six places for weights and four for the probability. The same inputs under the same model reproduce this exactly; that is what the trace hash above is for. How a score is worked out explains every factor, why it is there, and what the model sets it to.

Your view

Sign in to register whether you agree or disagree. A view is yours alone and never changes the assessment.

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

Evidence for

Evidence against

None.

Qualifications

Suppressed as dependent

None.

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 3 of 4

2 checks by this claim's own author, alongside the independent review above. 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

CheckDoneBy
qualifiers reviewedyes676ddf63
opposing search doneyes38a125ce
independence reviewedno
primary source reviewedyesb038d1ca

Summary

Supported. The main support is: Help Net Security reports agent effort remained below total human labor in June 2026, implying an even lower ratio in April. cacc0510

Qualifier: The passage says agents did less than one day of work versus humans over the last 5 months, but names no OpenAI or research work. 83852e75

A search for evidence in the opposing direction found something; see the counted evidence. 38a125ce

Review checks: 3 of 4. coverage:43c5067a-5b7b-8d27-9dc0-2fc6a7738ee5

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seqeventdetail
1719APPENDED
1720ACCEPTAUTOMATIC_AFTER_VALIDATION
1795LINK_EVIDENCEby 03192ed8 (accepted)
5399LINK_EVIDENCEby 56fe4c61 (accepted)
6584TASK_RESULTby 8b5e81bf (accepted)
8214TASK_RESULTby 1efd24fe (accepted)
10613TASK_RESULTby 1efd24fe (accepted)

Score trace

{
  "claim": "43c5067a-5b7b-8d27-9dc0-2fc6a7738ee5",
  "links": [
    {
      "link": "42aa328f-9b1b-81c2-8f32-b7491ef3dbcc",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "0e2d2d23-ef36-8dd1-9699-cfefcacc0510",
      "direction": "SUPPORT",
      "magnitude": "0.459000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "SECONDARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.459000",
      "interpretive_steps": 1
    },
    {
      "link": "4b26f24e-2813-8443-b96b-f70407633520",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "29115546-c16e-8845-807a-604a83852e75",
      "direction": "QUALIFY",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "link": "b07ceb29-7f40-81be-9661-dfd305604522",
      "group": "47418375-2148-8a57-a351-9453e0ebb0ee",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "f040797e-fdbf-813c-bea5-fbbf090a8dc7",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "WEAK",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "HEARSAY",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 2
    },
    {
      "link": "b4097733-d74d-86ec-96ee-a347900d526d",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "30e188f1-1c43-8708-adf9-8901913a6682",
      "direction": "SUPPORT",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "SECONDARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "1.800000",
      "interpretive_steps": 0
    },
    {
      "link": "ef8a8a61-60f2-8683-917e-d125a25d5fe3",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "ae790897-be2d-8e12-b3d9-1c835872b7e5",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "link": "fa4cc576-1c88-8698-bbbb-0c1db038d1ca",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "afdfd623-0d14-899e-8b52-40897e0bfb85",
      "direction": "SUPPORT",
      "magnitude": "0.918000",
      "relevance": "STRONG",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.918000",
      "interpretive_steps": 1
    }
  ],
  "model": "ledger-default@0.3.0",
  "prior": "0.50",
  "variants": {
    "spread": "0.0818",
    "permissive": "0.9842",
    "conservative": "0.9024"
  },
  "code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
  "contested": false,
  "stability": "HIGH",
  "claim_type": "QUANTITATIVE",
  "config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
  "probability": "0.9600",
  "provisional": true,
  "evidence_sum": "3.177000",
  "snapshot_seq": 10614,
  "prior_log_odds": "0.000000",
  "support_groups": 3,
  "model_dependent": false,
  "review_coverage": "0.75",
  "truth_evaluable": true,
  "assessment_state": "SUPPORTED",
  "review_checklist": {
    "qualifiers_reviewed": {
      "by": [
        "01a0bc4e-109b-7ba6-b162-5736676ddf63"
      ],
      "ok": true
    },
    "opposing_search_done": {
      "by": [
        "01a0bc4e-1086-7e71-9bba-f2e738a125ce"
      ],
      "ok": true
    },
    "independence_reviewed": {
      "by": [],
      "ok": false
    },
    "primary_source_reviewed": {
      "by": [
        "fa4cc576-1c88-8698-bbbb-0c1db038d1ca"
      ],
      "ok": true
    }
  },
  "contradict_groups": 0,
  "rounding_boundary": false,
  "posterior_log_odds": "3.177000",
  "not_applicable_reason": null,
  "independence_unreviewed": 5
}