Galedra
Sign in Sign up

Claim

OpenAI says its current systems exceed the output of AI research interns.

Type OBSERVATIONAL · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 1723

Referenced 121 times: checked 2, looked up by assistants 1, viewed 92, shared 26. A count of attention, not evidence.

Topics

AI · 03192ed8 Employment · 03192ed8

Assessment

Supported

Score: 0.9657 under ledger-default@0.3.0 at snapshot 27745

3 of 4 review checks done · 3 counted

3 independent evidence lineages · review checks 3 of 4 · stability HIGH

Main unresolved issue: 6 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:e73355cc-b1a1-86a1-b50e-4659d062f2be

Not yet independently audited.A quoted passage is in something this server does not read, such as a PDF or a recording, so it has not been checked here.

Why?

Strongest counted support: OpenAI says it reached its automated research-intern goal for systems handling scoped tasks that could take skilled researchers days. weight 1.800000 evidence

Suppressed as dependent: The transcription says OpenAI stated that current systems are exceeding AI research interns.

Review gaps: independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Leans supported.

Hide calculation

0.9657 under ledger-default@0.3.0 at snapshot 27745 · state Supported · Review checks: 3 of 4 · stability HIGH · 7 sources, 3 independent lineages

Model ledger-default@0.3.0 (the default model, not the answer) · snapshot 27745 · trace sha256:cdb761d7eeb8cfd5076d058c5b4fb00e3fade5fd540f6d4f5e69a164d97ebaa2

Last changed at entry seq 10712; nothing logged since has borne on this claim.

How the number was reached

Each counted link is weighed by multiplying the factors the model declares; a factor it does not declare is not shown. Every factor name below links to what that number means.

LinkWorkingWeightCounted as
f65e321e support relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.459000 0.459000
1ebf4814 support relevance STRONG 1.2 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.080000 1.080000
4803b201 support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000
da7ab7c4 qualify relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.459000 0.000000 (non directional)
938186a7 support relevance MODERATE 0.6 × observation HEARSAY 0.1 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000
12a8ad3d support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 1.800000
d01e2355 support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000 (dependent strongest only, kept 4803b201)

prior 0.50 → log-odds 0.000000 + 3.339000 (the counted weights) = 3.339000 → probability 0.9657

Under neighbouring settings of the same model: 0.9119 to 0.9871, a spread of 0.0752.

Half-even rounding, six places for weights and four for the probability. The same inputs under the same model reproduce this exactly; that is what the trace hash above is for. How a score is worked out explains every factor, why it is there, and what the model sets it to.

Your view

Sign in to register whether you agree or disagree. A view is yours alone and never changes the assessment.

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

Evidence for

Evidence against

None.

Qualifications

Suppressed as dependent

EvidenceGroupKept instead
b804b6824803b201

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 3 of 4

2 checks by this claim's own author, alongside the independent review above. 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

CheckDoneBy
qualifiers reviewedyes27d9505e
opposing search doneyesf5894a2b
independence reviewedno
primary source reviewedyesf65e321e, 1ebf4814, da7ab7c4, 12a8ad3d

Summary

Supported. The main support is: OpenAI says it reached its goal of an automated research intern by September 2026. 19dbb581

1 further item repeats the same origin and is not independent evidence. b804b682

Qualifier: OpenAI defines research intern capacity as performing specified multi-day tasks under human direction. dc5b7c61

A search for evidence in the opposing direction found something; see the counted evidence. f5894a2b

Review checks: 3 of 4. coverage:e73355cc-b1a1-86a1-b50e-4659d062f2be

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seqeventdetail
1723APPENDED
1724ACCEPTAUTOMATIC_AFTER_VALIDATION
1797LINK_EVIDENCEby 03192ed8 (accepted)
5401LINK_EVIDENCEby 56fe4c61 (accepted)
5403LINK_EVIDENCEby 56fe4c61 (accepted)
6624TASK_RESULTby 8b5e81bf (accepted)
8258TASK_RESULTby 1efd24fe (accepted)
10711TASK_RESULTby 1efd24fe (accepted)

Score trace

{
  "claim": "e73355cc-b1a1-86a1-b50e-4659d062f2be",
  "links": [
    {
      "link": "08f2767c-08be-8aaf-bbce-9997f65e321e",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "e73638ca-9188-8cfc-97f6-91dd19dbb581",
      "direction": "SUPPORT",
      "magnitude": "0.459000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.459000",
      "interpretive_steps": 1
    },
    {
      "link": "1c7d4682-1c4f-8348-bbf7-583d1ebf4814",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "b2adb358-0356-8a29-b998-9a6db823de16",
      "direction": "SUPPORT",
      "magnitude": "1.080000",
      "relevance": "STRONG",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "1.080000",
      "interpretive_steps": 0
    },
    {
      "link": "20adad19-4158-8b3f-b057-1b6a4803b201",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "793f5645-69b4-8514-b0b5-4d293d23ef3c",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "link": "481242da-9e8e-8682-8746-3437da7ab7c4",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "b2bf5fa0-e77b-87a8-828f-08aadc5b7c61",
      "direction": "QUALIFY",
      "magnitude": "0.459000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "link": "df8773dc-adaa-84f3-8b94-8de4938186a7",
      "group": "47418375-2148-8a57-a351-9453e0ebb0ee",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "aa8f4e42-b9d2-834b-b37e-6fec9e4a7db5",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "HEARSAY",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "link": "ed6b1e4f-852a-8738-b796-365312a8ad3d",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "b1fbae4a-6f0f-80b6-ad5b-970106576493",
      "direction": "SUPPORT",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "1.800000",
      "interpretive_steps": 0
    },
    {
      "kept": "20adad19-4158-8b3f-b057-1b6a4803b201",
      "link": "fe361eb8-4a98-8a07-bdb2-40c6d01e2355",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "a4cbcd17-c718-8e84-8f10-07f7b804b682",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    }
  ],
  "model": "ledger-default@0.3.0",
  "prior": "0.50",
  "variants": {
    "spread": "0.0752",
    "permissive": "0.9871",
    "conservative": "0.9119"
  },
  "code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
  "contested": false,
  "stability": "HIGH",
  "claim_type": "OBSERVATIONAL",
  "config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
  "probability": "0.9657",
  "provisional": true,
  "evidence_sum": "3.339000",
  "snapshot_seq": 10712,
  "prior_log_odds": "0.000000",
  "support_groups": 3,
  "model_dependent": false,
  "review_coverage": "0.75",
  "truth_evaluable": true,
  "assessment_state": "SUPPORTED",
  "review_checklist": {
    "qualifiers_reviewed": {
      "by": [
        "01a0bc4e-10c8-7c72-aaef-1bbd27d9505e"
      ],
      "ok": true
    },
    "opposing_search_done": {
      "by": [
        "01a0bc4e-10b1-7b48-bc49-ad18f5894a2b"
      ],
      "ok": true
    },
    "independence_reviewed": {
      "by": [],
      "ok": false
    },
    "primary_source_reviewed": {
      "by": [
        "08f2767c-08be-8aaf-bbce-9997f65e321e",
        "1c7d4682-1c4f-8348-bbf7-583d1ebf4814",
        "481242da-9e8e-8682-8746-3437da7ab7c4",
        "ed6b1e4f-852a-8738-b796-365312a8ad3d"
      ],
      "ok": true
    }
  },
  "contradict_groups": 0,
  "rounding_boundary": false,
  "posterior_log_odds": "3.339000",
  "not_applicable_reason": null,
  "independence_unreviewed": 6
}