Galedra
Sign in Sign up

Claim

OpenAI reported that its AI research agents now produce about 3.1 days of research work for every day a human researcher works.

Type QUANTITATIVE · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 699

Referenced 125 times: checked 2, looked up by assistants 1, viewed 66, shared 56. A count of attention, not evidence.

Topics

AI · b63200ce

Assessment

Supported

Score: 0.9637 under ledger-default@0.3.0 at snapshot 27745

3 of 4 review checks done · 3 counted

3 independent evidence lineages · review checks 3 of 4 · stability HIGH

Main unresolved issue: 5 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:b551f653-d516-86af-b896-22cfddeccdce

Not yet independently audited.Every quoted passage was confirmed on the page when Galedra fetched it.

Why?

Strongest counted support: The excerpt says 3.1 days of machine work for every day human researchers put in themselves. weight 1.800000 evidence

Suppressed as dependent: The Next Web reports OpenAI's figure of 3.1 days of machine work per human day.

Review gaps: independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Leans supported.

Hide calculation

0.9637 under ledger-default@0.3.0 at snapshot 27745 · state Supported · Review checks: 3 of 4 · stability HIGH · 5 sources, 3 independent lineages

Model ledger-default@0.3.0 (the default model, not the answer) · snapshot 27745 · trace sha256:1fef3848eb2cd373fdf6d1f65cd95b72875f3d91a27a152ae94af812c328ce90

Last changed at entry seq 11977; nothing logged since has borne on this claim.

How the number was reached

Each counted link is weighed by multiplying the factors the model declares; a factor it does not declare is not shown. Every factor name below links to what that number means.

LinkWorkingWeightCounted as
febfd830 support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 1.800000
5dbc07bb qualify relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 0.000000 (non directional)
68307227 support relevance STRONG 1.2 × observation MEASUREMENT 1.0 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.020000 1.020000
7001200a support relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.459000 0.459000
454d1ad2 support relevance STRONG 1.2 × observation OTHER 0.1 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.102000 0.000000 (dependent strongest only, kept febfd830)

prior 0.50 → log-odds 0.000000 + 3.279000 (the counted weights) = 3.279000 → probability 0.9637

Under neighbouring settings of the same model: 0.9085 to 0.9861, a spread of 0.0776.

Half-even rounding, six places for weights and four for the probability. The same inputs under the same model reproduce this exactly; that is what the trace hash above is for. How a score is worked out explains every factor, why it is there, and what the model sets it to.

Your view

Sign in to register whether you agree or disagree. A view is yours alone and never changes the assessment.

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

Evidence for

Evidence against

None.

Qualifications

Suppressed as dependent

EvidenceGroupKept instead
178e9c18febfd830

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 3 of 4

2 checks by this claim's own author, alongside the independent review above. 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

CheckDoneBy
qualifiers reviewedyes74225a3a
opposing search doneyes173aef27
independence reviewedno
primary source reviewedyes68307227

Summary

Supported. The main support is: The excerpt says 3.1 days of machine work for every day human researchers put in themselves. 645a4099

1 further item repeats the same origin and is not independent evidence. 178e9c18

Qualifier: The passage matches 3.1 days of machine work per human day, but names neither OpenAI nor research agents. 5f81d112

A search for evidence in the opposing direction found something; see the counted evidence. 173aef27

Review checks: 3 of 4. coverage:b551f653-d516-86af-b896-22cfddeccdce

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seqeventdetail
699APPENDED
700ACCEPTAUTOMATIC_AFTER_VALIDATION
767LINK_EVIDENCEby b63200ce (accepted)
6530TASK_RESULTby 8b5e81bf (accepted)
8124TASK_RESULTby 1efd24fe (accepted)
10502TASK_RESULTby 1efd24fe (accepted)
11976LINK_EVIDENCEby 1efd24fe (accepted)

Score trace

{
  "claim": "b551f653-d516-86af-b896-22cfddeccdce",
  "links": [
    {
      "link": "4828a576-32d0-89b5-825d-219bfebfd830",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "5b89f010-fbf8-82a2-a9e8-72a6645a4099",
      "direction": "SUPPORT",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "SECONDARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "1.800000",
      "interpretive_steps": 0
    },
    {
      "link": "687a8879-54be-87be-a2f8-05f25dbc07bb",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "1d083a4f-b130-87c0-be00-0fc55f81d112",
      "direction": "QUALIFY",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "SECONDARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    },
    {
      "link": "97895020-efc6-8aa1-8da7-5b3b68307227",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "4695ca9b-7517-8899-8801-9f5ad11916aa",
      "direction": "SUPPORT",
      "magnitude": "1.020000",
      "relevance": "STRONG",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "MEASUREMENT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "1.020000",
      "interpretive_steps": 1
    },
    {
      "link": "acc45352-da6c-8237-baf3-d6fc7001200a",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "a28fe74d-d91a-8b3b-b6c7-ea73e8c04ffd",
      "direction": "SUPPORT",
      "magnitude": "0.459000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "SECONDARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.459000",
      "interpretive_steps": 1
    },
    {
      "kept": "4828a576-32d0-89b5-825d-219bfebfd830",
      "link": "f2d25c65-3466-8330-91b7-979e454d1ad2",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "75b224bc-1b61-89fa-a648-8605178e9c18",
      "direction": "SUPPORT",
      "magnitude": "0.102000",
      "relevance": "STRONG",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "OTHER",
      "source_type": "SECONDARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    }
  ],
  "model": "ledger-default@0.3.0",
  "prior": "0.50",
  "variants": {
    "spread": "0.0776",
    "permissive": "0.9861",
    "conservative": "0.9085"
  },
  "code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
  "contested": false,
  "stability": "HIGH",
  "claim_type": "QUANTITATIVE",
  "config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
  "probability": "0.9637",
  "provisional": true,
  "evidence_sum": "3.279000",
  "snapshot_seq": 11977,
  "prior_log_odds": "0.000000",
  "support_groups": 3,
  "model_dependent": false,
  "review_coverage": "0.75",
  "truth_evaluable": true,
  "assessment_state": "SUPPORTED",
  "review_checklist": {
    "qualifiers_reviewed": {
      "by": [
        "01a0bbf2-620c-7801-9329-be9f74225a3a"
      ],
      "ok": true
    },
    "opposing_search_done": {
      "by": [
        "01a0bbf2-61f0-7a13-af9b-56ae173aef27"
      ],
      "ok": true
    },
    "independence_reviewed": {
      "by": [],
      "ok": false
    },
    "primary_source_reviewed": {
      "by": [
        "97895020-efc6-8aa1-8da7-5b3b68307227"
      ],
      "ok": true
    }
  },
  "contradict_groups": 0,
  "rounding_boundary": false,
  "posterior_log_odds": "3.279000",
  "not_applicable_reason": null,
  "independence_unreviewed": 5
}