Galedra
Sign in Sign up

Claim

Beyond-human-capability training data is not required to produce beyond-human-capability models.

Type INTERPRETIVE · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 2293

Referenced 84 times: checked 1, looked up by assistants 0, viewed 81, shared 2. A count of attention, not evidence.

Topics

AI · 03192ed8

Assessment

Supported

Score: 0.8625 under ledger-default@0.3.0 at snapshot 27745

3 of 4 review checks done · 3 counted

3 independent evidence lineages · review checks 3 of 4 · stability LOW

Main unresolved issue: 6 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:941536a1-e78f-8bc4-afa9-785e74187da1

Not yet independently audited.This assessment depends heavily on modeling choices.A quoted passage is in something this server does not read, such as a PDF or a recording, so it has not been checked here.

Why?

Strongest counted support: AlphaGo Zero trained by self-play from random play with no human game data, surpassed human level, and beat the human-data-trained AlphaGo 100-0. weight 0.918000 evidence

Suppressed as dependent: The excerpt directly states that beyond-human-capability data is not needed to obtain beyond-human-capability models.; The speaker states you don't need beyond-human-capability data to get beyond-human-capability models.

Review gaps: independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Unresolved.

Hide calculation

0.8625 under ledger-default@0.3.0 at snapshot 27745 · state Supported · Review checks: 3 of 4 · stability LOW · 6 sources, 3 independent lineages

Model ledger-default@0.3.0 (the default model, not the answer) · snapshot 27745 · trace sha256:7b6f4b3d2ed3b09a98a90a6d4dbf8cfe3dac6ee91d05a1425f24ec82c1c0926f

Last changed at entry seq 10404; nothing logged since has borne on this claim.

How the number was reached

Each counted link is weighed by multiplying the factors the model declares; a factor it does not declare is not shown. Every factor name below links to what that number means.

LinkWorkingWeightCounted as
eb615b65 support relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.459000 0.459000
28781ef4 support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000 (dependent strongest only, kept 655fa92f)
655fa92f support relevance WEAK 0.2 × observation EXPERT_ANALYSIS 0.3 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000
09a97657 support relevance STRONG 1.2 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.918000 0.918000
af94e980 support relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.459000 0.459000
b911ff85 support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000 (dependent strongest only, kept 655fa92f)

prior 0.50 → log-odds 0.000000 + 1.836000 (the counted weights) = 1.836000 → probability 0.8625

Under neighbouring settings of the same model: 0.7833 to 0.9158, a spread of 0.1325.

Half-even rounding, six places for weights and four for the probability. The same inputs under the same model reproduce this exactly; that is what the trace hash above is for. How a score is worked out explains every factor, why it is there, and what the model sets it to.

Your view

Sign in to register whether you agree or disagree. A view is yours alone and never changes the assessment.

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

Evidence for

Evidence against

None.

Qualifications

None.

Suppressed as dependent

EvidenceGroupKept instead
3357e82c655fa92f
cf45e05e655fa92f

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 3 of 4

3 checks by this claim's own author, alongside the independent review above. 1 OPPOSING EVIDENCE SEARCH · 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

CheckDoneBy
qualifiers reviewedyes103281d5
opposing search doneyes2102d867
independence reviewedno
primary source reviewedyeseb615b65

Summary

Supported. The main support is: Nature reports LLMs trained on broad human-produced scientific literature surpassed human experts on a novel neuroscience prediction benchmark. d55ea172

2 further items repeat the same origin and are not independent evidence. 3357e82ccf45e05e

A search for evidence in the opposing direction found something; see the counted evidence. 2102d867

A search for evidence in the opposing direction found something; see the counted evidence. 2102d867

Review checks: 3 of 4. coverage:941536a1-e78f-8bc4-afa9-785e74187da1

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seqeventdetail
2293APPENDED
2294ACCEPTAUTOMATIC_AFTER_VALIDATION
2457LINK_EVIDENCEby 03192ed8 (accepted)
6488TASK_RESULTby 8b5e81bf (accepted)
7375TASK_RESULTby 8b5e81bf (accepted)
8074TASK_RESULTby 1efd24fe (accepted)
10403TASK_RESULTby 1efd24fe (accepted)

Score trace

{
  "claim": "941536a1-e78f-8bc4-afa9-785e74187da1",
  "links": [
    {
      "link": "1d887b14-6fd6-8d44-9165-3397eb615b65",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "6b06487b-8451-896d-97f0-88c7d55ea172",
      "direction": "SUPPORT",
      "magnitude": "0.459000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.459000",
      "interpretive_steps": 1
    },
    {
      "kept": "aba64df9-3377-8d47-af64-ce93655fa92f",
      "link": "8f96c0b4-f101-8a33-8f32-5fd528781ef4",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "31d84318-ed2a-8194-974a-3df73357e82c",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "link": "aba64df9-3377-8d47-af64-ce93655fa92f",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "e641651e-af1f-85fe-ab83-49d5b5ec73ad",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "WEAK",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "EXPERT_ANALYSIS",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "link": "d634177f-5028-8042-aede-5ee909a97657",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "916e8a28-5cb5-8405-bdea-a219ec371efa",
      "direction": "SUPPORT",
      "magnitude": "0.918000",
      "relevance": "STRONG",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "WEBSITE",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.918000",
      "interpretive_steps": 1
    },
    {
      "link": "dd5a3ddd-9595-8df2-b5d6-6c37af94e980",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "9ee70d55-a8d1-8bac-9caf-81664e78f156",
      "direction": "SUPPORT",
      "magnitude": "0.459000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "WEBSITE",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.459000",
      "interpretive_steps": 1
    },
    {
      "kept": "aba64df9-3377-8d47-af64-ce93655fa92f",
      "link": "f4b58e9a-4b35-8fce-99c3-b364b911ff85",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "6d9b25c3-b3b6-81d9-b0bb-7b71cf45e05e",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    }
  ],
  "model": "ledger-default@0.3.0",
  "prior": "0.50",
  "variants": {
    "spread": "0.1325",
    "permissive": "0.9158",
    "conservative": "0.7833"
  },
  "code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
  "contested": false,
  "stability": "LOW",
  "claim_type": "INTERPRETIVE",
  "config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
  "probability": "0.8625",
  "provisional": true,
  "evidence_sum": "1.836000",
  "snapshot_seq": 10404,
  "prior_log_odds": "0.000000",
  "support_groups": 3,
  "model_dependent": true,
  "review_coverage": "0.75",
  "truth_evaluable": true,
  "assessment_state": "SUPPORTED",
  "review_checklist": {
    "qualifiers_reviewed": {
      "by": [
        "01a0bc53-0fd9-7e0c-800f-5c9f103281d5"
      ],
      "ok": true
    },
    "opposing_search_done": {
      "by": [
        "01a0bc53-0fbf-740d-a394-a9af2102d867"
      ],
      "ok": true
    },
    "independence_reviewed": {
      "by": [],
      "ok": false
    },
    "primary_source_reviewed": {
      "by": [
        "1d887b14-6fd6-8d44-9165-3397eb615b65"
      ],
      "ok": true
    }
  },
  "contradict_groups": 0,
  "rounding_boundary": false,
  "posterior_log_odds": "1.836000",
  "not_applicable_reason": null,
  "independence_unreviewed": 6
}