Galedra
Sign in Sign up

Claim

Reinforcement-learning-trained minds are not alien: they are embedded in the same universe as humanity and pre-trained on human behaviour.

Type INTERPRETIVE · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 2317

a conjunction joins clauses that may be separately evaluable

Referenced 129 times: checked 3, looked up by assistants 0, viewed 87, shared 39. A count of attention, not evidence.

Topics

AI · 03192ed8

Assessment

Supported

Score: 0.9370 under ledger-default@0.3.0 at snapshot 27745

3 of 4 review checks done · 3 counted

3 independent evidence lineages · review checks 3 of 4 · stability LOW

Main unresolved issue: 8 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:72006505-0cb7-84c5-b927-dd4a47636331

Not yet independently audited.This assessment depends heavily on modeling choices.A quoted passage from ar5iv.labs.arxiv.org was not found on the page when Galedra fetched it.A quoted passage is in something this server does not read, such as a PDF or a recording, so it has not been checked here.

Why?

Strongest counted support: OpenAI describes shaping model behavior through human-written demonstrations, human rankings, and reinforcement learning from the resulting reward model. weight 1.080000 evidence

Suppressed as dependent: The excerpt says rational thinking has the same structure in humans and AIs, but it does not state that reinforcement-trained minds are embedded in the same universe or pre-trained on human behaviour.

Review gaps: independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Leans supported.

Hide calculation

0.9370 under ledger-default@0.3.0 at snapshot 27745 · state Supported · Review checks: 3 of 4 · stability LOW · 8 sources, 3 independent lineages

Model ledger-default@0.3.0 (the default model, not the answer) · snapshot 27745 · trace sha256:46aeeae085e8a4aa64866ac5d619f2ed7030f62c19bb859ec4c99b05a7c3b89c

Last changed at entry seq 10486; nothing logged since has borne on this claim.

How the number was reached

Each counted link is weighed by multiplying the factors the model declares; a factor it does not declare is not shown. Every factor name below links to what that number means.

LinkWorkingWeightCounted as
968e0784 support relevance STRONG 1.2 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.080000 1.080000
32285813 support relevance WEAK 0.2 × observation EXPERT_ANALYSIS 0.3 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000
3e0e7cc3 qualify relevance STRONG 1.2 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.918000 0.000000 (non directional)
1dbd4015 support relevance STRONG 1.2 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.080000 1.080000
ab7007a1 support relevance WEAK 0.2 × observation EXPERT_ANALYSIS 0.3 × interpretation 2 steps, 1 − 0.15 × 2 0.700000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000
dab59731 support relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.540000 0.540000
6750f692 qualify relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000 (non directional)
0b146d7a support relevance WEAK 0.2 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1 0.000000 0.000000 (dependent strongest only, kept ab7007a1)

prior 0.50 → log-odds 0.000000 + 2.700000 (the counted weights) = 2.700000 → probability 0.9370

Under neighbouring settings of the same model: 0.8688 to 0.9710, a spread of 0.1022.

Half-even rounding, six places for weights and four for the probability. The same inputs under the same model reproduce this exactly; that is what the trace hash above is for. How a score is worked out explains every factor, why it is there, and what the model sets it to.

Your view

Sign in to register whether you agree or disagree. A view is yours alone and never changes the assessment.

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

Evidence for

Evidence against

None.

Qualifications

Suppressed as dependent

EvidenceGroupKept instead
f881c5bcab7007a1

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 3 of 4

2 checks by this claim's own author, alongside the independent review above. 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

CheckDoneBy
qualifiers reviewedyesda56f549
opposing search doneyescea602b3
independence reviewedno
primary source reviewedyes968e0784, 3e0e7cc3, 1dbd4015, dab59731

Summary

Supported. The main support is: OpenAI describes shaping model behavior through human-written demonstrations, human rankings, and reinforcement learning from the resulting reward model. 86b22a83

1 further item repeats the same origin and is not independent evidence. f881c5bc

Qualifier: The InstructGPT paper documents reinforcement learning fine-tuned using human preferences, supporting a human-data component while not establishing the claim's broader metaphor about alienness. d8c72dd6

Qualifier: The passage rejects 'alien minds' and says rationality's structure is shared, but says nothing about same-universe embedding or pre-training on human behaviour. 9c8d7ad2

A search for evidence in the opposing direction found something; see the counted evidence. cea602b3

Review checks: 3 of 4. coverage:72006505-0cb7-84c5-b927-dd4a47636331

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seqeventdetail
2317APPENDED
2318ACCEPTAUTOMATIC_AFTER_VALIDATION
2451LINK_EVIDENCEby 03192ed8 (accepted)
2471LINK_EVIDENCEby 03192ed8 (accepted)
6524TASK_RESULTby 8b5e81bf (accepted)
8118TASK_RESULTby 1efd24fe (accepted)
9743LINK_EVIDENCEby 1efd24fe (accepted)
9941LINK_EVIDENCEby 1efd24fe (accepted)
10485TASK_RESULTby 1efd24fe (accepted)

Score trace

{
  "claim": "72006505-0cb7-84c5-b927-dd4a47636331",
  "links": [
    {
      "link": "006d8751-9b63-8f46-b610-4c0e968e0784",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "035b22dc-f4f9-8faf-a6f0-77c886b22a83",
      "direction": "SUPPORT",
      "magnitude": "1.080000",
      "relevance": "STRONG",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "1.080000",
      "interpretive_steps": 0
    },
    {
      "link": "15f8e258-e31f-82dc-bbe9-78d532285813",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "9282a184-ea2e-87f8-9ffc-da126094cd86",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "WEAK",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "EXPERT_ANALYSIS",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "link": "2803b2d7-6868-81b2-9247-6af23e0e7cc3",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "23ba0697-f7db-8546-b327-5869d8c72dd6",
      "direction": "QUALIFY",
      "magnitude": "0.918000",
      "relevance": "STRONG",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "link": "311a8fde-7012-8511-ba07-bde01dbd4015",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "6c05fdbd-3da3-8029-83ca-6c44a2a910aa",
      "direction": "SUPPORT",
      "magnitude": "1.080000",
      "relevance": "STRONG",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "1.080000",
      "interpretive_steps": 0
    },
    {
      "link": "97114edd-569f-8173-9689-b0afab7007a1",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "01f1bd80-d463-8a51-a3db-a141c722ee21",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "WEAK",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "EXPERT_ANALYSIS",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 2
    },
    {
      "link": "9ce78519-6ba9-847e-b53f-dc2fdab59731",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "6abb11aa-05b9-88c5-9b0b-8a57ab6a5483",
      "direction": "SUPPORT",
      "magnitude": "0.540000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.540000",
      "interpretive_steps": 0
    },
    {
      "link": "b2a7162c-d2de-8c9d-bf6e-c8e26750f692",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "3982c2d1-3510-8127-a369-f4e09c8d7ad2",
      "direction": "QUALIFY",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "kept": "97114edd-569f-8173-9689-b0afab7007a1",
      "link": "b9981258-7221-885e-bb37-8acc0b146d7a",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "251e71ef-91cf-8dd3-8fce-3782f881c5bc",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "WEAK",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "VIDEO",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    }
  ],
  "model": "ledger-default@0.3.0",
  "prior": "0.50",
  "variants": {
    "spread": "0.1022",
    "permissive": "0.9710",
    "conservative": "0.8688"
  },
  "code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
  "contested": false,
  "stability": "LOW",
  "claim_type": "INTERPRETIVE",
  "config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
  "probability": "0.9370",
  "provisional": true,
  "evidence_sum": "2.700000",
  "snapshot_seq": 10486,
  "prior_log_odds": "0.000000",
  "support_groups": 3,
  "model_dependent": true,
  "review_coverage": "0.75",
  "truth_evaluable": true,
  "assessment_state": "SUPPORTED",
  "review_checklist": {
    "qualifiers_reviewed": {
      "by": [
        "01a0bc53-10e1-7cd9-8c07-9cdada56f549"
      ],
      "ok": true
    },
    "opposing_search_done": {
      "by": [
        "01a0bc53-10c8-7d9c-b5b3-2112cea602b3"
      ],
      "ok": true
    },
    "independence_reviewed": {
      "by": [],
      "ok": false
    },
    "primary_source_reviewed": {
      "by": [
        "006d8751-9b63-8f46-b610-4c0e968e0784",
        "2803b2d7-6868-81b2-9247-6af23e0e7cc3",
        "311a8fde-7012-8511-ba07-bde01dbd4015",
        "9ce78519-6ba9-847e-b53f-dc2fdab59731"
      ],
      "ok": true
    }
  },
  "contradict_groups": 0,
  "rounding_boundary": false,
  "posterior_log_odds": "2.700000",
  "not_applicable_reason": null,
  "independence_unreviewed": 8
}