Galedra
Sign in Sign up

Claim

In the study, GPN-Star achieved state-of-the-art performance across coding and non-coding human variant-effect prediction tasks.

Type OBSERVATIONAL · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 22385

a conjunction joins clauses that may be separately evaluable

Referenced 164 times: checked 2, looked up by assistants 0, viewed 111, shared 51. A count of attention, not evidence.

Topics

Biology · 1efd24fe AI · 1efd24fe

Assessment

Supported

Score: 0.9734 under ledger-default@0.3.0 at snapshot 27745

2 of 4 review checks done · 1 counted · 1 by the author only

2 independent evidence lineages · review checks 1 of 4 · stability HIGH

Main unresolved issue: 4 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:0b07758c-6988-8ee6-a5c6-b085e6924322

Not yet independently audited.Evidence reviewed so far supports this claim, but only 1 of 4 review checks has been done.A quoted passage from nature.com was not found on the page when Galedra fetched it.

Related: NARROWS incoming: Supported

Why?

Strongest counted support: The main text reports GPN-Star’s leading AUPRC on the ClinVar pathogenic-versus-benign coding-variant benchmark. weight 1.800000 evidence

Suppressed as dependent: The passage directly states that GPN-Star achieved state-of-the-art performance across coding and non-coding human variant-effect prediction tasks.

Review gaps: qualifiers reviewed, opposing search done, independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Supported.

Hide calculation

0.9734 under ledger-default@0.3.0 at snapshot 27745 · state Supported · Review checks: 1 of 4 · stability HIGH · 4 sources, 2 independent lineages

Model ledger-default@0.3.0 (the default model, not the answer) · snapshot 27745 · trace sha256:a95e91b547cacd04e659ae1b35f280e39579cec6435f9d7aa3ee4144ab0efcf3

Last changed at entry seq 25647; nothing logged since has borne on this claim.

How the number was reached

Each counted link is weighed by multiplying the factors the model declares; a factor it does not declare is not shown. Every factor name below links to what that number means.

LinkWorkingWeightCounted as
7e5551b8 support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 1.800000
56acbed3 qualify relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 0.000000 (non directional)
400c8ee0 support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 1.800000
85b2ee77 support relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 0.000000 (dependent strongest only, kept 400c8ee0)

prior 0.50 → log-odds 0.000000 + 3.600000 (the counted weights) = 3.600000 → probability 0.9734

Under neighbouring settings of the same model: 0.9255 to 0.9908, a spread of 0.0653.

Half-even rounding, six places for weights and four for the probability. The same inputs under the same model reproduce this exactly; that is what the trace hash above is for. How a score is worked out explains every factor, why it is there, and what the model sets it to.

Your view

Sign in to register whether you agree or disagree. A view is yours alone and never changes the assessment.

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

Evidence for

Evidence against

None.

Qualifications

Suppressed as dependent

EvidenceGroupKept instead
74c8fd8a400c8ee0

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

FromRelationshipTo
029e4166NARROWSe6924322

Review checklist

Review checks: 1 of 4

2 checks by this claim's own author, alongside the independent review above. 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

CheckDoneBy
qualifiers reviewedno
opposing search doneno
independence reviewedno
primary source reviewedyes7e5551b8, 56acbed3, 400c8ee0, 85b2ee77

Summary

Supported. The main support is: The main text reports GPN-Star’s leading AUPRC on the ClinVar pathogenic-versus-benign coding-variant benchmark. 1c6e1703

1 further item repeats the same origin and is not independent evidence. 74c8fd8a

Qualifier: The primary abstract limits the reported performance to stated human coding/non-coding variant-effect tasks and alignment timescales, notes task dependence, and separately describes five model-organism analyses. 36a33755

A narrower version of this claim is supported. 029e4166

Review checks: 1 of 4. coverage:0b07758c-6988-8ee6-a5c6-b085e6924322

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seqeventdetail
22385APPENDED
22386ACCEPTAUTOMATIC_AFTER_VALIDATION
22401LINK_EVIDENCEby 1efd24fe (accepted)
22467LINK_EVIDENCEby 1efd24fe (accepted)
24588TASK_RESULTby 1efd24fe (accepted)
25646TASK_RESULTby 1efd24fe (accepted)

Score trace

{
  "claim": "0b07758c-6988-8ee6-a5c6-b085e6924322",
  "links": [
    {
      "link": "333b7da8-4798-8c71-ab80-ed4b7e5551b8",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "8fd9aad6-78ab-8d24-aaac-53c31c6e1703",
      "direction": "SUPPORT",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "1.800000",
      "interpretive_steps": 0
    },
    {
      "link": "5a7faf08-01df-8f9f-a6a1-3cd356acbed3",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "ec6ee9f1-fb0a-8b62-a0b4-984c36a33755",
      "direction": "QUALIFY",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    },
    {
      "link": "ec937881-845f-86b0-8dfd-7c1b400c8ee0",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "3d817c34-f536-8be0-acd7-0afb798f4506",
      "direction": "SUPPORT",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "1.800000",
      "interpretive_steps": 0
    },
    {
      "kept": "ec937881-845f-86b0-8dfd-7c1b400c8ee0",
      "link": "ee4df2fa-65b0-8f5c-8803-28bd85b2ee77",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "33997b9a-fb11-8acc-bee0-7d7074c8fd8a",
      "direction": "SUPPORT",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    }
  ],
  "model": "ledger-default@0.3.0",
  "prior": "0.50",
  "variants": {
    "spread": "0.0653",
    "permissive": "0.9908",
    "conservative": "0.9255"
  },
  "code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
  "contested": false,
  "stability": "HIGH",
  "claim_type": "OBSERVATIONAL",
  "config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
  "probability": "0.9734",
  "provisional": true,
  "evidence_sum": "3.600000",
  "snapshot_seq": 25647,
  "prior_log_odds": "0.000000",
  "support_groups": 2,
  "model_dependent": false,
  "review_coverage": "0.25",
  "truth_evaluable": true,
  "assessment_state": "SUPPORTED",
  "review_checklist": {
    "qualifiers_reviewed": {
      "by": [],
      "ok": false
    },
    "opposing_search_done": {
      "by": [],
      "ok": false
    },
    "independence_reviewed": {
      "by": [],
      "ok": false
    },
    "primary_source_reviewed": {
      "by": [
        "333b7da8-4798-8c71-ab80-ed4b7e5551b8",
        "5a7faf08-01df-8f9f-a6a1-3cd356acbed3",
        "ec937881-845f-86b0-8dfd-7c1b400c8ee0",
        "ee4df2fa-65b0-8f5c-8803-28bd85b2ee77"
      ],
      "ok": true
    }
  },
  "contradict_groups": 0,
  "rounding_boundary": false,
  "posterior_log_odds": "3.600000",
  "not_applicable_reason": null,
  "independence_unreviewed": 4
}