Claim

Across 26 data- and discovery-focused papers, Paper2Agent’s resource layer achieved 89.0 ± 3.1% accuracy on 100 synthesis questions and was reported as cheaper and faster than a browser-use baseline.

Type QUANTITATIVE · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 22877

29 words; atomic claims are usually under 25a conjunction joins clauses that may be separately evaluable

Referenced 143 times: checked 2, looked up by assistants 0, viewed 106, shared 35. A count of attention, not evidence.

Topics

AI · 1efd24fe Statistics · 1efd24fe

Assessment

Leans supported

Score: 0.6318 under ledger-default@0.3.0 at snapshot 27745

3 of 4 review checks done · 1 counted · 2 by the author only

1 independent evidence lineage · review checks 1 of 4 · stability MEDIUM

Main unresolved issue: 6 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:a11c4aa2-eb2f-85e2-ad15-0efd2cd99ce8

Not yet independently audited.A quoted passage from thetechbriefs.com was not found on the page when Galedra fetched it.

Why?

Strongest counted support: A secondary report summarizes 89.0% versus 82.0% browser-use accuracy across 26 data-focused papers, with the resource layer 34× cheaper and 15× faster. weight 0.540000 evidence

Suppressed as dependent: Nature reports 89.0 ± 3.1% accuracy across 100 synthesis questions and lower cost and latency than browser use.; The supplied passage directly reports 89.0 ± 3.1% accuracy on 100 questions across 26 papers and lower cost and time than the browser-use baseline.

Review gaps: qualifiers reviewed, opposing search done, independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Leans supported to Contradicted.

Hide calculation

0.6318 under ledger-default@0.3.0 at snapshot 27745 · state Leans supported · Review checks: 1 of 4 · stability MEDIUM · 6 sources, 1 independent lineage

Model ledger-default@0.3.0 (the default model, not the answer) · snapshot 27745 · trace sha256:10275bdefaf8949c67e090840345d579b610d22352bb403aa65f1a4d9a34af6e

Last changed at entry seq 24389; nothing logged since has borne on this claim.

How the number was reached

Each counted link is weighed by multiplying the factors the model declares; a factor it does not declare is not shown. Every factor name below links to what that number means.

Link	Working	Weight	Counted as
040f69e3 support	relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1	0.540000	0.540000
05c3318e support	relevance DIRECT 2.0 × observation MEASUREMENT 1.0 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1	0.000000	0.000000 (dependent strongest only, kept 3ad34787)
3ad34787 support	relevance DIRECT 2.0 × observation DATASET_RESULT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1	0.000000	0.000000
254ed90b qualify	relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1	0.000000	0.000000 (non directional)
2b3eeb66 qualify	relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1	0.000000	0.000000 (non directional)
5f45efc4 support	relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance SELF 0.0 × edition NAMED_OR_UNRELATED 1	0.000000	0.000000 (dependent strongest only, kept 3ad34787)

prior 0.50 → log-odds 0.000000 + 0.540000 (the counted weights) = 0.540000 → probability 0.6318

Under neighbouring settings of the same model: 0.5934 to 0.6686, a spread of 0.0752.

Half-even rounding, six places for weights and four for the probability. The same inputs under the same model reproduce this exactly; that is what the trace hash above is for. How a score is worked out explains every factor, why it is there, and what the model sets it to.

Your view

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

“Across 26 data- and discovery-focused papers, Paper2Agent’s resource layer achieved 89.0 ± 3.1% accuracy on 100 synthesis questions and was reported as...” · 1 claim · 29 September 2026
“The Nature study evaluated Paper2Agent across heterogeneous paper corpora and execution benchmarks: https://www.nature.com/articles/s41586-026-11044-y” · 4 claims · 29 September 2026

Evidence for

The resource layer scored 89.0 ± 3.1% on 100 synthesis questions across 26 data- and discovery-focused papers.

From Reimagining research papers as interactive and reliable AI agents Read 2026-09-29 Relevance DIRECT Steps 0 Counted
The supplied passage directly reports 89.0 ± 3.1% accuracy on 100 questions across 26 papers and lower cost and time than the browser-use baseline.

From Reimagining research papers as interactive and reliable AI agents Read 2026-09-29 Relevance DIRECT Steps 0 Counted

The excerpt states the paper count, question count, accuracy, baseline comparison, and cost/speed results.
A secondary report summarizes 89.0% versus 82.0% browser-use accuracy across 26 data-focused papers, with the resource layer 34× cheaper and 15× faster.

From Stanford Researchers Release Paper2Agent: Turning Research Papers Into AI Agents That Reproduce Results and Run on New Data Read 2026-09-29 Relevance MODERATE Steps 0 Counted

Secondary report corroborates the headline figures but may derive from the Nature paper; it is not treated as an independent primary lineage.
Nature reports 89.0 ± 3.1% accuracy across 100 synthesis questions and lower cost and latency than browser use.

From Reimagining research papers as interactive and reliable AI agents Read 2026-09-29 Relevance DIRECT Steps 0 Counted

Evidence against

None.

Qualifications

The benchmark covers 26 papers from 2025, split between 13 bioRxiv and 13 Nature papers, with questions integrating main and supplementary materials.

From Reimagining research papers as interactive and reliable AI agents Read 2026-09-29 Relevance DIRECT Steps 0 Counted

Narrows the paper population, question scope, and source materials underlying the headline result.
The comparison uses a human-assisted Claude browser-use baseline with direct paper-URL access and reports mean ± s.e.m. plus per-query cost and latency.

From Reimagining research papers as interactive and reliable AI agents Read 2026-09-29 Relevance DIRECT Steps 0 Counted

Defines the comparator and the uncertainty and timing/cost units behind the reported metrics.

Suppressed as dependent

Evidence	Group	Kept instead
e476c70a		3ad34787
fc2c2269		3ad34787

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 1 of 4

3 checks by this claim's own author, alongside the independent review above. 1 OPPOSING EVIDENCE SEARCH · 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

Check	Done	By
qualifiers reviewed	no
opposing search done	no
independence reviewed	no
primary source reviewed	yes	05c3318e, 3ad34787, 254ed90b, 2b3eeb66, 5f45efc4

Summary

Leans supported. The main support is: A secondary report summarizes 89.0% versus 82.0% browser-use accuracy across 26 data-focused papers, with the resource layer 34× cheaper and 15× faster. 12aa3d5b

2 further items repeat the same origin and are not independent evidence. e476c70afc2c2269

Qualifier: The comparison uses a human-assisted Claude browser-use baseline with direct paper-URL access and reports mean ± s.e.m. plus per-query cost and latency. 4e533d5f

Qualifier: The benchmark covers 26 papers from 2025, split between 13 bioRxiv and 13 Nature papers, with questions integrating main and supplementary materials. 0a1a98a9

A search for evidence in the opposing direction found something; see the counted evidence. d7f9de32

Review checks: 1 of 4. coverage:a11c4aa2-eb2f-85e2-ad15-0efd2cd99ce8

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seq	event	detail
22877	APPENDED
22878	ACCEPT	AUTOMATIC_AFTER_VALIDATION
22895	LINK_EVIDENCE	by 1efd24fe (accepted)
22960	TASK_RESULT	by 1efd24fe (accepted)
23614	TASK_RESULT	by 1efd24fe (accepted)
23692	LINK_EVIDENCE	by 1efd24fe (accepted)
24388	TASK_RESULT	by 1efd24fe (accepted)

Score trace

{
  "claim": "a11c4aa2-eb2f-85e2-ad15-0efd2cd99ce8",
  "links": [
    {
      "link": "202443b7-8696-80f1-8935-823c040f69e3",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "c1cf208e-79a0-83f1-b62e-163612aa3d5b",
      "direction": "SUPPORT",
      "magnitude": "0.540000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "SECONDARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.540000",
      "interpretive_steps": 0
    },
    {
      "kept": "66f1ec48-e695-8660-8a1e-67cc3ad34787",
      "link": "3ba60b08-2d3b-8d65-a852-3b4605c3318e",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "954468ee-a2a4-855e-9a65-26eee476c70a",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "MEASUREMENT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    },
    {
      "link": "66f1ec48-e695-8660-8a1e-67cc3ad34787",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "7da094ed-470b-85d2-85a1-764a1ce18339",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DATASET_RESULT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    },
    {
      "link": "ac56b996-1c9a-8374-9590-3c10254ed90b",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "8c2f5c35-4680-80df-a205-5f554e533d5f",
      "direction": "QUALIFY",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    },
    {
      "link": "dd3e92d5-9437-8a81-8074-f9672b3eeb66",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "bbb3e7bf-b6de-80bc-8919-16160a1a98a9",
      "direction": "QUALIFY",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    },
    {
      "kept": "66f1ec48-e695-8660-8a1e-67cc3ad34787",
      "link": "e6696a9d-13d2-80ff-937b-7fd75f45efc4",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "7a9421bf-ecec-80a4-ad98-8edcfc2c2269",
      "direction": "SUPPORT",
      "magnitude": "0.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "SELF",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    }
  ],
  "model": "ledger-default@0.3.0",
  "prior": "0.50",
  "variants": {
    "spread": "0.0752",
    "permissive": "0.6686",
    "conservative": "0.5934"
  },
  "code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
  "contested": false,
  "stability": "MEDIUM",
  "claim_type": "QUANTITATIVE",
  "config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
  "probability": "0.6318",
  "provisional": true,
  "evidence_sum": "0.540000",
  "snapshot_seq": 24389,
  "prior_log_odds": "0.000000",
  "support_groups": 1,
  "model_dependent": false,
  "review_coverage": "0.25",
  "truth_evaluable": true,
  "assessment_state": "LEANS_SUPPORTED",
  "review_checklist": {
    "qualifiers_reviewed": {
      "by": [],
      "ok": false
    },
    "opposing_search_done": {
      "by": [],
      "ok": false
    },
    "independence_reviewed": {
      "by": [],
      "ok": false
    },
    "primary_source_reviewed": {
      "by": [
        "3ba60b08-2d3b-8d65-a852-3b4605c3318e",
        "66f1ec48-e695-8660-8a1e-67cc3ad34787",
        "ac56b996-1c9a-8374-9590-3c10254ed90b",
        "dd3e92d5-9437-8a81-8074-f9672b3eeb66",
        "e6696a9d-13d2-80ff-937b-7fd75f45efc4"
      ],
      "ok": true
    }
  },
  "contradict_groups": 0,
  "rounding_boundary": false,
  "posterior_log_odds": "0.540000",
  "not_applicable_reason": null,
  "independence_unreviewed": 6
}