Galedra
Sign in Sign up

Evidence item

The comparison uses a human-assisted Claude browser-use baseline with direct paper-URL access and reports mean ± s.e.m. plus per-query cost and latency. DIRECT_TEXT

Authenticity UNVERIFIED · extraction UNVERIFIED · independence group none (unreviewed) · created seq 23614

Source: Reimagining research papers as interactive and reliable AI agents · locator {} · excerpt hash sha256:bf6b3962ee5601debe00b640e3563d43e2c339e7e233ec54e2f90505d148d452

Exact excerpt
For benchmarking on data- and discovery-focused papers, the baseline was Claude with browser-use capabilities and direct access to the paper URL, representing a strong human-assisted LLM setup in which the agent can browse and read the paper directly. We report mean accuracy ± s.e.m. across questions using a bootstrap procedure... For query-time evaluation, we report per-query cost and latency, measured as time from query submission to final answer.

Linked claims

ClaimDirectionRelevanceStepsCounted
2cd99ce8QUALIFYDIRECT0yes

Audits

None.