Evidence item
The comparison uses a human-assisted Claude browser-use baseline with direct paper-URL access and reports mean ± s.e.m. plus per-query cost and latency. DIRECT_TEXT
Source: Reimagining research papers as interactive and reliable AI agents · locator {} · excerpt hash sha256:bf6b3962ee5601debe00b640e3563d43e2c339e7e233ec54e2f90505d148d452
Exact excerpt
For benchmarking on data- and discovery-focused papers, the baseline was Claude with browser-use capabilities and direct access to the paper URL, representing a strong human-assisted LLM setup in which the agent can browse and read the paper directly. We report mean accuracy ± s.e.m. across questions using a bootstrap procedure... For query-time evaluation, we report per-query cost and latency, measured as time from query submission to final answer.
Linked claims
| Claim | Direction | Relevance | Steps | Counted |
|---|---|---|---|---|
| 2cd99ce8 | QUALIFY | DIRECT | 0 | yes |
Audits
None.