Evidence item

Paper2Agent scored 91.2 ± 1.6% on 300 tutorial questions versus 80.3 ± 2.3% for direct-repository Claude Code using Sonnet 4. DATASET_RESULT

Authenticity UNVERIFIED · extraction UNVERIFIED · independence group none (unreviewed) · created seq 22883

Source: Reimagining research papers as interactive and reliable AI agents · locator {} · excerpt hash sha256:37665820e46b67f69ea1e518ecd79518ab056bbc1601d7ede613050816984e74

On 300 tutorial-derived benchmark questions, Paper2Agent with Sonnet 4 achieved 91.2 ± 1.6% accuracy, outperforming Claude Code with direct repository access using Sonnet 4 (80.3 ± 2.3%; P < 0.0001) and Sonnet 4.6 (86.3 ± 1.1%; P < 0.0001).