Skip to content
Global sound
AI Post Transformers

AI Post Transformers

Paper2Agent: Turning Research Papers into Interactive MCP Agents

Show notes

This episode explores Paper2Agent, a Stanford system that converts a research paper and its released code into a Model Context Protocol server, so a chat agent can run the paper's actual methods through pre-tested tools instead of writing fresh code for every question. It explains MCP's three object types (tools, resources and prompts) and how the ReAct pattern lets the agent plan and call locked, paper-specific functions. This is meant to reduce hallucinated API calls, with AlphaGenome as the running example of a hard-to-use genomics API. The discussion places the work among earlier efforts such as executable papers, Papers with Code, AI co-scientists, and benchmarks like PaperBench and CORE-Bench. It stays skeptical of the authors' suggestion that "how easily a paper becomes an agent" could measure reproducibility, since the evidence is only three case studies and wrapping the authors' code also reproduces their bugs. Listeners get a clear, critical look at whether pre-built tool servers make research code trustworthy and usable by non-programmers.

Sources:
1. Paper2Agent: Reimagining Research Papers As Interactive and Reliable AI Agents — Jiacheng Miao, Joe R. Davis, Yaohui Zhang, Jonathan K. Pritchard, James Zou, 2025
http://arxiv.org/abs/2509.06917
2. AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation — Qingyun Wu, Gagan Bansal, Jieyu Zhang, et al. (Microsoft Research), 2023
https://scholar.google.com/scholar?q=AutoGen%3A+Enabling+Next-Gen+LLM+Applications+via+Multi-Agent+Conversation
3. SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering — John Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, Ofir Press, 2024
https://scholar.google.com/scholar?q=SWE-agent%3A+Agent-Computer+Interfaces+Enable+Automated+Software+Engineering
4. ReAct: Synergizing Reasoning and Acting in Language Models — Shunyu Yao, Jeffrey Zhao, Dian Yu, et al., 2022
https://scholar.google.com/scholar?q=ReAct%3A+Synergizing+Reasoning+and+Acting+in+Language+Models
5. Model Context Protocol (specification and announcement: 'Introducing the Model Context Protocol') — Anthropic (David Soria Parra, Justin Spahr-Summers and colleagues), 2024
https://scholar.google.com/scholar?q=Model+Context+Protocol+%28specification+and+announcement%3A+%27Introducing+the+Model+Context+Protocol%27%29
6. PaperBench: Evaluating AI's Ability to Replicate AI Research — Giulio Starace, Oliver Jaffe, Dane Sherburn, James Aung, Chan Jun Shern, Neil Chowdhury, et al. (OpenAI), 2025
https://scholar.google.com/scholar?q=PaperBench%3A+Evaluating+AI%27s+Ability+to+Replicate+AI+Research
7. CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark — Zachary S. Siegel, Sayash Kapoor, Nitya Nagdir, Benedikt Stroebl, Arvind Narayanan…

Live, last hour: 12,115 songs on 5,250 stations in 121 countries

Discover the world through radio

More ways to discover (7)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Diva 91.6Continue listening