Notas del episodio
🤗 Upvotes: 55 | cs.CL
作者:
Tianyu Fu, Ruoxi Wang, Zihan Min, Zhongqi Ren, Zhihao Li, Tengxuan Liu, Shengxu Mu, Hanling Zhang, Yu Wang
标题:
Cache Engineering for Agents
Arxiv:
http://arxiv.org/abs/2610.28577v1
摘要:
Large Language Model (LLM) agents can handle increasingly complex tasks, navigating long trajectories of observations and actions. As these trajectories grow, key-value (KV) cache I/O and storage become the dominant cost. Trajectories can also exceed the LLM's maximum context length, requiring control over active cache growth. Prior work uses context engineering to reduce…
Web: share.transistor.fm

