Eye on AI Weekly Research Watch
Credit Where It Matters: Dependency-Aware Policy Optimization for Terminal Agents
· 2 min · Řada 1
Poznámky k epizodě
Terminal-using agents trained with reinforcement learning handle multi-step coding and debugging, but standard credit assignment ignores that later commands depend on earlier outputs, so training signals can land on irrelevant steps. DepGPO builds a command dependency graph from execution traces, traces backward from resources the task verifier inspects, and assigns credit to relevant writes and their supporting reads, redistributing trajectory advantages across steps. Experiments show better task performance and training stability on complex terminal tasks.
Authors: Yu Li, Guangfeng Cai…
Web: share.transistor.fm
