Beschrijving
1. Compact Tool Schemas & Prefill Optimization
• Prompt Token Reduction: Tool instructions previously inlined complete JSON input schemas into the prompt prefix of every turn, causing even short questions to incur over 3,800 tokens of fixed overhead[1]. Schemas are now reduced to compact signatures (e.g., read_file(required: path; optional: content)), cutting prompt tokens from 3,814 down to 1,047 and prefill latency from ~13.1s to ~5.9s[1][2]. Full schemas remain accessible on-demand via tool_schema_detail[3].
• Selective Remote Routing: Rather than naively splitting whole layers across…
Website: spreaker.com

