Shownotes
We may be transitioning from an era where humans design algorithms to an era where machines derive new algorithms by questioning assumptions. Research along these lines has been published.
To reduce the execution costs of large language models, techniques such as KV cache reduction, weight pruning, and accelerated inference are employed. However, these optimization algorithms have traditionally been designed by researchers through intuition and trial-and-error. The process embeds numerous implicit assumptions.
AutoAssumption focuses precisely on these assumptions. It formalizes existing…
Website: tech.airadio.news

