İçeriğe geç
Global sound
Ventura Labs

Ventura Labs

Mentor Palokaj: AI Model Compression & Quantization | TPN, Bittensor Subnet 65 | Ep. 106

· 36 dk · Bölüm 106

Bölüm notları

Mentor Palokaj, one of the technical leads at TPN (True Performance Network, Bittensor Subnet 65), on how small a language model can get before it stops being intelligent, and why nobody yet agrees on how to measure what gets lost.

In this episode, you’ll learn

• Model compression: How far a large language model can shrink and still be useful
• Quantization: Why each halving of precision costs more intelligence than the last
• Measurement: Why nobody agrees on how to measure the intelligence of an LLM
• Fluid Bench: A benchmark that generates a new test every run so miners cannot overfit
•…

Web sitesi: podcasters.spotify.com

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio 538 luisteren - Live!Şu an popüler