Przejdź do treści
Global sound
Intellectually Curious

Intellectually Curious

From Tokens to Bytes: AI Learns Its Own Building Blocks

· 6 min

Notatki do odcinka

Most language models begin with a tokenizer that cuts text into predetermined pieces. What if the model could learn those pieces for itself? Cartesia’s hierarchical networks, or H-Nets, start with raw bytes and build useful chunks inside the model. We explore how this learned hierarchy can compress familiar patterns, preserve important detail, and even change its segmentation as new words and repeated structures appear within a passage. Cartesia reports promising efficiency gains in controll...

Na żywo, ostatnia godzina: 11 412 utworów na 5 934 stacjach w 134 krajach

Odkrywaj świat przez radio

Więcej sposobów na odkrywanie (9)

Usłyszałeś coś fajnego? Zapisz to albo otwórz od razu w Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio nr UrortSłuchaj dalej