Přejít k obsahu
Global sound
Totally A Thing

Totally A Thing

Emergent behaviour? Or stolen IP?

· 15 min

Poznámky k epizodě

The Attention is All You Need paper started the LLM gold rush, but it initially came from Google scientists who only expected it to do language translation. As more data was used in training sets, and the number of parameters grew orders of magnitude it was less easy to understand what the model was doing.
Emergent Instruction Following
In Ars Technica from 2023 we have this summary of how the “emergent” AI behaviour was being seen popularly, in the press:
The biggest breakthrough came in the jump from GPT2 to GPT3 in 2020. GPT2 had about 1.5 billion parameters, which would easily fit in the…

Web: totallyathing.substack.com

Živě, poslední hodina: 16 527 skladeb na 7 793 stanicích v 143 zemích

Objevte svět prostřednictvím rádia

Další způsoby objevování (9)

Slyšeli jste něco pěkného? Uložte si to, nebo to otevřete rovnou ve Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
98.5 El PatronPokračovat v poslechu