Notatki do odcinka
When AI Has Nothing On Your Company, It Describes Someone Else
References from this episode:
Mallen et al., ACL 2023, When Not to Trust Language Models - the finding I mentioned about models struggling with less popular factual knowledge, and about scale improving recall of popular facts while doing very little for the tail of the distribution.
Longpre et al., EMNLP 2021, Entity-Based Knowledge Conflicts in Question Answering - the work on how heavily models lean on memorized information rather than reading what is in front of them, and where the hallucinate-rather-than-read framing comes…
Strona: duaneforresterdecodes.substack.com

