LLM emergent behavior written off as rubbish – small models work fine but are measured poorly
[…] As defined in academic studies, “emergent” abilities refers to “abilities that are not present in smaller-scale models, but which are present in large-scale models,” as one such paper puts it. In other words, immaculate injection: increasing the size of a model infuses it with some amazing ability not previously present. […] those emergent abilities Read more about LLM emergent behavior written off as rubbish – small models work fine but are measured poorly[…]