Ecologia Digital<p>"The fact that they [<a href="https://mato.social/tags/LLMs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLMs</span></a>] can get by as far as they can without explicit <a href="https://mato.social/tags/worldmodels" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>worldmodels</span></a> is actually astonishing. But much of what ails them comes from that design choice.<br>In the rest of the essay I will try to persuade you of just two things: that LLM's lack world models, and that this is as important and central to understanding their failures as are their failures in <a href="https://mato.social/tags/reasoning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reasoning</span></a>."<br><span class="h-card" translate="no"><a href="https://sigmoid.social/@garymarcus" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>garymarcus</span></a></span> <br><a href="https://garymarcus.substack.com/p/generative-ais-crippling-and-widespread" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">garymarcus.substack.com/p/gene</span><span class="invisible">rative-ais-crippling-and-widespread</span></a></p>