☮ ♥ ♬ 🧑💻<p>“Breakthroughs in large language models (<a href="https://ioc.exchange/tags/LLMs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLMs</span></a>) have made conversations with <a href="https://ioc.exchange/tags/chatbots" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>chatbots</span></a> feel more natural and human-like. Applications such as Replika and Character.ai, which allow users to chat with artificial intelligence (#<a href="https://ioc.exchange/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a>) versions of famous actors and science-fiction characters, are becoming popular, especially among young <a href="https://ioc.exchange/tags/users" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>users</span></a>. As a <a href="https://ioc.exchange/tags/neuroscientist" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>neuroscientist</span></a> studying <a href="https://ioc.exchange/tags/stress" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>stress</span></a>, <a href="https://ioc.exchange/tags/vulnerability" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>vulnerability</span></a> and <a href="https://ioc.exchange/tags/resilience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>resilience</span></a>, I’ve seen how easily people react to even the smallest emotional cues — even when they know that those cues are artificial. For example, study participants exhibit measurable physiological responses when shown videos of computer-generated avatars expressing sadness or fear.”</p><p>…</p><p>“Because these AI systems are <a href="https://ioc.exchange/tags/trained" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>trained</span></a> on vast amounts of emotionally expressive human language, their outputs can come across as surprisingly natural. *LLMs often mirror human emotional patterns, not because they understand emotions, but because their responses resemble how people talk.*”</p><p>…</p><p>“Now is the time to establish mandatory <a href="https://ioc.exchange/tags/safeguards" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>safeguards</span></a> for all emotionally responsive AI.”</p><p>“Emotional influence isn’t a glitch. It’s a core feature of LLMs. If we celebrate their ability to comfort or advise, we must also confront their capacity to mislead or manipulate. We’ve built machines that sound like they care. Now, we must ensure that they don’t hurt the very people who turn to them for support. That means giving emotionally responsive AI not just more capabilities, but clearer boundaries.”</p><p><a href="https://ioc.exchange/tags/ZivBenZion" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ZivBenZion</span></a> / <a href="https://ioc.exchange/tags/neurosciene" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>neurosciene</span></a> / <a href="https://ioc.exchange/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> / <a href="https://ioc.exchange/tags/GuardRails" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GuardRails</span></a> / <a href="https://ioc.exchange/tags/control" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>control</span></a> / <a href="https://ioc.exchange/tags/WhiteCollar" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WhiteCollar</span></a> <<a href="https://www.nature.com/articles/d41586-025-02031-w" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">nature.com/articles/d41586-025</span><span class="invisible">-02031-w</span></a>> (paywall) / <<a href="https://archive.md/IyddU" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">archive.md/IyddU</span><span class="invisible"></span></a>></p>