Olivier Mehani<p>In Large Language Models We Trust? | Communications of the <span class="h-card" translate="no"><a href="https://mastodon.acm.org/@ACM" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>ACM</span></a></span> <br><a href="https://dl.acm.org/doi/10.1145/3726009" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">dl.acm.org/doi/10.1145/3726009</span><span class="invisible"></span></a></p><p>Salient point:</p><p>> LLMs are not trustworthy because they hallucinate. LLM hallucinations are inevitable because of the cyclic feedback structure for the core ANN amplifies the fragility of their core ANNs on discontinuous training data. Detecting hallucinations, and possibly correcting them, is difficult because all the usual independent sources in the Internet are already included in the training data.</p><p><a href="https://piaille.fr/tags/trust" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>trust</span></a> <a href="https://piaille.fr/tags/largeLanguageModels" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>largeLanguageModels</span></a> <a href="https://piaille.fr/tags/llm" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>llm</span></a> <a href="https://piaille.fr/tags/artificialNeuralNetworks" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>artificialNeuralNetworks</span></a> <a href="https://piaille.fr/tags/ann" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ann</span></a> <a href="https://piaille.fr/tags/artificialIntelligence" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>artificialIntelligence</span></a> <a href="https://piaille.fr/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a></p>
eupolicy.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
This Mastodon server is a friendly and respectful discussion space for people working in areas related to EU policy. When you request to create an account, please tell us something about you.
Administered by:
Server stats:
215active users
eupolicy.social: About · Profiles directory · Privacy policy
Mastodon: About · Get the app · Keyboard shortcuts · View source code · v4.4.1
#artificialneuralnetworks
2 posts · 2 participants · 0 posts today
Bytes Europe<p>Does AI Aid Rare Bone Fracture Detection in Children? <a href="https://www.byteseu.com/1205181/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">byteseu.com/1205181/</span><span class="invisible"></span></a> <a href="https://pubeurope.com/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://pubeurope.com/tags/ArtificialIntelligence" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialIntelligence</span></a> <a href="https://pubeurope.com/tags/ArtificialNeuralNetworks" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialNeuralNetworks</span></a> <a href="https://pubeurope.com/tags/child" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>child</span></a> <a href="https://pubeurope.com/tags/childhood" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>childhood</span></a> <a href="https://pubeurope.com/tags/Children" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Children</span></a> <a href="https://pubeurope.com/tags/DeepLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DeepLearning</span></a> <a href="https://pubeurope.com/tags/fractures" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>fractures</span></a> <a href="https://pubeurope.com/tags/kids" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>kids</span></a> <a href="https://pubeurope.com/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://pubeurope.com/tags/MLNaturalLanguageProcessing" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MLNaturalLanguageProcessing</span></a> <a href="https://pubeurope.com/tags/NPL" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NPL</span></a> <a href="https://pubeurope.com/tags/OsteogenesisImperfecta" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OsteogenesisImperfecta</span></a>;OsteogenesisImperfecta(OI) <a href="https://pubeurope.com/tags/Pediatrics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Pediatrics</span></a> <a href="https://pubeurope.com/tags/UK" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>UK</span></a> <a href="https://pubeurope.com/tags/UKSiteContent" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>UKSiteContent</span></a>;UnitedKingdomSiteContent <a href="https://pubeurope.com/tags/UnitedKingdom" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>UnitedKingdom</span></a></p>
US<p><a href="https://www.europesays.com/us/32233/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">europesays.com/us/32233/</span><span class="invisible"></span></a> Depression Rates Differ By Occupation, Industry <a href="https://pubeurope.com/tags/accommodation" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>accommodation</span></a> <a href="https://pubeurope.com/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://pubeurope.com/tags/ArtificialIntelligence" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialIntelligence</span></a> <a href="https://pubeurope.com/tags/ArtificialNeuralNetworks" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialNeuralNetworks</span></a> <a href="https://pubeurope.com/tags/career" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>career</span></a> <a href="https://pubeurope.com/tags/CentersForDiseaseControlAndPrevention" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CentersForDiseaseControlAndPrevention</span></a>;CentersForDiseaseControlAndPrevention(CDC) <a href="https://pubeurope.com/tags/DeepLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DeepLearning</span></a> <a href="https://pubeurope.com/tags/depression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>depression</span></a> <a href="https://pubeurope.com/tags/Employment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Employment</span></a> <a href="https://pubeurope.com/tags/EmploymentContract" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>EmploymentContract</span></a> <a href="https://pubeurope.com/tags/Health" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Health</span></a> <a href="https://pubeurope.com/tags/JobContract" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>JobContract</span></a> <a href="https://pubeurope.com/tags/JobInterview" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>JobInterview</span></a> <a href="https://pubeurope.com/tags/jobs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>jobs</span></a> <a href="https://pubeurope.com/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://pubeurope.com/tags/MentalHealth" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MentalHealth</span></a> <a href="https://pubeurope.com/tags/MLNaturalLanguageProcessing" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MLNaturalLanguageProcessing</span></a> <a href="https://pubeurope.com/tags/NPL" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NPL</span></a> <a href="https://pubeurope.com/tags/profession" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>profession</span></a> <a href="https://pubeurope.com/tags/psychosocial" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>psychosocial</span></a> <a href="https://pubeurope.com/tags/uninsured" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>uninsured</span></a> <a href="https://pubeurope.com/tags/UnitedStates" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>UnitedStates</span></a> <a href="https://pubeurope.com/tags/UnitedStates" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>UnitedStates</span></a> <a href="https://pubeurope.com/tags/US" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>US</span></a> <a href="https://pubeurope.com/tags/Washington" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Washington</span></a></p>
Europe Says<p><a href="https://www.europesays.com/2137381/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">europesays.com/2137381/</span><span class="invisible"></span></a> Can Cold Exposure Alter Energy Dynamics in Obesity? <a href="https://pubeurope.com/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://pubeurope.com/tags/ArtificialIntelligence" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialIntelligence</span></a> <a href="https://pubeurope.com/tags/ArtificialNeuralNetworks" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialNeuralNetworks</span></a> <a href="https://pubeurope.com/tags/blood" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>blood</span></a> <a href="https://pubeurope.com/tags/Canada" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Canada</span></a>;Canadian <a href="https://pubeurope.com/tags/DeepLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DeepLearning</span></a> <a href="https://pubeurope.com/tags/Energy" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Energy</span></a> <a href="https://pubeurope.com/tags/exercise" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>exercise</span></a> <a href="https://pubeurope.com/tags/Grant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Grant</span></a> <a href="https://pubeurope.com/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://pubeurope.com/tags/MLNaturalLanguageProcessing" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MLNaturalLanguageProcessing</span></a> <a href="https://pubeurope.com/tags/NPL" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NPL</span></a> <a href="https://pubeurope.com/tags/obese" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>obese</span></a> <a href="https://pubeurope.com/tags/obesity" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>obesity</span></a> <a href="https://pubeurope.com/tags/PhysicalActivity" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PhysicalActivity</span></a> <a href="https://pubeurope.com/tags/WeightLoss" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WeightLoss</span></a> <a href="https://pubeurope.com/tags/WeightManagement" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WeightManagement</span></a></p>
Laurent Perrinet<p>The remarkable energy efficiency of the Human brain: <strong>One <a href="https://neuromatch.social/tags/Spike" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Spike</span></a> Every 6 Seconds</strong> !</p><p>In the groundbreaking paper <a href="https://www.cell.com/current-biology/pdf/S0960-9822(03)00135-0.pdf" rel="nofollow noopener" target="_blank">"The Cost of Cortical Computation"</a> published in 2003 in <em>Current Biology</em>, neuroscientist Peter Lennie reached a stunning conclusion about neural activity in the human brain: the average firing rate of cortical neurons is approximately 0.16 Hz—equivalent to just one spike every 6 seconds.</p><p>This finding challenges conventional assumptions about neural activity and reveals the extraordinary energy efficiency of the brain's computational strategy. Unconventional? Ask a LLM about it, and it will rather point to a baseline frequency between 0.1Hz and 10Hz. Pretty high and vague, right? But how did Lennie arrive at this remarkable figure?</p><p><strong>The Calculation Behind the 0.16 Hz Baseline Rate</strong></p><p>Lennie's analysis combines several critical factors:</p><p><strong>1. Energy Constraints Analysis</strong></p><p>Starting with the brain's known energy consumption (approximately 20% of the body's entire energy budget despite being only 2% of body weight), Lennie worked backward to determine how many action potentials this energy could reasonably support.</p><p><strong>2. Precise Metabolic Costs</strong></p><p>His calculations incorporated detailed metabolic requirements:</p><ul><li>Each action potential consumes approximately 3.84 × 109 ATP molecules</li><li>The human brain uses about 5.7 × 1021 ATP molecules daily</li></ul><p><strong>3. Neural Architecture</strong></p><p>The analysis factored in essential neuroanatomical data:</p><ul><li>The human cerebral cortex contains roughly 1010 neurons</li><li>Each neuron forms approximately 104 synaptic connections</li></ul><p><strong>4. Metabolic Distribution</strong></p><p>Using cerebral glucose utilization measurements from PET studies, Lennie accounted for energy allocation across different neural processes:</p><ul><li>Maintaining resting membrane potentials</li><li>Generating action potentials</li><li>Powering synaptic transmission</li></ul><p>By synthesizing these factors and dividing the available energy budget by the number of neurons and the energy cost per spike, Lennie calculated that cortical neurons can only sustain an average firing rate of approximately 0.16 Hz while remaining within the brain's metabolic constraints.</p><p><strong>Implications for Neural Coding</strong></p><p>This extremely low firing rate has profound implications for our understanding of neural computation. It suggests that:</p><ol><li><strong>Neural coding must be remarkably sparse</strong> — information in the brain is likely represented by the activity of relatively few neurons at any given moment</li><li><strong>Energy efficiency has shaped brain evolution</strong> — metabolic constraints have driven the development of computational strategies that maximize information processing while minimizing energy use</li><li><strong>Low baseline rates enable selective amplification</strong> — this sparse background activity creates a context where meaningful signals can be effectively amplified</li></ol><p>The brain's solution to energy constraints reveals an elegant approach to computation: doing more with less through strategic sparsity rather than constant activity.</p><p>This perspective on neural efficiency continues to influence our understanding of brain function and inspires energy-efficient approaches to <a href="https://neuromatch.social/tags/ArtificialNeuralNetworks" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialNeuralNetworks</span></a> and <a href="https://neuromatch.social/tags/neuromorphic" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>neuromorphic</span></a> computing.</p>
Europe Says<p><a href="https://www.europesays.com/1576367/" rel="nofollow noopener" target="_blank"><span class="invisible">https://www.</span><span class="">europesays.com/1576367/</span><span class="invisible"></span></a> Exclusive | From physics to mind: where AI really came from <a href="https://pubeurope.com/tags/2024NobelPrizeInPhysics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>2024NobelPrizeInPhysics</span></a> <a href="https://pubeurope.com/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://pubeurope.com/tags/AlanTuring" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AlanTuring</span></a> <a href="https://pubeurope.com/tags/ArtificialIntelligence" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialIntelligence</span></a> <a href="https://pubeurope.com/tags/ArtificialNeuralNetworks" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialNeuralNetworks</span></a> <a href="https://pubeurope.com/tags/FrankWilczek" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>FrankWilczek</span></a> <a href="https://pubeurope.com/tags/GeoffreyHinton" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GeoffreyHinton</span></a> <a href="https://pubeurope.com/tags/Hebbs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Hebbs</span></a>'Rule <a href="https://pubeurope.com/tags/JohnHopfield" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>JohnHopfield</span></a> <a href="https://pubeurope.com/tags/KMeson" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>KMeson</span></a> <a href="https://pubeurope.com/tags/LargeHadronCollider" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LargeHadronCollider</span></a> <a href="https://pubeurope.com/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://pubeurope.com/tags/MarvinMinsky" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MarvinMinsky</span></a> <a href="https://pubeurope.com/tags/mathematics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>mathematics</span></a> <a href="https://pubeurope.com/tags/Neurobiologists" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Neurobiologists</span></a> <a href="https://pubeurope.com/tags/NobelPrize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NobelPrize</span></a> <a href="https://pubeurope.com/tags/Perceptrons" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Perceptrons</span></a> <a href="https://pubeurope.com/tags/physics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>physics</span></a> <a href="https://pubeurope.com/tags/science" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>science</span></a> <a href="https://pubeurope.com/tags/SETI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SETI</span></a> <a href="https://pubeurope.com/tags/SeymourPapert" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SeymourPapert</span></a> <a href="https://pubeurope.com/tags/TheoreticalPhysics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TheoreticalPhysics</span></a> <a href="https://pubeurope.com/tags/WarrenMcCulloch" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WarrenMcCulloch</span></a></p>
SubtleBlade ⚔️<p><a href="https://mastodon.scot/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> [<a href="https://mastodon.scot/tags/LLMs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLMs</span></a>] Is a Black Box. <a href="https://mastodon.scot/tags/Anthropic" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Anthropic</span></a> Figured Out a Way to Look Inside</p><p>What goes on in <a href="https://mastodon.scot/tags/ArtificialNeuralNetworks" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ArtificialNeuralNetworks</span></a> work is largely a mystery, even to their creators. But researchers from Anthropic have caught a glimpse.<br> <a href="https://www.wired.com/story/anthropic-black-box-ai-research-neurons-features/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">wired.com/story/anthropic-blac</span><span class="invisible">k-box-ai-research-neurons-features/</span></a></p>
Technische Universität München<p>Our university welcomes two professors who were honored with a Humboldt Professorship!👏Stefanie Jegelka and Suvrit Sra will conduct research in <a href="https://wisskomm.social/tags/artificialneuralnetworks" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>artificialneuralnetworks</span></a> and <a href="https://wisskomm.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>machinelearning</span></a> methods, respectively: <a href="http://go.tum.de/658203" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">http://</span><span class="">go.tum.de/658203</span><span class="invisible"></span></a></p><p><a href="https://wisskomm.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> </p><p>📷private</p>
TrendingLive feeds
Mastodon is the best way to keep up with what's happening.
Follow anyone across the fediverse and see it all in chronological order. No algorithms, ads, or clickbait in sight.
Create accountLoginDrag & drop to upload