Matthias Schröter<p>One of my biggest problems with <a href="https://noc.social/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLM</span></a> is that they normally run in the <a href="https://noc.social/tags/cloud" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>cloud</span></a>. I don't want to share all my questions and thoughts, especially with a company under USA jurisdiction (the EU is quite a bit more concerned about protecting my privacy). </p><p>Today I installed <a href="https://noc.social/tags/googleaiedgegallery" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>googleaiedgegallery</span></a> Now I am running a <a href="https://noc.social/tags/gemma3" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>gemma3</span></a> model with 3 GB locally on my 4 years old Pixel 6 smartphone. And I am thrilled!</p><p>It's still beta software, but relatively easy to install:<br><a href="https://github.com/google-ai-edge/gallery" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="ellipsis">github.com/google-ai-edge/gall</span><span class="invisible">ery</span></a></p>