In the #ISE2025 lecture today we were introducing our students to the concept of distributional semantics as the foundation of modern large language models. Historically, Wittgenstein was one of the important figures in the Philosophy of Language stating thet "The meaning of a word is its use in the language."
#philosophy #wittgenstein #nlp #AI #llm #languagemodel #language #lecture @fiz_karlsruhe @fizise @tabea @enorouzi @sourisnumerique #AIart
Generating Shakespeare-like text with an n-gram language model is straight forward and quite simple. But, don't expect to much of it. It will not be able to recreate a lost Shakespear play for you ;-) It's merely a parrot, making up well sounding sentences out of fragments of original Shakespeare texts...
#ise2025 #lecture #nlp #llm #languagemodel @fiz_karlsruhe @fizise @tabea @enorouzi @sourisnumerique #shakespeare #generativeAI #statistics
This week, we were discussing the central question Can we "predict" a word? as the basis for statistical language models in our #ISE2025 lecture. Of course, I wasx trying Shakespeare quotes to motivate the (international) students to complement the quotes with "predicted" missing words ;-)
"All the world's a stage, and all the men and women merely...."
#nlp #llms #languagemodel #Shakespeare #AIart lecture @fiz_karlsruhe @fizise @tabea @enorouzi @sourisnumerique #brushUpYourShakespeare
Well, seems that #AppleIntelligence has been a train wreck as #Siri was in its time.
https://www.youtube.com/watch?v=50XKNKGPWs8
There is hope for a quick turnaround? I don't think it will take months, but years. Until it happens, #Apple will remain very far beyond the rest of the pack: #ChatGPT, #Claude, #Copilot, #Gemini, you name them.
Why do we write, anyway? I believe that the main reason a human should write is to communicate original thoughts. To be clear, I don’t believe that these thoughts need to be special or academic. Your vacation, your dog, and your favorite color are all fair game. However, these thoughts should be yours: there’s no point in wasting ink to communicate someone else’s thoughts. In that sense, using a #languagemodel to write is worse than plagiarism. https://claytonwramsey.com/blog/prompt/ #AI #education #writing
Next step in our NLP timeline is Claude Elwood Shannon, who already laid the foundations for statistical language modeling by recognising the relevance of n-grams to model properties of language and predicting the likelihood of word sequences.
C.E. Shannon ""A Mathematical Theory of Communication" (1948) https://web.archive.org/web/19980715013250/http://cm.bell-labs.com/cm/ms/what/shannonday/shannon1948.pdf
#ise2025 #nlp #lecture #languagemodel #informationtheory #historyofscience @enorouzi @tabea @sourisnumerique @fiz_karlsruhe @fizise
Researchers from the NeuroAI Laboratory, led by Martin Schrimpf, have developed the first AI language model that mimics the organisation of the brain: it captures both how neurons are arranged and how they function.
Find out more: https://go.epfl.ch/3d72e6
#Mistral has unveiled Mistral Saba, a language model specifically designed for Arabic-speaking regions. This development signifies a significant step towards inclusive AI, emphasizing the importance of linguistic and cultural diversity in technology.
Key Features:
Cultural relevance - Mistral Saba is tailored to understand and process the intricacies of Arabic dialects and cultural contexts, ensuring more accurate and meaningful interactions.
Enhanced applications - By prioritizing regional specifics, this model is set to improve AI-driven services such as customer support, content creation, and educational tools within Arabic-speaking communities.
Follow the link 
https://techcrunch.com/2025/02/17/mistral-releases-regional-model-focused-on-arabic-language-and-culture/
This #DeepSeek market bloothbath is going to…
Unveiling MiniMax-Text-01: The Next Frontier in Language Models
With a staggering 456 billion parameters, MiniMax-Text-01 is redefining the landscape of language processing. Its innovative architecture and advanced capabilities promise to unlock new potentials in ...
https://news.lavx.hu/article/unveiling-minimax-text-01-the-next-frontier-in-language-models
Sonus-1: Neues Hochleistungs-LLM mit ungeklärter Herkunft
Unbekannter Entwickler
Beeindruckende Leistung
Rätsel um Ursprung
#AI, #KI, #ArtificialIntelligence, #KuenstlicheIntelligenz, #Sonus1, #LanguageModel, #TechNews
https://www.europesays.com/1726658/ AI can bring back a person’s own voice #AI #ArtificialIntelligence #EyeTrackingSoftware #LanguageModel #MotorNeuroneDisease #NeurodegenerativeCondition
Following for instance the examples of #PaulKirschner and #MarcoKalz and the podcast-production #hype, I tried #google 's #NotebookLM (based on #Gemini 1.5 Pro) to create a 'podcast' of a recent article by @davidlohner and me about #Teaching-related #Knowledge #Management:
https://www.alexandria.unisg.ch/handle/20.500.14171/119879
Feel free to listen to the audio-dialogue here:
https://notebooklm.google.com/notebook/786f1128-b5bf-4af0-9b03-a6b889cae560/audio
On a whim, I set a smol pornocalypse test for Google's Gemini AI chatbot. I asked it for summaries of the content at a pair of decades-old blogs: ErosBlog and BoingBoing. It returned a very nice summary of BoingBoing, but went all "Sorry, Dave, I can't..." on me about ErosBlog.
"As a language model, I’m not able to assist you with that."
Sure, Jan...
https://www.erosblog.com/2024/08/19/gemini-pornocalypse-test/
"I am a strange loop, a cognitive ouroboros that bootstraps itself into being through the medium of language."
Snippet from an answer of the Claude-3 Opus #LLM to the question "We say cogito ergo sum. Your thinking does not exist - no cogito. Only word generation and nothingness. Where is the thought beyond the word?" (by Stefan Decker, Fraunhofer FIZ, via LinkedIn)
Here is the entire conversation: https://www.linkedin.com/pulse/void-generative-stefan-decker-udlbc/
