Recent searches

No recent searches

Search options

Only available when logged in.
eupolicy.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
This Mastodon server is a friendly and respectful discussion space for people working in areas related to EU policy. When you request to create an account, please tell us something about you.

Administered by:

Server stats:

195
active users

eupolicy.social: AboutProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.4.1

#DataEngineering

2 posts2 participants0 posts today
pipTrends<p>Litestar is a Python web framework that’s built with async support and type hints in mind. You might think, “But we already have FastAPI.” That’s true, but <span class="h-card" translate="no"><a href="https://infosec.exchange/@ubernostrum" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>ubernostrum</span></a></span> shared some good reasons why this framework is worth exploring.</p><p><a href="https://www.b-list.org/weblog/2025/aug/06/litestar/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">b-list.org/weblog/2025/aug/06/</span><span class="invisible">litestar/</span></a></p><p><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PythonProgramming</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ml</span></a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDevelopment</span></a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDevelopment</span></a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TechNews</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a></p>
pipTrends<p>If you’re writing test cases, I strongly suggest using pytest’s parametrize feature. It helps you save both time and code. In this article, <span class="h-card" translate="no"><a href="https://hachyderm.io/@nedbat" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>nedbat</span></a></span> explained how to use it with a clear example.</p><p><a href="https://nedbatchelder.com/blog/202508/starting_with_pytests_parametrize.html" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">nedbatchelder.com/blog/202508/</span><span class="invisible">starting_with_pytests_parametrize.html</span></a></p><p><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PythonProgramming</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ml</span></a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDevelopment</span></a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDevelopment</span></a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TechNews</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a></p>
TechKeysX<p>S1 EP1 T1 - Most basic machine learning example <a href="https://mastodon.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>machinelearning</span></a> <a href="https://mastodon.social/tags/linearregression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>linearregression</span></a> <a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/jupyternotebook" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>jupyternotebook</span></a> <a href="https://mastodon.social/tags/jupyter" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>jupyter</span></a> <a href="https://mastodon.social/tags/datascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>datascience</span></a> <a href="https://mastodon.social/tags/alogrithim" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>alogrithim</span></a> <a href="https://mastodon.social/tags/statistics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statistics</span></a> <a href="https://mastodon.social/tags/coding" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>coding</span></a> <a href="https://mastodon.social/tags/codingforbeginners" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>codingforbeginners</span></a> <a href="https://mastodon.social/tags/deeplearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deeplearning</span></a> <a href="https://mastodon.social/tags/mathematics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>mathematics</span></a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dataengineering</span></a> <a href="https://mastodon.social/tags/learncoding" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>learncoding</span></a></p>
Gordon Inggs<p>Come work with us at the City of <a href="https://fosstodon.org/tags/CapeTown" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CapeTown</span></a> - <a href="https://uct.ac.za/sites/default/files/2025-08/com-e25810-datascientist-jpal-saldru-soe.pdf" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">uct.ac.za/sites/default/files/</span><span class="invisible">2025-08/com-e25810-datascientist-jpal-saldru-soe.pdf</span></a></p><p>The job says data scientist, but really this is a <a href="https://fosstodon.org/tags/CivicTech" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CivicTech</span></a> <a href="https://fosstodon.org/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a> position. We run a decent Open Source, modern data stack, but what sets us apart is our great culture - family first, psychologically safe, curiosity encouraged and reward!</p><p>Would appreciate any boosts for reach!</p>
Sarah Lea<p>Why normalize databases?<br>Yesterday, my tutoring student asked me why databases need to be normalized at all. She said: “Wouldn’t it be easier to just have one big table with all the information?”</p><p>It’s a common first question when learning about relational databases.<br>At first, one big table (e.g. customer name, order date, product name, price) seems easiest.</p><p>I told her:<br>:blobcoffee: Because that quickly leads to data redundancy, anomalies, and integrity issues when inserting, updating, or deleting records.<br>:blobcoffee: Normalization means structuring data into separate, related tables, so that each fact is stored only once. This reduces redundancy &amp; preserves consistency.</p><p><a href="https://techhub.social/tags/databases" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>databases</span></a> <a href="https://techhub.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dataengineering</span></a> <a href="https://techhub.social/tags/datascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>datascience</span></a> <a href="https://techhub.social/tags/datascientist" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>datascientist</span></a> <a href="https://techhub.social/tags/dataanalysis" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dataanalysis</span></a> <a href="https://techhub.social/tags/dataanalyst" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dataanalyst</span></a> <a href="https://techhub.social/tags/sql" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>sql</span></a> <a href="https://techhub.social/tags/data" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>data</span></a></p>
Thewatch<p><a href="https://mastodon.social/tags/data" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>data</span></a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dataengineering</span></a> <a href="https://mastodon.social/tags/datascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>datascience</span></a> <a href="https://mastodon.social/tags/etl" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>etl</span></a> <a href="https://mastodon.social/tags/DataPipe" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataPipe</span></a> <a href="https://mastodon.social/tags/sql" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>sql</span></a> <a href="https://mastodon.social/tags/sqlserver" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>sqlserver</span></a> <a href="https://mastodon.social/tags/meme" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>meme</span></a> <a href="https://mastodon.social/tags/memes" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>memes</span></a></p>
Posit<p>What makes tools truly useful? </p><p>Episode 2 of <a href="https://fosstodon.org/tags/TheTestSet" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TheTestSet</span></a> features Wes McKinney (Part 1of 2!) sharing his experience building Pandas &amp; Arrow, plus his surprising past in speedrun communities.</p><p>Tune in for his story at thetestset.co, on Spotify, or Apple Podcasts</p><p><a href="https://fosstodon.org/tags/DataStack" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataStack</span></a> <a href="https://fosstodon.org/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://fosstodon.org/tags/Podcast" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Podcast</span></a> <a href="https://fosstodon.org/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Python</span></a></p>
Posit<p>Ever wonder about the mind behind Pandas &amp; Apache Arrow? 🤔 Ep. 2 of <a href="https://fosstodon.org/tags/TheTestSet" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TheTestSet</span></a> (Part 1!) unpacks Wes McKinney's journey – including his speedrunning past! What makes good tools good?</p><p>🎧 Listen at <a href="https://thetestset.co" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">thetestset.co</span><span class="invisible"></span></a>, on Spotify, or Apple Podcasts</p><p><a href="https://fosstodon.org/tags/DataStack" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataStack</span></a> <a href="https://fosstodon.org/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a> <a href="https://fosstodon.org/tags/Pandas" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Pandas</span></a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://fosstodon.org/tags/PodcastLaunch" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PodcastLaunch</span></a> <a href="https://fosstodon.org/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Python</span></a></p>
Rami Krispin :unverified:<p>My weekly newsletter is out! 🚀</p><p>This week's agenda:<br>🔹 Open Source of the Week - The dagster project <br>🔹 New learning resources - Forecasting with linear regression, multi-model LLM, multiprocessing with Python<br>🔹 Book of the week - Visualization for Social Data Science by Roger Beecham</p><p>📌 Join 29k subscribers and subscribe to get weekly updates 🗞️👇🏼<br><a href="https://ramikrispin.substack.com/p/the-dagster-project-visualization" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">ramikrispin.substack.com/p/the</span><span class="invisible">-dagster-project-visualization</span></a></p><p><a href="https://mstdn.social/tags/DataScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataScience</span></a> <a href="https://mstdn.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a> <a href="https://mstdn.social/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Python</span></a> <a href="https://mstdn.social/tags/RStats" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>RStats</span></a> <a href="https://mstdn.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://mstdn.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a></p>
pipTrends<p>This week's newsletter will be out tomorrow. Interesting stuff by Tim Kamanin, Iván Palomares Carrascosa, <span class="h-card" translate="no"><a href="https://mathstodon.xyz/@rgoswami" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>rgoswami</span></a></span>, Eric Chung ( <span class="h-card" translate="no"><a href="https://hachyderm.io/@towardsdatascience" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>towardsdatascience</span></a></span> ), <span class="h-card" translate="no"><a href="https://fosstodon.org/@koaning" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>koaning</span></a></span> &amp; Johnny covered</p><p><a href="https://newsletter.piptrends.com/p/how-can-you-structure-your-python" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">newsletter.piptrends.com/p/how</span><span class="invisible">-can-you-structure-your-python</span></a></p><p><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PythonProgramming</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ml</span></a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDevelopment</span></a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDevelopment</span></a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TechNews</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a></p>
pipTrends<p>Many people write Python scripts to automate tasks, but without proper structure, these scripts can quickly become hard to maintain. If you're planning to write a script, check out this Real Python article by <span class="h-card" translate="no"><a href="https://mathstodon.xyz/@rgoswami" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>rgoswami</span></a></span> Your future self (and your teammates) will thank you.</p><p><a href="https://realpython.com/python-script-structure/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">realpython.com/python-script-s</span><span class="invisible">tructure/</span></a></p><p><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PythonProgramming</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ml</span></a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDevelopment</span></a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDevelopment</span></a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TechNews</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a></p>
pipTrends<p>It’s a good idea to run slow tests last; this way, you catch failed tests early and avoid putting unnecessary stress continuously on resources like databases and external services. In this article, Tim Kamanin shared how to achieve this by creating a custom marker and a pytest plugin tailored for Django application tests.</p><p><a href="https://timonweb.com/django/optimizing-test-execution-running-live_server-tests-last-with-pytest/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">timonweb.com/django/optimizing</span><span class="invisible">-test-execution-running-live_server-tests-last-with-pytest/</span></a></p><p><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PythonProgramming</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ml</span></a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDevelopment</span></a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDevelopment</span></a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TechNews</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a></p>
James Bartlett :terminal:<p>🧙‍♂️ One does not simply build reports on OLTP data…</p><p>This week on The Drill Down with Ahmad &amp; James, our special guest <br>Kristyna Ferris will be presenting a session titled "The Fellowship of the Star Schema: Transforming OLTP Data for Power BI" </p><p>🛠️ This session is packed with:<br>- Clear distinctions between OLTP &amp; OLAP<br>- Tips for building Power BI-ready models<br>- A sprinkle of Slowly Changing Dimension magic</p><p>💡Whether you’re a data wizard 🧙, business hobbit 🧝‍♀️, or SQL ranger 🏹 — this is your quest.</p><p>🗓️ Join us LIVE on LinkedIn | Wednesday, July 2nd @ 2PM Central<br><a href="https://lnkd.in/eWh4SsBb" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">lnkd.in/eWh4SsBb</span><span class="invisible"></span></a></p><p><a href="https://techhub.social/tags/TheDrillDown" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TheDrillDown</span></a> <a href="https://techhub.social/tags/MicrosoftFabric" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MicrosoftFabric</span></a> <a href="https://techhub.social/tags/PowerBI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PowerBI</span></a> <a href="https://techhub.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a> <a href="https://techhub.social/tags/DataTransformation" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataTransformation</span></a> <a href="https://techhub.social/tags/DataAnalytics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataAnalytics</span></a> <a href="https://techhub.social/tags/BusinessIntelligence" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>BusinessIntelligence</span></a> <a href="https://techhub.social/tags/StarSchema" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>StarSchema</span></a> <a href="https://techhub.social/tags/OLTP" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OLTP</span></a> <a href="https://techhub.social/tags/KristynaFerris" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>KristynaFerris</span></a></p>
Gordon Inggs<p><span class="h-card" translate="no"><a href="https://mstdn.party/@shibaprasad" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>shibaprasad</span></a></span> I have a colleague who has used it with success in prod data pipelines. A big attraction for him was speed and resource footprint - he avoided refactoring for task parallelism in a few cases</p><p>I gave it a try, but found it sufficiently different from pandas that I struggled to make the switch, but since you're coming in "fresh" probably worth a go?</p><p><a href="https://fosstodon.org/tags/data" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>data</span></a> <a href="https://fosstodon.org/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dataengineering</span></a></p>
pipTrends<p>Tomorrow newsletter will be out. Interesting stuff by Wyatt Ferguson, <span class="h-card" translate="no"><a href="https://mastodon.social/@driscollis" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>driscollis</span></a></span> Rahul Jha, Kenneth Burchfiel &amp; Cheng/Racey Chan covered</p><p><a href="https://newsletter.piptrends.com/p/build-a-wikipedia-search-engine-working" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">newsletter.piptrends.com/p/bui</span><span class="invisible">ld-a-wikipedia-search-engine-working</span></a></p><p><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PythonProgramming</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ml</span></a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDevelopment</span></a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDevelopment</span></a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TechNews</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a></p>
pipTrends<p>Did you know Python’s standard library includes configparser, which lets you work with Windows-style INI files? If not, check out this article by <span class="h-card" translate="no"><a href="https://mastodon.social/@driscollis" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>driscollis</span></a></span> where he walks through creating, editing and reading INI files with clear examples.</p><p><a href="https://www.blog.pythonlibrary.org/2025/04/09/python-101-an-intro-to-working-with-ini-files-using-configparser/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">blog.pythonlibrary.org/2025/04</span><span class="invisible">/09/python-101-an-intro-to-working-with-ini-files-using-configparser/</span></a></p><p><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PythonProgramming</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ml</span></a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDevelopment</span></a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDevelopment</span></a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TechNews</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a></p>
⚯ Michel de Cryptadamus ⚯<p>pro tip for user interface designers:</p><p>if you have hundreds of millions of dollars of venture capital and you want to make a user facing data analytics tool of some kind and you think it's reasonable to ask an average human being to type this:</p><p> CAST('2023-05-01' AS TIMESTAMP)</p><p>to do literally anything with a date or time in your application's user interface, just stop right there. do not pass go, do not collect $200, and do not ever attempt to offer feedback to a UX designer ever again. something is deeply broken inside you that means there are certain mysteries of the universe that even the guys who designed the postgres command line can access that you will never know, and that's ok. You can still live a really rad life.</p><p><a href="https://universeodon.com/tags/SQL" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SQL</span></a> <a href="https://universeodon.com/tags/dba" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dba</span></a> <a href="https://universeodon.com/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dataengineering</span></a> <a href="https://universeodon.com/tags/postgres" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>postgres</span></a></p>
⚯ Michel de Cryptadamus ⚯scariest shit i've seen in years
pipTrends<p>Tomorrow newsletter will be out. Interesting stuff by Gwyneth Peña-Siguenza, Erez Shinan, Corey Schafer, <span class="h-card" translate="no"><a href="https://fosstodon.org/@tonybaloney" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>tonybaloney</span></a></span> &amp; Yang Zhou covered</p><p><a href="https://newsletter.piptrends.com/p/how-reladiff-works-t-strings-gil" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">newsletter.piptrends.com/p/how</span><span class="invisible">-reladiff-works-t-strings-gil</span></a></p><p><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PythonProgramming</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/ml" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ml</span></a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MachineLearning</span></a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDevelopment</span></a> <a href="https://mastodon.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDevelopment</span></a> <a href="https://mastodon.social/tags/TechNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TechNews</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a></p>
pipTrends<p>Pinpointing differences between two tables is very important for tasks like validating data migrations or spotting corruption. But when those tables live in different databases, it becomes tricky due to issues like network costs and different SQL dialects. In this article, Erez Shinnan shared how Reladiff tackles these challenges and its development journey.</p><p><a href="https://eshsoft.com/blog/how-reladiff-works" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">eshsoft.com/blog/how-reladiff-</span><span class="invisible">works</span></a></p><p><a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>python</span></a> <a href="https://mastodon.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://mastodon.social/tags/PythonProgramming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PythonProgramming</span></a> <a href="https://mastodon.social/tags/SoftwareDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDevelopment</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataEngineering</span></a></p>
TrendingLive feeds
About