flipboard.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
Welcome to Flipboard on Mastodon. A place for our community of curators and enthusiasts to inform and inspire each other. If you'd like to join please request an invitation via the sign-up page.

Administered by:

Server stats:

1.2K
active users

#DataEngineering

10 posts8 participants2 posts today

The job of a data engineer hasn't changed.

We still move data, clean it, model it, and deliver something useful - under pressure, at scale, and with moving targets.

What’s changed? The marketing.

This post tears into the latest buzzwords I'm already sick of: luminousmen.com/post/data-engi

👉 [FREE] Join the community of data engineers to receive practical lessons from the trenches straight to your inbox! Subscribe here: luminousmen.substack.com/welco

luminousmenData Engineering: Now with 30% More BullshitTools don't solve problems. People do. No buzzword replaces craftsmanship.

If you ever felt guilty for not using the "cool" tools… this one's for you.
You’re not behind. You’re just busy building systems that actually work.
Let’s talk about the overhype problem: luminousmen.com/post/data-engi

👉 Weekly DE truths in your inbox: luminousmen.substack.com/welco

luminousmenData Engineering: Now with 30% More BullshitTools don't solve problems. People do. No buzzword replaces craftsmanship.

In this video, Justin from CodingEntrepreneurs walks you through building your own data pipeline and crafting an Analytics API from scratch. He used Python, FastAPI, SQLModel, SQLAlchemy and TimescaleDB & also demonstrated how to deploy the project on the Railway platform. It’s a great resource if you’re looking to learn the full flow - from development to deployment

youtube.com/watch?v=tiBeLLv5GJo

PEP 751 was officially accepted on March 31, 2025, marking a major leap for Python’s packaging ecosystem. Similar to how JavaScript, Rust, and Go rely on lock files Python will now have a standardized lock file format. If you're curious about what this PEP introduces & why it matters, check out this article by Sarah Gooding from the Socket team.

socket.dev/blog/python-adopts-

SocketPython Adopts Standard Lock File Format for Reproducible Ins...Python has adopted a standardized lock file format to improve reproducibility, security, and tool interoperability across the packaging ecosystem.

Refactoring #data projects helps with clarity, scalability, and onboarding new people into the project

We’re refactoring in the open by tackling our internal analytics dbt project

In part 1 as we create a time spine as a foundation for semantic layer

medium.com/inthepipeline/build

A ChatGPT generated image. The background is blue. On the left there is a pink code screen with squiggles meant to be code coming into the code and coming out simplified. On the right there is a yellow code screen being placed on a strong foundation of orange and yellow bricks.
In the Pipeline · Building in the open: Recce’s internal dbt repo refactorBy Dori Wilson

If you use Jupyter notebooks often, you’ve probably faced issues like small edits leading to big Git diffs or difficulties reusing code across notebooks. Marimo is a good alternative that tackles these problems. In this article, Akshay, Myles and Dylan explained how Marimo solves these issues.

marimo.io/blog/python-not-json

Reinventing notebooks as reusable Python programs
marimo.ioReinventing notebooks as reusable Python programsDesigning a Python notebook that blends the best parts of interactive computing with the sanity of code

We all know that SELECT * FROM table_name is less efficient than selecting specific columns. The same applies to Django ORM, where you can optimize application performance using defer() and only(). If you want to learn how to use them, check out this article by Nik Tomazic.

testdriven.io/blog/django-quer

A white rectangle displaying the article title, "Django Query Optimization - Defer, Only, and Exclude", and a byline featuring Nik Tomazic.
testdriven.ioDjango Query Optimization - Defer, Only, and ExcludeIn this article, we'll look at the differences between Django QuerySet's defer, only, and exclude methods.