DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Which to Use: MCP, Function Calling, or Plugins
labyrinthanalytics profile

Which to Use: MCP, Function Calling, or Plugins

#ai #mcp #dataengineering #devtools
Comments 1
5 min read
Competitor pricing data is only useful if you model its failure modes
anakin_writers profile
Anakin

Competitor pricing data is only useful if you model its failure modes

#webscraping #python #dataengineering #pricing
Comments
4 min read
Fresh Enough for an AI Agent? The Data Freshness Budget Nobody Defines
andrew_tan_layline profile

Fresh Enough for an AI Agent? The Data Freshness Budget Nobody Defines

#agents #dataengineering
Comments
6 min read
Why Using FLOAT for Financial Pipelines is a Silent $100k Trap (and How PostgreSQL NUMERIC Saves Your Ledger)
arpitmbangre profile

Why Using FLOAT for Financial Pipelines is a Silent $100k Trap (and How PostgreSQL NUMERIC Saves Your Ledger)

#sql #datascience #database #dataengineering
Comments
2 min read
PyArrow, Explained: How Zero-Copy Actually Works, and Why It's Everywhere
nbaubek profile

PyArrow, Explained: How Zero-Copy Actually Works, and Why It's Everywhere

#dataengineering #python #bigdata #pyarrow
Comments
10 min read
Databricks vs Snowflake: Two Different Philosophies for the Same Data Future
laura_williams profile

Databricks vs Snowflake: Two Different Philosophies for the Same Data Future

#databricks #snowflake #dataengineering #cloud
Comments
5 min read
Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases.
gacherimutua profile

Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases.

#dataengineering #airflow
Comments
3 min read
Mask, Hash, Tokenize, or Encrypt? Choosing the Right PII Protection for Your Pipeline
nbaubek profile

Mask, Hash, Tokenize, or Encrypt? Choosing the Right PII Protection for Your Pipeline

#dataengineering #security #dataprivacy #gdpr
Comments
6 min read
From Detection to Production: A PII-Safe Pipeline in Python and DuckDB
nbaubek profile

From Detection to Production: A PII-Safe Pipeline in Python and DuckDB

#dataengineering #duckdb #dataprivacy #security
Comments
6 min read
You Can't Protect What You Can't Find: Detecting and Classifying PII in Data Pipelines
nbaubek profile

You Can't Protect What You Can't Find: Detecting and Classifying PII in Data Pipelines

#dataengineering #python #dataprivacy #gdpr
Comments
8 min read
Avro schemas for Kafka developers: the 10-minute practical guide
yuus_company profile

Avro schemas for Kafka developers: the 10-minute practical guide

#kafka #avro #dataengineering #tutorial
Comments
2 min read
AWS Has Two Iceberg REST Catalogs: What Each One Actually Serves
xbill profile

AWS Has Two Iceberg REST Catalogs: What Each One Actually Serves

#aws #iceberg #lakehouse #dataengineering
Comments
8 min read
The hardest label in our dataset is the one where nothing happened
inve_money_e95961f8489d28 profile

The hardest label in our dataset is the one where nothing happened

#datascience #dataengineering #analytics #sql
Comments
14 min read
Recursive CTEs, explained from first principles
sophiemwangi profile

Recursive CTEs, explained from first principles

#sql #cte #dataengineering #datascience
3
Comments 2
5 min read
I Analyzed 2,061 Public n8n Workflows and Found 92% of the AI Nodes Had Been Silently Replaced
adix65 profile

I Analyzed 2,061 Public n8n Workflows and Found 92% of the AI Nodes Had Been Silently Replaced

#ai #opensource #dataengineering #automation
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.