DEV Community

#etl

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Load CSV and JSON from Azure Blob into Postgres with pg_duckdb
franckpachot profile

Load CSV and JSON from Azure Blob into Postgres with pg_duckdb

#postgres #duckdb #azure #etl
Comments
6 min read
Data Engineering Log 2/3: Source Systems, Data Ingestion, and Pipelines
ayush_pangaonkar profile

Data Engineering Log 2/3: Source Systems, Data Ingestion, and Pipelines

#dataengineering #aws #etl #airflow
Comments
1 min read
Grounding Palantir AIP Workflows in the Ontology: Tool Design, Guardrails, and Evaluation Patterns
kaviwrites profile

Grounding Palantir AIP Workflows in the Ontology: Tool Design, Guardrails, and Evaluation Patterns

#palantir #dataengineering #etl #datamigration
Comments
10 min read
Announcing det: - Fast, local-first SQL ETL workspace and pipeline orchestration engine
saurabhr2 profile

Announcing det: - Fast, local-first SQL ETL workspace and pipeline orchestration engine

#etl #dataengineering #sql #python
Comments
2 min read
Amazon Aurora PostgreSQL: Query Remote Data Without Building an ETL Pipeline
omayrashraf profile

Amazon Aurora PostgreSQL: Query Remote Data Without Building an ETL Pipeline

#aws #dataengineering #etl #postgres
Comments
5 min read
Airflow 3 quietly changed what your cron schedule means
itcraftsman profile

Airflow 3 quietly changed what your cron schedule means

#airflow #dataengineering #python #etl
Comments
3 min read
Replacing SSIS with a C# data flow
andreaslennartz profile

Replacing SSIS with a C# data flow

#etl #csharp #lowcode
Comments
9 min read
Migrating Legacy ETL to Palantir Foundry: Incremental Transforms, Schema Evolution, and Reconciliation Without Downtime
kaviwrites profile

Migrating Legacy ETL to Palantir Foundry: Incremental Transforms, Schema Evolution, and Reconciliation Without Downtime

#dataengineering #etl #palantir #python
Comments
9 min read
I built a Claude Skill that inventories legacy SSIS packages before a Fabric migration
bayremhamrouni profile

I built a Claude Skill that inventories legacy SSIS packages before a Fabric migration

#dataengineering #etl #python #microsoftfabric
Comments
3 min read
When One Legacy Position Code Isn't Enough: A Common Oracle HCM Data Conversion Challenge
abbassibai profile

When One Legacy Position Code Isn't Enough: A Common Oracle HCM Data Conversion Challenge

#oracle #hcm #hdl #etl
Comments
3 min read
Bundling NuGet Package Dependencies in an SSIS Script Task
whitewaw profile

Bundling NuGet Package Dependencies in an SSIS Script Task

#nuget #dotnet #etl #ssis
Comments
3 min read
Fivetran vs Estuary for Real-Time ETL
jaume_bogu_c05b19569765 profile

Fivetran vs Estuary for Real-Time ETL

#dataengineering #softwaredevelopment #etl #estuary
10
Comments
8 min read
[ES] Entrada/Salida externa blindada: Pasos resilientes de conectividad HTTP con wpipe-steps
william_rodriguez_65a5898 profile

[ES] Entrada/Salida externa blindada: Pasos resilientes de conectividad HTTP con wpipe-steps

#etl
Comments 1
2 min read
CDC with Sling: When Log-Based Works and When Query-Based Is Enough
flarco profile

CDC with Sling: When Log-Based Works and When Query-Based Is Enough

#mysql #dataengineering #etl #database
Comments 1
8 min read
From 16 Hours to Minutes: The Hard Part of Multithreading Isn't the Threads
rami8k profile
Rami

From 16 Hours to Minutes: The Hard Part of Multithreading Isn't the Threads

#multithreading #etl #inmemory
1
Comments
10 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.