Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
bigdata
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
From API to Business Insights: Building a Medallion Pipeline on AWS
Rahul R
Rahul R
Rahul R
Follow
Oct 25
From API to Business Insights: Building a Medallion Pipeline on AWS
#
aws
#
bigdata
#
python
#
architecture
Comments
Add Comment
11 min read
Como aprendi Apache Spark — Parte 6: Spark SQL e DataFrames — do código ao plano de execução
renanpyd
renanpyd
renanpyd
Follow
Oct 24
Como aprendi Apache Spark — Parte 6: Spark SQL e DataFrames — do código ao plano de execução
#
pyspark
#
dataengineering
#
bigdata
#
cluster
Comments
Add Comment
15 min read
Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução
renanpyd
renanpyd
renanpyd
Follow
Oct 24
Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução
#
dataengineering
#
bigdata
#
spark
#
cluster
Comments
Add Comment
14 min read
Como aprendi Apache Spark — Parte 4: Shuffle — onde a performance começa a ficar avançada
renanpyd
renanpyd
renanpyd
Follow
Oct 23
Como aprendi Apache Spark — Parte 4: Shuffle — onde a performance começa a ficar avançada
#
dataengineering
#
bigdata
#
pyspark
#
spark
Comments
Add Comment
13 min read
Próximo: Parte 2 — Por dentro da arquitetura do Apache Spark: Driver, Executors, Jobs, Stages e Tasks
renanpyd
renanpyd
renanpyd
Follow
Oct 23
Próximo: Parte 2 — Por dentro da arquitetura do Apache Spark: Driver, Executors, Jobs, Stages e Tasks
#
pyspark
#
bigdata
#
dataengineering
#
spark
Comments
Add Comment
10 min read
Como aprendi Apache Spark — Parte 3: Partições, paralelismo e performance
renanpyd
renanpyd
renanpyd
Follow
Oct 23
Como aprendi Apache Spark — Parte 3: Partições, paralelismo e performance
#
dataengineering
#
bigdata
#
pyspark
#
spark
Comments
Add Comment
13 min read
Apache Data Lakehouse Weekly: October 14-21, 2026
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21
Apache Data Lakehouse Weekly: October 14-21, 2026
#
bigdata
#
data
#
opensource
Comments
Add Comment
8 min read
Como aprendi Apache Spark — Parte 7: Memória — Executors, Driver, Cache, Spill e OutOfMemory
renanpyd
renanpyd
renanpyd
Follow
Oct 24
Como aprendi Apache Spark — Parte 7: Memória — Executors, Driver, Cache, Spill e OutOfMemory
#
cluster
#
spark
#
python
#
bigdata
1
 reaction
Comments
Add Comment
16 min read
BigQuery BI Engine deserves a benchmark before you dismiss Looker Studio as slow
Jean-Luc Martel
Jean-Luc Martel
Jean-Luc Martel
Follow
Oct 18
BigQuery BI Engine deserves a benchmark before you dismiss Looker Studio as slow
#
googlecloud
#
bigdata
#
data
Comments
Add Comment
2 min read
Can an AI Agent Fix a Failed Data Pipeline? Build a Safe Recovery Workflow
Rahul R
Rahul R
Rahul R
Follow
Oct 16
Can an AI Agent Fix a Failed Data Pipeline? Build a Safe Recovery Workflow
#
ai
#
agents
#
bigdata
#
aws
1
 reaction
Comments
Add Comment
8 min read
Building Local Browser Automation Workflows with Tobub
tobub
tobub
tobub
Follow
Oct 12
Building Local Browser Automation Workflows with Tobub
#
ai
#
webdev
#
bigdata
#
programming
Comments
Add Comment
2 min read
Next-Gen Synergy: How Blockchain and Decoupled Databases Secure Big Data Integrity
Fuad Husnan
Fuad Husnan
Fuad Husnan
Follow
Oct 14
Next-Gen Synergy: How Blockchain and Decoupled Databases Secure Big Data Integrity
#
bigdata
#
blockchain
1
 reaction
Comments
Add Comment
7 min read
Apache Spark procesa terabytes sin que se te derrita el cluster
Juan Torchia
Juan Torchia
Juan Torchia
Follow
Oct 8
Apache Spark procesa terabytes sin que se te derrita el cluster
#
spanish
#
espanol
#
java
#
bigdata
Comments
Add Comment
5 min read
How to Convert XML to PARQUET?
Jaskirat Singh Anand
Jaskirat Singh Anand
Jaskirat Singh Anand
Follow
Oct 6
How to Convert XML to PARQUET?
#
automation
#
bigdata
#
data
#
python
Comments
Add Comment
6 min read
Como aprendi Apache Spark — Parte 1: Por que o Spark mudou o processamento de Big Data
renanpyd
renanpyd
renanpyd
Follow
Oct 6
Como aprendi Apache Spark — Parte 1: Por que o Spark mudou o processamento de Big Data
#
spark
#
dataengineering
#
bigdata
#
python
1
 reaction
Comments
Add Comment
7 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account