DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
An Introduction to Data Engineering in Google Cloud Platform

An Introduction to Data Engineering in Google Cloud Platform

Comments
5 min read
Notes on Data Engineering Zoomcamp 2025 - Launch Stream

Notes on Data Engineering Zoomcamp 2025 - Launch Stream

Comments
3 min read
Run PySpark Local Python Windows Notebook

Run PySpark Local Python Windows Notebook

Comments
3 min read
DataOps Best Practices: Building Resilient Pipelines in Databricks

DataOps Best Practices: Building Resilient Pipelines in Databricks

3
Comments
5 min read
Data Orchestration Tool Analysis: Airflow, Dagster, Flyte

Data Orchestration Tool Analysis: Airflow, Dagster, Flyte

16
Comments 8
7 min read
Uses of Snowflake Schema

Uses of Snowflake Schema

Comments
3 min read
Handling Dates in Argo Workflows

Handling Dates in Argo Workflows

1
Comments
4 min read
Massively Scalable Processing & Massively Parallel Processing

Massively Scalable Processing & Massively Parallel Processing

Comments
2 min read
Pandas + NBB data 🐼🏀

Pandas + NBB data 🐼🏀

Comments
2 min read
Data Engineering Foundations: A Hands-On Guide

Data Engineering Foundations: A Hands-On Guide

Comments
6 min read
When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

Comments
5 min read
Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform

Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform

2
Comments
3 min read
Config Secret Value Databricks Python SDK Windows

Config Secret Value Databricks Python SDK Windows

Comments
2 min read
The Columnar Approach: A Deep Dive into Efficient Data Storage for Analytics 🚀

The Columnar Approach: A Deep Dive into Efficient Data Storage for Analytics 🚀

Comments
4 min read
AtmoFlow: Breathing Life into Data - Real Time Weather and Air Quality Insights

AtmoFlow: Breathing Life into Data - Real Time Weather and Air Quality Insights

Comments
7 min read
Optimizing Data Pipelines for Fiix Dating App

Optimizing Data Pipelines for Fiix Dating App

2
Comments
3 min read
What kind of Data Team should I join?

What kind of Data Team should I join?

Comments
1 min read
Tech Interviews: The Hustle Behind Tech Interview Prep

Tech Interviews: The Hustle Behind Tech Interview Prep

Comments
1 min read
Why Feature Scaling Should Be Done After Splitting Your Dataset into Training and Test Sets

Why Feature Scaling Should Be Done After Splitting Your Dataset into Training and Test Sets

Comments
3 min read
Comprehensive LuxDevHQ Data Engineering Course Guide

Comprehensive LuxDevHQ Data Engineering Course Guide

14
Comments 1
4 min read
Essential MongoDB: A Practical Guide to Creating CRUD Operations and Powerful Aggregations

Essential MongoDB: A Practical Guide to Creating CRUD Operations and Powerful Aggregations

8
Comments
3 min read
Exploring OSM changesets via DuckDB

Exploring OSM changesets via DuckDB

Comments
9 min read
I built a data pipeline tool in Go

I built a data pipeline tool in Go

Comments
5 min read
Data Warehousing Architectures

Data Warehousing Architectures

Comments
5 min read
Cultivating a Data-Centric Culture at Work

Cultivating a Data-Centric Culture at Work

Comments
2 min read
loading...