DEV Community

# bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Solved a practical business problem when using Hudi: LakeSoul supports null field non-override semanticssemantics

Solved a practical business problem when using Hudi: LakeSoul supports null field non-override semanticssemantics

Reactions 7 Comments
3 min read
What is the Lakehouse, the latest Direction of Big Data Architecture?

What is the Lakehouse, the latest Direction of Big Data Architecture?

Reactions 8 Comments
10 min read
May 9th in Streaming

May 9th in Streaming

Reactions 6 Comments
1 min read
Build a real-time machine learning sample library using the best open-source project about big data and data lakehouse, LakeSoul

Build a real-time machine learning sample library using the best open-source project about big data and data lakehouse, LakeSoul

Reactions 9 Comments
7 min read
Leveraging Change Data Capture for Fraud Detection using Arcion Cloud

Leveraging Change Data Capture for Fraud Detection using Arcion Cloud

Reactions 10 Comments
9 min read
How to prepare for the GCP Professional Data Engineer certification

How to prepare for the GCP Professional Data Engineer certification

Reactions 16 Comments
8 min read
Dynamic way doing ETL through Pyspark

Dynamic way doing ETL through Pyspark

Reactions 10 Comments 2
4 min read
BigQuery transactions over multiple queries, with sessions

BigQuery transactions over multiple queries, with sessions

Reactions 8 Comments
3 min read
Auto discovering and auto actions in data monitoring or How to drink coffee instead of routine tasks

Auto discovering and auto actions in data monitoring or How to drink coffee instead of routine tasks

Reactions 13 Comments
9 min read
Fully Embracing K8s, Cisco Hangzhou Seeks to Support K8s Tasks Based on Apache DolphinScheduler

Fully Embracing K8s, Cisco Hangzhou Seeks to Support K8s Tasks Based on Apache DolphinScheduler

Reactions 4 Comments
5 min read
AWS Certified Big Data - Specialty Certification - Complete Study Guide

AWS Certified Big Data - Specialty Certification - Complete Study Guide

Reactions 4 Comments
4 min read
Apache Spark, Hive, and Spring Boot — Testing Guide

Apache Spark, Hive, and Spring Boot — Testing Guide

Reactions 32 Comments 1
18 min read
A Brief Comparison of Apache DolphinScheduler With Other Alternatives

A Brief Comparison of Apache DolphinScheduler With Other Alternatives

Reactions 4 Comments
10 min read
Design concept of a best opensource project about big data and data lakehouse

Design concept of a best opensource project about big data and data lakehouse

Reactions 9 Comments
9 min read
Details of 4 best opensource projects about big data you should try out(Ⅰ)

Details of 4 best opensource projects about big data you should try out(Ⅰ)

Reactions 7 Comments
5 min read
How to Build A System Popular Among Data Analysts?

How to Build A System Popular Among Data Analysts?

Reactions 7 Comments
5 min read
Create a Hadoop playground with Docker Desktop on Windows in minutes

Create a Hadoop playground with Docker Desktop on Windows in minutes

Reactions 6 Comments
4 min read
Characteristics of Big Data

Characteristics of Big Data

Reactions 4 Comments
8 min read
HIVE installation on WSL

HIVE installation on WSL

Reactions 6 Comments
3 min read
How to create a DIY Inexpensive Cloud Data Lake

How to create a DIY Inexpensive Cloud Data Lake

Reactions 5 Comments
3 min read
Quick use of CDC: A new demo from lakesoul makes it easier to set up the environment

Quick use of CDC: A new demo from lakesoul makes it easier to set up the environment

Reactions 8 Comments
5 min read
Big Data in Cloud Computing - AWS

Big Data in Cloud Computing - AWS

Reactions 14 Comments
2 min read
4 best opensource projects about big data you should try out

4 best opensource projects about big data you should try out

Reactions 15 Comments 3
3 min read
A new unified streaming and batch table storage solution similar to iceberg/hudi/delta lake but with several new functions

A new unified streaming and batch table storage solution similar to iceberg/hudi/delta lake but with several new functions

Reactions 8 Comments
2 min read
Fast Multivalue Look-ups For Huge Data Sets

Fast Multivalue Look-ups For Huge Data Sets

Reactions 5 Comments
6 min read
Apache Spark Unit Testing Strategies

Apache Spark Unit Testing Strategies

Reactions 7 Comments
3 min read
[OPINIÃO] Construindo uma Carreira como Data Engineer