Learning path

Data Systems Internals

Build the mental model for why distributed and analytical data systems need coordination, metadata, and storage layout choices.

Foundational2 lessons11 min
Start first article
Path outcome

What this path gives you

You can explain why Kafka needed ZooKeeper and why columnar databases feel faster for analytical workloads.

1
Why Kafka Needed ZooKeeper

Before KRaft, Kafka used ZooKeeper as its coordination layer: broker membership, controller election, topic metadata, partition leaders, and ISR state all needed a consistent place to live.

Data Engineering / 6 min read
2
Why Columnar Databases Feel Like Cheating

Analytical databases like BigQuery and Redshift are fast because they stop pretending every query needs every field. They read columns, compress patterns, and skip the bytes your question never asked for.

Data Engineering / 5 min read
Menu