Notion

Building and scaling Notion's data lake

Notion replaced slow warehouse syncs with a CDC pipeline (Debezium to Kafka to Hudi on S3) processed with Spark.

Published
2024-07-01
Scale
Not stated in source
Techniques
change data capture data lake incremental ingestion
Stack
Kafka Debezium Apache Hudi Spark S3

The best scaling write-ups, weekly

One email a week. No spam.