Kafka Architecture: Log Compaction
Kafka Architecture: Log Compaction This post really picks off from our series on Kafka architecture which includes Kafka topics architecture, Kafka producer architecture, Kafka consumer architecture and Kafka ecosystem architecture. This article is heavily inspired by the Kafka section on design around log compaction. You can think of it as the cliff notes about Kafka design around log compaction. Kafka can delete older records based on time or size of a log.