01 - Apache Kafka Fundamentals: Topics, Partitions, Offsets and Consumer Groups
Kafka is not simply a message queue: it is a distributed commit log designed to sustain millions of events per second with guaranteed durability.
Apache Kafka
Series “Apache Kafka”: it starts with “02 - KRaft in Kafka 4.0: Goodbye ZooKeeper, Quorum Controller and Migration”. KRaft in Kafka 4.0: Goodbye ZooKeeper. Kafka 4.0 (March 2025) finally removed ZooKeeper after years of co-existence. Learn KRaft architecture, quorum controllers, migration strategies from ZooKeeper-based clusters, and…
This series collects 11 articles (approximately 179 minutes of total reading time), designed for a level Intermediate. The main topics covered are Retry, Apache Kafka, Topics, Partitions.
11Articles179 minTotal reading timeIntermediateLevel
RetryApache KafkaTopicsPartitionsConsumer GroupOffset
Series Articles
- 1
- 2
02 - KRaft in Kafka 4.0: Goodbye ZooKeeper, Quorum Controller and Migration
KRaft in Kafka 4.0: Goodbye ZooKeeper. Kafka 4.0 (March 2025) finally removed ZooKeeper after years of co-existence. Learn KRaft architecture…
- 3
03 - Advanced Kafka Producer and Consumer: Acks, Idempotency and Retry
The behavior of a Kafka producer depends critically on three parameters: acks , retries e max.in.flight.requests.per.connection .
- 4
04 - Exactly-Once Semantics in Kafka: Transactions and Coordination
Exactly-once is the hardest delivery semantic to implement in distributed systems. Kafka transactions and coordination, step by step.
- 5
05 - Schema Registry: Avro, Protobuf, Compatibility and Schema Evolution
The Schema Registry is the critical component for data governance in Kafka: centralized management of Avro and Protobuf schemes…
- 6
06 - Kafka Streams: Stream Processing Embedded in Java, KTable and Windowing
Kafka Streams is a Java library for processing streams directly in the application without dedicated cluster. The answer depends on context.
- 7
07 - Kafka Connect: Source/Sink Connector, Debezium CDC and DB Integration
Kafka Connect allows you to connect Kafka to databases, cloud systems and SaaS without write code. Focus on Debezium for Change Data Capture from PostgreSQL…
- 8
08 - Kafka + Apache Flink: Pipeline Analytics Real-Time and Iceberg Sink
The Kafka + Flink combination is the de facto standard for real-time analytics pipelines in 2026. Apache Flink is a distributed stream processing framework.
- 9
09 - Monitoring Kafka: JMX Exporter, Prometheus and Grafana Dashboard
A silent Kafka cluster is not a healthy cluster—it is a cluster you cannot see. Learn JMX metrics export, Prometheus scraping, Grafana dashboard creation…
- 10
10 - Dead Letter Queue and Error Handling in Kafka
In a distributed system, messages fail. Corrupt deserialization, business logic throwing exception, downstream service unreachable…
- 11
11 - Kafka in Production: Sizing, Retention, Replication and Disaster Recovery
Taking Kafka to production takes more than starting three brokers. Sizing, retention, replication and disaster recovery explained.