Kafka Tutorial

Kafka Tutorial

Kafka Tutorial This comprehensive Kafka tutorial covers Kafka architecture and design. The Kafka tutorial has example Java Kafka producers and Kafka consumers. The Kafka tutorial also covers Avro and Schema Registry. Kafka Tutorial Part 1: What is Kafka? Kafka Tutorial Part 2: Kafka Architecture Kafka Tutorial Part 3: Kafka Topic Architecture Kafka Tutorial Part 4: Kafka Consumer Architecture Kafka Tutorial Part 5: Kafka Producer Architecture Kafka Tutorial Part 6: Using Kafka from the command line Kafka Tutorial Part 7: Kafka Broker Failover and Consumer Failover Kafka Tutorial Part 8: Kafka Ecosystem Kafka Tutorial Part 9: Kafka Low-Level Design Kafka Tutorial Part 10: Kafka Log Compaction Architecture Kafka Tutorial Part 11: Writing a Kafka Producer example in Java Kafka Tutorial Part 12: Writing a Kafka Consumer example in Java Kafka Tutorial Part 13: Writing Advanced Kafka Producer with Java examples Kafka Tutorial Part 14: Writing Advanced Kafka Consumer with Java examples Kafka Tutorial Part 15: Kafka and Avro Kafka Tutorial Part 16: Kafka and Schema Registry Kafka Tutorial

Continue reading

Kafka Tutorial: Creating Advanced Kafka Producers in Java

Kafka Tutorial 13: Creating Advanced Kafka Producers in Java In this tutorial, you are going to create advanced Kafka Producers. UNDER CONSTRUCTION. Before you start The prerequisites to this tutorial are Kafka from the command line Kafka clustering and failover basics and Creating a Kafka Producer in Java. This tutorial picks up right where Kafka Tutorial Part 11: Writing a Kafka Producer example in Java and Kafka Tutorial Part 12: Writing a Kafka Consumer example in Java left off.

Continue reading

Kafka Tutorial: Creating Advanced Kafka Consumers in Java

Kafka Tutorial 14: Creating Advanced Kafka Consumers in Java In this tutorial, you are going to create advanced Kafka Consumers. UNDER CONSTRUCTION. Before you start The prerequisites to this tutorial are Kafka from the command line Kafka clustering and failover basics and Creating a Kafka Consumer in Java. This tutorial picks up right where Kafka Tutorial Part 11: Writing a Kafka Producer example in Java left off. In the last tutorial, we created advanced Java producers, now we will do the same with Consumers.

Continue reading

Kafka Architecture: Log Compaction

Kafka Architecture: Log Compaction This post really picks off from our series on Kafka architecture which includes Kafka topics architecture, Kafka producer architecture, Kafka consumer architecture and Kafka ecosystem architecture. This article is heavily inspired by the Kafka section on design around log compaction. You can think of it as the cliff notes about Kafka design around log compaction. Kafka can delete older records based on time or size of a log.

Continue reading

Kafka Architecture: Low Level

If you are not sure what Kafka is, see What is Kafka?. Kafka Architecture: Low-Level Design This post really picks off from our series on Kafka architecture which includes Kafka topics architecture, Kafka producer architecture, Kafka consumer architecture and Kafka ecosystem architecture. This article is heavily inspired by the Kafka section on design. You can think of it as the cliff notes. Kafka Design Motivation LinkedIn engineering built Kafka to support real-time analytics.

Continue reading

Kafka Tutorial: Creating a Kafka Consumer in Java

Kafka Tutorial: Writing a Kafka Consumer in Java In this tutorial, you are going to create simple Kafka Consumer. This consumer consumes messages from the Kafka Producer you wrote in the last tutorial. This tutorial demonstrates how to process records from a Kafka topic with a Kafka Consumer. This tutorial describes how Kafka Consumers in the same group divide up and share partitions while each consumer group appears to get its own copy of the same data.

Continue reading

Kafka Tutorial: Creating a Kafka Producer in Java

Kafka Tutorial: Writing a Kafka Producer in Java In this tutorial, we are going to create simple Java example that creates a Kafka producer. You create a new replicated Kafka topic called my-example-topic, then you create a Kafka producer that uses this topic to send records. You will send records with the Kafka producer. You will send records synchronously. Later, you will send records asynchronously. Before you start Prerequisites to this tutorial are Kafka from the command line and Kafka clustering and failover basics.

Continue reading

Kafka Tutorial: Kafka clusters, Kafka consumer failover, and Kafka broker failover

If you are not sure what Kafka is, start here “What is Kafka?”. Getting started with Kafka cluster tutorial Understanding Kafka Failover This Kafka tutorial picks up right where the first Kafka tutorial from the command line left off. The first tutorial has instructions on how to run ZooKeeper and use Kafka utils. In this tutorial, we are going to run many Kafka Nodes on our development laptop so that you will need at least 16 GB of RAM for local dev machine.

Continue reading

Kafka Tutorial: Using Kafka from the command line

If you are not sure what Kafka is, start here “What is Kafka?”. Getting started with Kafka tutorial Let’s show a simple example using producers and consumers from the Kafka command line. Download Kafka 0.10.2.x from the Kafka download page. Later versions will likely work, but this was example was done with 0.10.2.x. We assume that you have Java SDK 1.8.x installed. We unzipped the Kafka download and put it in ~/kafka-training/, and then renamed the Kafka install folder to kafka.

Continue reading

Kafka Architecture: Consumers

Kafka Consumer Architecture - Consumer Groups and subscriptions This article covers some lower level details of Kafka consumer architecture. It is a continuation of the Kafka Architecture, Kafka Topic Architecture, and Kafka Producer Architecture articles. This article covers Kafka Consumer Architecture with a discussion consumer groups and how record processing is shared among a consumer group as well as failover for Kafka consumers. Kafka Consumer Groups You group consumers into a consumer group by use case or function of the group.

Continue reading


Kafka Tutorial
Akka Consulting
Cassandra Training
AWS Cassandra Database Support
Kafka Support Pricing
Cassandra Database Support Pricing
Non-stop Cassandra
Watchdog
Advantages of using Cloudurable™
Cassandra Consulting
Cloudurable™| Guide to AWS Cassandra Deploy
Cloudurable™| AWS Cassandra Guidelines and Notes
Free guide to deploying Cassandra on AWS
Kafka Training
Kafka Consulting
DynamoDB Training
DynamoDB Consulting
Kinesis Training
Kinesis Consulting
Kafka Tutorial PDF