Kafka Broker Startup Scripts

Running a Kafka Broker

Starting brokers in Kafka is pretty straightforward, here are some simple quick start instructions. But as developers, we want to do at least a little more than just the basics. For instance my first needs were to start multiple brokers on the same machine, and also to enable JMX.

Out of the box, you can simply rely on the supplied server.properties Each broker needs a unique id and needs a unique port. These are the corresponding properties from server.properties:

Continue reading

Kafka Tutorial with Examples

Kafka Tutorial

Kafka Tutorial for the Kafka streaming platform. Covers Kafka Architecture with some small examples from the command line. Then we expand on this with a multi-server example. Lastly, we added some simple Java client examples for a Kafka Producer and a Kafka Consumer. We have started to expand on the Java examples to correlate with the design discussion of Kafka. We have also expanded on the Kafka design section and added references.

Continue reading

Learn about Kafka Architecture

Learning about the Kafka Streaming Platform

Slideshare Kafka Architecture. PDF: Introduction to Kafka Architecture.

Related content

• Kafka Architecture
• What is Kafka?
• Kafka and Schema Registry
• Kafka and Avro
• Kafka Tutorial

Kafka Training

Training for DevOps, Architects and Developers

This Kafka training course teaches the basics of the Apache Kafka distributed streaming platform. The Apache Kafka distributed streaming platform is one of the most powerful and widely used reliable streaming platforms. Kafka is a fault tolerant, highly scalable and used for log aggregation, stream processing, event sources and commit logs. Kafka is used by LinkedIn, Yahoo, Twitter, Square, Uber, Box, PayPal, Etsy and more to enable stream processing, online messaging, facilitate in-memory computing by providing a distributed commit log, data collection for big data and so much more.

Continue reading

Learn about Kafka Architecture with Java examples

Learning about the Kafka Streaming Platform with simple Java examples

This picks up where the last blog post left off. We added a multi-server version of the Kafka setup. Then we wrote some simple sample Java Kafka producer and a Java Kafka consumer.

Slideshare Kafka Architecture. PDF: Introduction to Kafka Architecture.

Continue reading