Blogs

Kubernetes StatefulSet with ZooKeeper

Kubernetes StatefulSet with ZooKeeper as an example Background We were having a hard time deploying Kafka to Kubernetes. It worked fine when we were doing development and integration. We started with Minikube for local development. If you are not interested in the background and want to skip to the meat of the matter go ahead and skip ahead. We created a MicroSerivce that uses Kafka in Spring Boot. We ran Kafka in minikube with Helm 2.

Continue reading

Set up Kubernetes on Mac: Minikube, Helm, etc.

Set up docker, k8s and helm on a Mac Book Pro (OSX) These k8s/helm/OSX install notes are reproduced from Rick Hightower with permission of Rick Hightower. Install docker brew install docker Install docker desktop for Mac. Minikube Use the version of k8s that the stable version of helm can use. Install minikube brew cask install minikube Install hyperkit brew install hyperkit Run minikube that is compatible with the last stable helm relesae running on hyperkit minikube start --kubernetes-version v1.

Continue reading

kubectl cheatsheet (OSX/Mac)

These k8s/helm/OSX install notes are reproduced from Rick Hightower profile with permission of Rick Hightower. Shell completion is a must while you are learning Kubernetes. kubectl: shell completion Shell Autocompletion set up guide In 2019, Apple announced that macOS Catalina would now use Zsh (Z Shell) as the default shell, replacing bash. The zsh extends Bourne shell has improvements with features of Bash, ksh, and tcsh. Add autoload -Uz compinit; compinit; source <(kubectl completion zsh) to .

Continue reading

Kafka Consumer: Advanced Consumers

Kafka Tutorial 14: Creating Advanced Kafka Consumers in Java - Part 1 In this tutorial, you are going to create advanced Kafka Consumers. Before you start The prerequisites to this tutorial are Kafka from the command line Kafka clustering and failover basics and Creating a Kafka Consumer in Java. Welcome to the first article on Advanced Kafka Consumers. In this article, we are going to set up an advanced Kafka Consumer.

Continue reading

Kafka Tutorial

Kafka Tutorial This comprehensive Kafka tutorial covers Kafka architecture and design. The Kafka tutorial has example Java Kafka producers and Kafka consumers. The Kafka tutorial also covers Avro and Schema Registry. Kafka Tutorial Part 1: What is Kafka? Kafka Tutorial Part 2: Kafka Architecture Kafka Tutorial Part 3: Kafka Topic Architecture Kafka Tutorial Part 4: Kafka Consumer Architecture Kafka Tutorial Part 5: Kafka Producer Architecture Kafka Tutorial Part 6: Using Kafka from the command line Kafka Tutorial Part 7: Kafka Broker Failover and Consumer Failover Kafka Tutorial Part 8: Kafka Ecosystem Kafka Tutorial Part 9: Kafka Low-Level Design Kafka Tutorial Part 10: Kafka Log Compaction Architecture Kafka Tutorial Part 11: Writing a Kafka Producer example in Java Kafka Tutorial Part 12: Writing a Kafka Consumer example in Java Kafka Tutorial Part 13: Writing Advanced Kafka Producer with Java examples Kafka Tutorial Part 14: Writing Advanced Kafka Consumer with Java examples Kafka Tutorial Part 15: Kafka and Avro Kafka Tutorial Part 16: Kafka and Schema Registry Kafka Tutorial Kafka Training - Onsite, Instructor-led Training for DevOps, Architects and Developers This Kafka course teaches the basics of the Apache Kafka distributed streaming platform.

Continue reading

Kafka Tutorial: Creating Advanced Kafka Producers in Java

Kafka Tutorial 13: Creating Advanced Kafka Producers in Java In this tutorial, you are going to create advanced Kafka Producers. Before you start The prerequisites to this tutorial are Kafka from the command line Kafka clustering and failover basics and Creating a Kafka Producer in Java. This tutorial picks up right where Kafka Tutorial Part 11: Writing a Kafka Producer example in Java and Kafka Tutorial Part 12: Writing a Kafka Consumer example in Java left off.

Continue reading

Kafka Consulting

Kafka Consulting Learn how to employ best practices for your teams’ Kafka deployments. Cloudurable has a range of consulting services and training to help you get the most out of Kafka from architecture to help with setting up health checks. If you are new to Apache Kafka, Cloudurable has mentoring, consulting, and training to help you get the most of the Kafka streaming data platform. Our professional services teams can support your team designing a real-time streaming platform using Kafka.

Continue reading

Kafka Tutorial: Creating Advanced Kafka Consumers in Java

Kafka Tutorial 14: Creating Advanced Kafka Consumers in Java In this tutorial, you are going to create advanced Kafka Consumers. UNDER CONSTRUCTION. Before you start The prerequisites to this tutorial are Kafka from the command line Kafka clustering and failover basics and Creating a Kafka Consumer in Java. This tutorial picks up right where Kafka Tutorial Part 11: Writing a Kafka Producer example in Java left off. In the last tutorial, we created advanced Java producers, now we will do the same with Consumers.

Continue reading

Kafka Architecture: Log Compaction

Kafka Architecture: Log Compaction This post really picks off from our series on Kafka architecture which includes Kafka topics architecture, Kafka producer architecture, Kafka consumer architecture and Kafka ecosystem architecture. This article is heavily inspired by the Kafka section on design around log compaction. You can think of it as the cliff notes about Kafka design around log compaction. Kafka can delete older records based on time or size of a log.

Continue reading

Kafka Architecture: Low Level

If you are not sure what Kafka is, see What is Kafka?. Kafka Architecture: Low-Level Design This post really picks off from our series on Kafka architecture which includes Kafka topics architecture, Kafka producer architecture, Kafka consumer architecture and Kafka ecosystem architecture. This article is heavily inspired by the Kafka section on design. You can think of it as the cliff notes. Kafka Design Motivation LinkedIn engineering built Kafka to support real-time analytics.

Continue reading

                                                                           

Apache Spark Training
Kafka Tutorial
Akka Consulting
Cassandra Training
AWS Cassandra Database Support
Kafka Support Pricing
Cassandra Database Support Pricing
Non-stop Cassandra
Watchdog
Advantages of using Cloudurable™
Cassandra Consulting
Cloudurable™| Guide to AWS Cassandra Deploy
Cloudurable™| AWS Cassandra Guidelines and Notes
Free guide to deploying Cassandra on AWS
Kafka Training
Kafka Consulting
DynamoDB Training
DynamoDB Consulting
Kinesis Training
Kinesis Consulting
Kafka Tutorial PDF
Kubernetes Security Training
Redis Consulting
Redis Training
ElasticSearch / ELK Consulting
ElasticSearch Training
InfluxDB/TICK Training TICK Consulting