Course Outline
Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration
- What is Apache Kafka and the Confluent Platform?
- Kafka broker, producer, consumer, and topic fundamentals
- The role of Kafka in data streaming and messaging pipelines
- Confluent extensions: REST Proxy, Schema Registry, Control Center
- Kafka cluster architecture: brokers, partitions, and replication
Module 2: Zookeeper Quorum Configuration
- What is Zookeeper?
- Zookeeper’s role in a Kafka cluster
- Zookeeper quorum size
- Zookeeper configuration
- Implementing SSH on our servers
- Hands-on: Zookeeper configuration (as a team and as a service)
- Using the Zookeeper Command Line Interface (CLI)
- Hands-on: Zookeeper quorum setup
- Zookeeper’s internal file system
- Performance factors affecting Zookeeper
- Demo: Zookeeper management tools and Zoonavigator
Module 3: Kafka Cluster Configuration
- Kafka basics
- Kafka configuration
- Hands-on: Kafka configuration on a single broker
- Hands-on: Executing Kafka commands
- Hands-on: Kafka multi-broker (cluster) setup
- Hands-on: Kafka cluster testing
- Can I connect to my Kafka cluster?
- Advertised.listeners configuration: key setting
- Topic configuration
- Setting up message ingestion and delivery in topics
- Hands-on: Demonstrating Kafka resilience
- Kafka performance: I/O, network, RAM, CPU, OS
- Kafka performance: other factors
- Hands-on: How to modify broker configurations
Module 4: Advanced Kafka Configuration
- Landoop Kafka Topics UI, Confluent REST Proxy, Confluent Schema Registry configuration
- Sending and receiving messages (CLI, Java, Spring Framework)
- Metrics and monitoring tools (Confluent Control Center, Elasticsearch, etc.)
- Log files and offset management
- High availability and disaster recovery
- Ensuring high availability with replication
- Performance tuning (producer/consumer)
- Disaster recovery strategies
- Failover control and data recovery
- Connectors setup
- Kafka Connect implementation
- Kafka security features
Summary and Next Steps
Requirements
- Experience with Linux-based systems and command-line tools
- Familiarity with distributed systems concepts
- Understanding of basic networking and system configuration
Audience
- DevOps and SRE teams managing Kafka deployments
- System administrators working with Confluent and Zookeeper
- Kafka developers and architects responsible for scalable systems
Testimonials (5)
the deploy of Kafka and zookeeper was very useful to understand the problem perhaps to check the config files would be also useful for next trainings
Bolivar Alvarez - SICPA SA
Course - Administration of Kafka Message Queue
Could throw questions at him and he would jump to slides or example to try and show and answer all our questions
Johannes - Canon Medical Informatics Europe B.V.
Course - Administration of Kafka Topic
The labs and the slides combine well with Jorge's knowledge and love for Kafka.
Willem - BMW SA
Course - Apache Kafka for Developers
Sufficient hands on, trainer is knowledgable
Chris Tan
Course - A Practical Introduction to Stream Processing
Grate skills, examples, very good exercises
