Cloudera Training for Apache Kafka

Duration: 4 Days (32 Hours)

Cloudera Training for Apache Kafka Course Overview:

This comprehensive four-day instructor-led course initiates by providing a thorough introduction to Apache Kafka, elucidating its fundamental concepts and architecture, while also delving into prevalent use cases. Progressing from this foundational knowledge, you will delve into strategic Kafka deployment planning, followed by practical experience through the installation and configuration of a multi-node Kafka cluster on the Cloudera Data Platform (CDP) within a cloud-based environment.

Subsequently, you’ll actively engage with the cluster in over 20 hands-on exercises, each contributing to the development of essential skills. Beginning with the creation of Kafka topics, producers, and consumers, the exercises gradually encompass more intricate aspects of Kafka operations and development. This journey spans areas like scalability, reliability, and performance optimization.

Throughout the course, you will become familiar with Cloudera’s recommended toolset for Kafka-related tasks, including Cloudera Manager, Schema Registry, Streams Messaging Manager, and Cruise Control. This immersive learning experience equips participants to confidently work with Kafka and navigate its multifaceted operational and developmental aspects.

Intended Audience:

  • This course is designed for system administrators, data engineers, and developers.

Learning Objectives of Cloudera Training for Apache Kafka:

During this course, you learn how to:

  • Plan, deploy, and operate Kafka clusters
  • Create and manage topics
  • Develop producers and consumers
  • Use replication to improve fault tolerance
  • Use partitioning to improve scalability
  • Troubleshoot common problems and performance issues
Kafka Overview
  • High-Level Architecture
  • Common Use Cases
  • Cloudera’s Distribution of Apache Kafka
  • System Requirements and Dependencies
  • Service Roles
  • Planning Your Deployment Deploying Kafka Services
  • Exercise: Preparing the Exercise Environment
  • Exercise: Installing the Kafka Service with Cloudera Manager
  • Exercise (optional): Create Metrics Dashboards
  • Exercise (optional): Using the CM API
  • Create and Manage Topics
  • Running Producers and Consumers
  • Streams Messaging Manager Overview 
  • Producers, Topics, and Consumers
  • Data Explorer
  • Brokers
  • Topic Management
  • Exercise: Managing Topics using the CLI
  • Exercise: Connecting Producers and Consumers from the Command Line
  • Overview of Kafka’s APIs
  • Topic Management from the Java API
  • Exercise (optional): Managing Kafka Topics Using the Java API
  • Using Producers and Consumers from the Java API
  • Exercise: Developing Producers and Consumers with the Java API
  • Replication
  • Exercise: Observing Downtime Due to Broker Failure
  • Considerations for the Replication Factor
  • Exercise: Adding Replicas to Improve Availability
  • Partitioning
  • How Messages are Partitioned
  • Exercise: Observing How Partitioning Affects Performance
  • Consumer Groups
  • Exercise: Implementing Consumer Groups
  • Consumer Rebalancing
  • Exercise: Using a Key to Control Partition Assignment
  • Delivery Semantics
  • Demonstration (optional): ISRs vs. ACKs
  • Producer Delivery
  • Exercise: Idempotent Producer
  • Transactions
  • Exercise: Transactional Producers and Consumers
  • Handling Consumer Failure
  • Offset Management
  • Exercise: Detecting and Suppressing Duplicate Messages
  • Exercise: Handling Invalid Records
  • Handling Producer Failure
  • End-to-End Latency
  • Notifiers 
  • Alert Policies 
  • Use Cases 
  • Monitoring Overview
  • Monitoring using Cloudera Manager
  • Charts and Reports in CM
  • Monitoring Recommendations
  • Metrics for Troubleshooting
  • Diagnosing Service Failure
  • Exercise: Monitoring Kafka
  • Managing Kafka Topic Storage
  • Demonstration (optional): Message Retention Period
  • Log Cleanup and Collection
  • Rebalancing Partitions
  • Cruise Control
  • Exercise: Installing Cruise Control
  • Exercise: Troubleshooting Kafka Topics
  • Unclean Leader Election
  • Exercise: Unclean Leader Election
  • Adding and Removing Brokers
  • Exercise: Adding and Removing Brokers
  • Best Practices
  • Message Structure
  • Schema Registry
  • Defining Schemas
  • Schema Evolution and Versioning
  • Schema Registry Client
  • Exercise: Using an Avro Schema
  • Message Size
  • Batching
  • Compression
  • Exercise: Observing How Compression Affects Performance
  • Performance Tuning Strategies for the Administrator
  • Cluster Sizing
  • Exercise: Planning Capacity Needed for a Use Case
  • Encryption
  • Authentication
  • Authorization
  • Auditing

Cloudera Training for Apache Kafka Course Prerequisites

  • All students are expected to have basic Linux experience, and basic proficiency with the Java programming language is recommended. No prior experience with Apache Kafka is necessary.

Discover the perfect fit for your learning journey

Choose Learning Modality

Live Online

  • Convenience
  • Cost-effective
  • Self-paced learning
  • Scalability


  • Interaction and collaboration
  • Networking opportunities
  • Real-time feedback
  • Personal attention


  • Familiar environment
  • Confidentiality
  • Team building
  • Immediate application

Training Exclusives

This course comes with following benefits:

  • Practice Labs.
  • Get Trained by Certified Trainers.
  • Access to the recordings of your class sessions for 90 days.
  • Digital courseware
  • Experience 24*7 learner support.

Got more questions? We’re all ears and ready to assist!

Request More Details

Please enable JavaScript in your browser to complete this form.

Subscribe to our Newsletter

Please enable JavaScript in your browser to complete this form.