Description

In this three-day training, you will learn how to deploy, operate, and monitor a Kafka cluster using industry best practices, which have been developed by leading Apache Kafka experts.

/p>

Who is this training for ?

For whom ?

This course is designed for developers and operational teams who are required to deploy, administer and configure a Kafka cluster.

Prerequisites

Participants must have a good knowledge of Linux/Unix, and have basic knowledge of TCP/IP networks.

Knowledge of the Java Virtual Machine (JVM) is useful.

No prior knowledge of Kafka is necessary

Training objectives

• You will learn how Kafka and the Confluent platform work and their main subsystems.
• You will discover their functionalities and how they interact.
• You will also learn how to set up, administer and configure your cluster.

Training program

• The Motivations of Apache Kafka
  • The complexity of systems
  • The advent of real-time processing
  • Kafka: "Stream Data Platform"
• Kafka Concepts and Fundamentals
  • Kafka Overview
  • Producers
  • Brokers
  • Consumers
  • Using Zookeeper
  • Comparison with traditional message broker systems
• Consistency and guarantee of non-loss of data
  • Replication concepts
  • Message publication consistency
  • Shutdown and breakdown of a broker
  • Role of the Broker Controller
  • Kafka (data) log files
  • Offset Management
• High Availability (HA)
  • The Kafka reference architecture
  • Brokers
  • ZooKeeper
  • Kafka Connect
  • SchemaRegistry
  • RESTProxy
  • Multi-Data-centers
• Manage a Kafka cluster
  • Installation and operation of Kafka
  • Monitoring and supervision of a cluster
  • Basic operations of a cluster
  • Retention and compaction of logs
  • Elasticity of a cluster
• Optimize Kafka performance
  • Producer Performance
  • Broker Performance
  • Broker Failure and Recovery Time
  • Consumer Load Distribution
  • Consumer Performance
  • Performance Tests
• Secure a Kafka/Zookeeper cluster
  • Network encryption and Authentication via SSL
  • Authentication via SASL
  • Data encryption on disk
  • Securing ZooKeeper, SchemaRegistry and RESTProxy
  • Migrating to a secure cluster
• Kafka Connect: Integrate systems with Kafka
  • Motivations for Kafka Connect
  • Types of connectors
  • Implementation of Kafka Connect
  • Deployment modes (standalone/distributed )
  • Connector configuration
  • Deployment considerations
  • Comparison with other systems