Course Description

  • What are the course objectives?

    The Apache Kafka course offered by Simplilearn is a key requirement for those aspiring to become Big Data Hadoop architects. Apache Kafka is an open-source stream processing platform and a high-performance real-time messaging system that can process millions of messages per second. It provides a distributed and partitioned messaging system that is highly fault tolerant. This Kafka Training course will guide participants through Kafka architecture, installation, interfaces and configuration on their way to learning the advanced concepts of Big Data.

  • Why is this course so desirable?

    Apache Kafka course is popularly used in many companies across the world. The training in Apache Kafka is most sought-after for the following reasons:
    • Apache Kafka is the preferred messaging platform for processing Big Data in real-time and fast processing of real-time message feeds.
    • Kafka was initially developed at LinkedIn to process millions of messages per second and later became a part of the Apache open-source projects. It is a highly scalable and fault-tolerant messaging system with petabyte scale message processing in real-time.
    • The Apache Kafka professionals can demonstrate their expertise in the fast-growing big data industry. 
    • Trained Apache Kafka professionals are experienced in tools used to process huge amounts of data, empowering their organizations to better leverage Big Data analytics.

  • What skills will you learn?

    By the end of Simplilearn’s Kafka training course, participants will be able to:
    • Describe the importance of big data
    • Describe the fundamental concepts of Kafka
    • Describe the architecture of Kafka
    • Explain how to install and configure Kafka
    • Explain how to use Kafka for real-time messaging

  • What are the career benefits of Kafka certification?

    Apache Kafka is one among the top ten fastest growing, in-demand technical skills. The Apache Kafka certification helps IT professionals establish themselves as experts in the field of Big Data, and certified professionals typically earn higher salaries than their non-certified peers. Certified professionals can pursue new career paths such as senior software professional, IT consultant, lead software professional and Big Data professional.
     
    The value of Apache Kafka certification has increased sharply in recent years and this certification is quickly becoming an entry-level requirement for a majority of IT-based roles. According to a Dataquest survey, Apache Kafka figures among the top 10 highest paying IT jobs with a salary of $134,950. Source: DataQuest

  • Who should take this Apache Kafka course?

    The Apache Kafka course is suitable for many roles, including:
    • Professionals aspiring for a career in Big Data
    • Analytics professionals, research professionals, IT developers, testers and project managers
    • Students
    • Individuals looking for a change in career

Course Preview

    • Lesson 01 - Course Introduction

      07:16
      • Course Introduction
        07:16
    • Lesson 02 - Big Data Overview

      03:07
      • 1.Big Data Overview
        03:07
    • Lesson 03 - Big Data Analytics

      02:55
      • 1.Big Data Analytics
        02:55
    • Lesson 04 - Messaging System

      05:48
      • 1.Messaging System
        05:48
    • Lesson 05 - Kafka Overview

      08:33
      • 1.Introduction and Features of Kafka
        04:26
      • 2.Kafka Usecases
        04:07
    • Lesson 06 - Kafka Components and Architecture

      09:16
      • 1.Kafka Terminologies
        01:13
      • 2.Kafka Components
        07:10
      • 3.Kafka Architecture
        00:53
    • Lesson 07 - Kafka Clusters

      01:27
      • 1.Kafka Clusters
        01:27
    • Lesson 08 - Kafka Industry Usecases

      02:27
      • 1.Kafka Industry Usecases
        02:27
    • Lesson 09 - Demo: Install Kafka and Zookeeper

      04:58
      • 1 DEMO: Install zookeeper
        03:17
      • 2 DEMO: Install Kafka
        01:41
    • Lesson 10 - Demo: Single Node Single-Multi Broker Cluster

      05:38
      • 1 DEMO: Setup A Single Node Single Broker Cluster
        02:39
      • 2 DEMO: Setup A multi Node Single Broker Cluster
        02:59
    • Lesson 11 - Key Takeaways

      00:15
      • Key Takeaways
        00:15
    • Lesson 01 - Overview of Producer and Its Architecture

      04:51
      • Learning Objectives
        04:51
    • Lesson 02 - Kafka Producer Configuration

      14:33
      • 1.Kafka Producer Configuration
        02:27
      • 2.Kafka Producer Optional Configuration
        02:49
      • 3.Kafka Producer Configuration Objects
        06:59
      • 4.Demo: Create a Kafka Producer
        02:18
    • Lesson 03 - Send Messages

      04:50
      • 1.Sending Messages
        04:50
    • Lesson 04 - Serializers

      13:51
      • 1.Serializers and Custom Serializers
        02:57
      • 2.Demo: Creating a Custom Serializer
        03:59
      • 3.Serializers Challenges and Serializing using Apache Avro
        04:22
      • 4.Demo: Serializing Using Apache Avro
        02:33
    • Lesson 05 - Partitions

      08:50
      • 1.Partitions
        04:38
      • 2.Demo: Setup Custom Partition
        04:12
    • Lesson 06 - Key Takeaways

      00:17
      • Key Takeaways
        00:17
    • Lesson 01 - Kafka Consumer - Overview, Consumer Groups and Partitioners

      13:05
      • 1.Learning Objectives
        03:36
      • 2.Consumer Groups
        05:05
      • 3.Partition Rebalance and Creating a Consumer
        04:24
    • Lesson 02 - Poll Loop

      02:42
      • 1.Poll loop and it's functioning
        02:42
    • Lesson 03 - Configuring Consumer

      12:26
      • 1.Kafka Consumer Configuration- Part one
        04:35
      • 2.Kafka Consumer Configuration- Part two
        05:09
      • 3.Demo: Create Kafka Consumer
        02:42
    • Lesson 04 - Commit and Offset

      13:59
      • 1.Commit and Offset
        04:23
      • 2.Ways of Commiting Offset - Automatic Offset
        02:16
      • 3.Ways of Commiting Offset - Commit Current Offset
        01:34
      • 4.Ways of Commiting Offset - Asynchronous Commit
        02:15
      • 5.Ways of Commiting Offset - Combining Synchronous and Asynchronous Commits
        02:18
      • 6.Ways of Commiting Offset - Commit Specified Offset
        01:13
    • Lesson 05 - Rebalance Listeners

      01:45
      • 1.Rebalance Listeners
        01:45
    • Lesson 06 - Consuming Records with Specific Offset

      04:13
      • 1.Consuming Records with Specific Offset
        04:13
    • Lesson 07 - Deserializers

      05:32
      • 1.Deserializers
        03:18
      • 2.Demo: Create and Use Custom Deserializer
        02:14
    • Lesson 08 - Key Takeaways

      00:30
      • Key Takeaways
        00:30
    • Lesson 01 - Learning Objectives

      04:46
      • Learning Objectives
        04:46
    • Lesson 02 - Replications

      14:53
      • 1.Replication and Replica Types
        04:19
      • 2.Preffered Ladder, Request and Request Processing
        04:24
      • 3.Types of Requests
        06:10
    • Lesson 03 - Storage

      09:59
      • 1.Partition Allocation, File Management and Segments
        05:21
      • 2.File Format, Index and Compaction
        04:38
    • Lesson 04 - Configuration in Reliable System

      18:18
      • 1.Kafka Reliability and Reliablity Methods
        01:34
      • 2.Broker Configuration for Replication
        04:41
      • 3.Producer in Reliable System
        04:37
      • 4.Consumer in Reliable System
        07:26
    • Lesson 05 - Key Takeaways

      00:28
      • Key Takeaways
        00:28
    • Lesson 01 - Learning Objectives

      05:22
      • Learning Objectives
        05:22
    • Lesson 02 - Multi Cluster Architecture

      08:45
      • 1.Hub and Spokes Architecture and Active Active Architecture
        05:37
      • 2.Active-Standby Architecture and Strech Clusters
        03:08
    • Lesson 03 - MirrorMaker

      17:41
      • 1.MirrorMaker Configuration
        04:27
      • 2.MirrorMaker Deployment and Tuning
        06:33
      • 3.Demo: Setting up MirrorMaker
        06:41
    • Lesson 04 - Administering Kafka

      09:50
      • 1.Administering Kafka - Topic Operations
        05:50
      • 2.Administering Kafka - Consumer Group Operations
        04:00
    • Lesson 05 - Dynamic Configuration Changes

      09:20
      • 1.Dynamic Configuration Changes
        06:52
      • 2.Partition Management
        02:28
    • Lesson 06 - Console Producer Tool

      01:27
      • 1.Console Producer Tool
        01:27
    • Lesson 07 - Console Consumer Tool

      02:36
      • 1.Console Consumer Tool
        02:36
    • Lesson 08 - Key Takeaways

      00:25
      • Key Takeaways
        00:25
    • Lesson 01 -Monitoring

      47:23
      • 1 Learning Objectives
        02:17
      • 2.Server or Infrastructure Monitoring and Application Monitoring
        02:15
      • 3.Kafka Monitoring
        03:16
      • 4.Kafka Broker Metrics - Under Replicated Partitions
        06:25
      • 5.Kafka Broker Metrics - Others
        06:42
      • 6.Topic and Partition Specific Metrics
        01:56
      • 7.Logging and Client Monitoring
        02:48
      • 8.Producer and Consumer Metrics
        06:11
      • 9.Quotas and Lag Monitoring
        05:53
      • 10.Monitoring Dashboard
        03:33
      • 11.Demo: Setting up Open Source Health Monitor
        06:07
    • Lesson 02 - Kafka Schema Registry and Avro

      06:27
      • 1.Kafka Schema Registry
        06:27
    • Lesson 03 - Kafka Schema Registry Components

      08:14
      • 1.Kafka Component and Architecture
        04:01
      • 2.Kafka Schema Registry - Internal working and Use-cases
        04:13
    • Lesson 04 - Kafka Schema Registry Working

      08:25
      • 1.Kafka Schema Registry Working
        04:37
      • 2.Demo: Using Kafka Schema Registry With Kafka
        03:48
    • Lesson 05 - Key Takeaways

      00:17
      • Key Takeaways
        00:17
    • Lesson 01 - Kafka Stream Overview

      09:49
      • 1 Learning Objectives
        04:13
      • 2.Kafka Stream
        05:36
    • Lesson 02 - Kafka Stream Architecture, Working and Components

      50:42
      • 1.Kafka Stream Architecture and Working
        02:52
      • 10.Aggregation and Windowing
        05:41
      • 2.Kafka Stream Components
        04:28
      • 3. Kafka Stream Architecture Tasks, Threading Model and Local State Store
        04:30
      • 4.Kafka Stream Architecture - Record Buffer
        02:17
      • 5.Memory Management and Streaming Data Pipeline
        06:15
      • 6.Kafka Stream DSL
        06:41
      • 7.KStream Operations
        09:54
      • 8.KTable
        04:04
      • 9.KTable Operations
        04:00
    • Lesson 03 - Stream Concepts and Working

      15:30
      • 1.Processor Topology and Stream Processor
        04:19
      • 2.Stream and Processor APIs one
        07:09
      • 3.Processor APIs - Create Topology
        04:02
    • Lesson 04 - Kafka Connectors

      06:08
      • 1.Kafka Connectors
        06:08
    • Lesson 05 - Kafka Connector Configuration

      25:08
      • 1.Standalone and Sink Connector Configuration
        04:07
      • 2.Running Kafka Connect
        04:11
      • 3.Kafka Connector Distributed Mode
        03:56
      • 4.HTTP Rest Interface
        04:42
      • 5.Demo - Kafka Connector
        02:41
      • 6.Demo: Create an Application using Kafka Streams
        05:31
    • Lesson 06 - Key Takeaways

      00:20
      • Key Takeaways
        00:20
    • Lesson 01 - Apache Storm

      09:10
      • 1 Learning Objectives
        02:58
      • 2.Real-time Analytics
        06:12
    • Lesson 02 - Apache Storm Architecture and Components

      08:34
      • 1.Apache Storm Architecture
        04:05
      • 2.Apache Storm Components
        04:29
    • Lesson 03 - Apache Storm Topology

      10:44
      • 1.Apache Storm Topology
        05:05
      • 2.Apache Storm Topology - Execution Plan
        05:39
    • Lesson 04 - Kafka Spout

      03:54
      • 1.Kafka Spout
        03:54
    • Lesson 05 - Integration of Apache Storm and Kafka

      10:19
      • 1.Integration of Apache Storm and Kafka
        06:52
      • 2.Demo - Simple Standalone Application using Kafka and Storm
        03:27
    • Lesson 06 - Key Takeaways

      00:20
      • Key Takeaways
        00:20
    • Lesson 01 - Introduction to Spark and It_s Components

      10:59
      • 1 Learning Objectives
        03:44
      • 2.Spark Components
        07:15
    • Lesson 02 - Basics of Spark - RDD, Data Sets, and Transformation and Actions

      24:46
      • 1.RDD
        03:46
      • 2.RDD Operations - Transformation - Map, FlatMap and Filter
        05:12
      • 3.RDD Operations - Transformation - Join, Distinct, First and Take
        05:28
      • 4.RDD Operations - Actions
        02:29
      • 5.Data Sets and Spark Session
        02:38
      • 6.Data Sets and Spark Session Operations
        05:13
    • Lesson 03 - Spark Stream

      03:09
      • 1.Spark Stream
        03:09
    • Lesson 04 - Spark Integration with Kafka

      06:26
      • 1.Spark Integration with Kafka
        02:36
      • 2.Demo - Running Small Standalone Application in Spark with Kafka
        03:50
    • Lesson 05 - Flume

      08:03
      • 1.Flume
        05:25
      • 2.Flume Connectors
        02:38
    • Lesson 06 -Flume Kafka to HDFS Configuration

      13:28
      • 1.Flume Kafka to HDFS Configuration
        05:57
      • 2.Demo - Creating Flume agent Sending data from Kafka to HDFS
        07:31
    • Lesson 07 - Key Takeaways

      00:29
      • Key Takeaways
        00:29
    • Lesson 01 - Admin Client

      11:59
      • 1 Learning Objectives
        06:48
      • 2.Demo - Perform Various Admin Tasks using Admin Client
        05:11
    • Lesson 02 - Kafka Security

      01:36
      • 1.Kafka Security
        01:36
    • Lesson 03 - Kafka Security Components

      08:58
      • 1.Kafka Security Components
        05:25
      • 2.SASL
        03:33
    • Lesson 04 - Configure SSL in Kafka

      01:50
      • 1.Configure SSL in Kafka
        01:50
    • Lesson 05 - Secure using ACLs

      05:12
      • 1.Secure using ACLs
        05:12
    • Lesson 06 - Key Takeaways

      00:22
      • Key Takeaways
        00:22
    • {{childObj.title}}

      • {{childObj.childSection.chapter_name}}

        • {{lesson.title}}
      • {{lesson.title}}

    View More

    View Less

Exam & Certification

  • What are the prerequisites for the Apache Kafka course?

    The prerequisites for the Apache Kafka course are:
    • Knowledge of any messaging system
    • Basic knowledge of Java or any programming language
    • Some knowledge of Linux- or Unix-based systems (nor required)
     

  • How do I unlock my Simplilearn certificate?

    Online Self-Learning:
    • Complete 85 percent of the course
    • Complete one simulation test with a minimum score of 60 percent

  • Do you provide any practice tests as part of this course?

    Yes, we provide 1 practice test as part of our course to help you prepare for the actual certification exam. You can try this Apache Kafka MCQ Quiz - Free Practice Test to understand the type of tests that are part of the course curriculum.

Course Advisor

Ronald van Loon
Ronald van Loon Top 10 Big Data and Data Science Influencer, Director - Adversitement

Named by Onalytica as one of the three most influential people in Big Data, Ronald is also an author of a number of leading Big Data and Data Science websites, including Datafloq, Data Science Central, and The Guardian. He also regularly speaks at renowned events.

      FAQs

      • How do I enrol for the online training?

        You can enrol for the online training through our website. You can make online payment using any of the following options:
        • Visa debit/credit card
        • American Express and Diners Club cards
        • Master Card
        • PayPal
        Once the online payment is done, you will automatically receive payment receipt, via email.

      • What will I get along with this training?

        In this training, you will have access to online e-learning and practice tests.

      • Can I cancel my enrollment? Do I get a refund?

        Yes! You can cancel your enrollment. We will provide you a complete refund after deducting the administration fee. To know more, please go through our Refund Policy.

      • Do you provide money back guarantee for the training programs?

        Yes. We do offer a money-back guarantee for many of our training programs. You can refer to the Refund Policy and raise refund requests via our Help and Support portal.

      • Can I extend the access period?

        Yes, you can extend the access period by paying an additional fee. Please raise a request via our Help and Support portal.

      • Where and how can I access the e-learning content? Are there any limitations?

        Once you register with us for a course by paying the course fee, you can have 24/7 access to the e-learning content on our website. An automated course purchase confirmation mail from our side will guide you through the process.

      • I am not able to access the online course. Whom should I contact for a solution?

        Please raise a request via our Help and Support portal to have your issue resolved.

      • I want to know more about the training program. Whom do I contact?

        Please join our Live Chat for instant support, call us, or Request a Call Back to have your query resolved.

          • Disclaimer
          • PMP, PMI, PMBOK, CAPM, PgMP, PfMP, ACP, PBA, RMP, SP, and OPM3 are registered marks of the Project Management Institute, Inc.