How to install Kafka on Windows

In this article, we will learn how to install Kafka on Windows. There are a couple of options to install Kafka on Windows. One way is we can install docker on windows and then run the container of Kafka in that docker. We will be installing the standalone version of Kafka on Windows.

First, we need JRE (Java Runtime Environment) for running the Kafka server. You can check How to Install Java on Windows. If you have JRE already installed we can proceed.

Zookeeper Installation:

We need a Zookeeper server running to run Kafka. We will see why do we need Zookeeper in the next few articles on Kafka. The following are steps to install Zookeeper on windows.

  1. Download Apache Zookeeper. You can use this link.
  2. Extract downloaded Zookeeper files and rename that folder to Zookeeper (remove the version number from folder name). Keep that folder on location like C drive.
  3. Go to Zookeeper config directory that is “C:/Zookeeper/conf”
  4. Rename file “zoo_sample.cfg” to “zoo.cfg”
  5. We need to change dataDir in conf file. Open conf file in some editor like notepad++ or sublime text. Find dataDir and replace it with “dataDir=C:\zookeeper\data” (without quotes)
  6. Now we need to add Zookeeper to system environment variables. You can open that from Control Panel -> System -> Advanced System Settings ->Environmentt Variables
    1. In user variable, click on New then enter  ZOOKEEPER_HOME as variable name and value as “C:/Zookeeper”.
    2. Edit System variable named Path. Click on new and add “%ZOOKEEPER_HOME%\bin” as a new variable to the path.
  7. Open a new command prompt and type zkserver.  Zookeeper runs on port number 2181 by default. You can change that in conf file.
Zookeeper server output in shell

If you see output like this then Zookeeper is running successfully on your windows machine!!

Kafka Configuration:

  1. Download the latest version of Kafka from here.
  2. Extract downloaded the file to a directory named Kafka and move that directory to some location like C drive.
  3. Go to the Kafka config directory. “C:\kafka\config”
  4. Edit server.properties file and find log.dirs and change that to “log.dirs=C:\kafka\config\kafka-logs”
  5. After that Kafka will run on port number 9092 by default.

Running Kafka Server:

  1. Make sure that Zookeeper server is running on your machine.
  2. Open another command prompt and type command                                                                                                      C:\>.\kafka\bin\windows\kafka-server-start.bat .\kafka\config\server.properties
  3. If everything is configured correctly you will see the following output
Kafka server output when running in shell

Now your Kafka server is running on port number 9092. Let us validate this by listing topics present in the Kafka server. Open another terminal and write following command

C:\>kafka\bin\windows\kafka-topics.bat –zookeeper localhost:2181 –list

You will see output like this

checking Kafka topics in server

If you get output like this you are all set. Kafka is configured on your machine. In the next articles, we will learn more about Kafka in detail.

Similar Posts

Leave a Reply to Prithvi Cancel reply

Your email address will not be published.

2 Comments