Apache Kafka

From ArchWiki

Apache Kafka is a distributed streaming platform that:

  1. Lets you publish and subscribe to streams of records. In this respect it is similar to a message queue or enterprise messaging system.
  2. Lets you store streams of records in a fault-tolerant way.
  3. Lets you process streams of records as they occur.

Installation

Install the kafka package.

Start kafka.service, which should also automatically start/enable zookeeper@kafka.service as well.

Confluent Platform

To use the Confluent Platform or Confluent Server, install the confluent-platformAUR package. confluent-platformAUR install the following services:

  • ksqlDB - confluent-ksqldb.service
  • Schema Registry - confluent-schema-registry.service
  • REST Proxy - confluent-kafka-rest.service
  • Confluent Control Center - confluent-control-center.service
  • Confluent Server - confluent-server.service

Usage

For usage see official documentation

Clients

For additional clients, see the official client list.