Apache Kafka: Difference between revisions

From ArchWiki
(→‎Installation: add link for enable and start)
(update Pkg/AUR templates)
 
(6 intermediate revisions by 4 users not shown)
Line 12: Line 12:
== Installation ==
== Installation ==


Install the {{AUR|kafka}} package.
Install the {{Pkg|kafka}} package.


Start {{ic|kafka.service}} with systemctl which should also automatically [[enable]]/[[start]] {{ic|zookeeper@kafka.service}} as well.
[[Start]] {{ic|kafka.service}}, which should also automatically [[start/enable]] {{ic|zookeeper@kafka.service}} as well.
 
== Confluent Platform ==
 
To use the Confluent Platform or Confluent Server, install the {{AUR|confluent-platform}} package.
{{AUR|confluent-platform}} install the following services:
 
* ksqlDB - {{ic|confluent-ksqldb.service}}
* Schema Registry - {{ic|confluent-schema-registry.service}}
* REST Proxy - {{ic|confluent-kafka-rest.service}}
* Confluent Control Center - {{ic|confluent-control-center.service}}
* Confluent Server - {{ic|confluent-server.service}}


== Usage ==
== Usage ==
Line 22: Line 33:
== Clients ==
== Clients ==


* C - {{AUR|librdkafka-git}}  
* C - {{AUR|librdkafka-git}}
* Python - https://github.com/dpkp/kafka-python  
* PHP - {{AUR|php-rdkafka}}
* Php - {{AUR|php-rdkafka}} 
* Perl - {{AUR|perl6-pkafka}}{{Broken package link|package not found}}
* Perl - {{AUR|perl6-pkafka}}
* Python - https://github.com/dpkp/kafka-python
* .Net - https://github.com/confluentinc/confluent-kafka-dotnet
* Go - https://github.com/confluentinc/confluent-kafka-go
 
For additional clients, see the [https://cwiki.apache.org/confluence/display/KAFKA/Clients official client list].

Latest revision as of 21:33, 28 February 2024

Apache Kafka is a distributed streaming platform that:

  1. Lets you publish and subscribe to streams of records. In this respect it is similar to a message queue or enterprise messaging system.
  2. Lets you store streams of records in a fault-tolerant way.
  3. Lets you process streams of records as they occur.

Installation

Install the kafka package.

Start kafka.service, which should also automatically start/enable zookeeper@kafka.service as well.

Confluent Platform

To use the Confluent Platform or Confluent Server, install the confluent-platformAUR package. confluent-platformAUR install the following services:

  • ksqlDB - confluent-ksqldb.service
  • Schema Registry - confluent-schema-registry.service
  • REST Proxy - confluent-kafka-rest.service
  • Confluent Control Center - confluent-control-center.service
  • Confluent Server - confluent-server.service

Usage

For usage see official documentation

Clients

For additional clients, see the official client list.