Install the Aerospike Kafka Source Connector

Kafka Platform Compatibility

The source connector is fully compatible with:

• Apache Kafka 2.x
• Confluent Platform 6.x

It has not been tested with Apache Kafka 3.x+ or Confluent Platform 7.x+.

Prerequisites

Aerospike Database change notification configuration

Note

Streaming from Aerospike requires you to configure your Aerospike database to send change notifications. For the steps, see Configuring Change Notification for Use with Connectors.

Deploying on Docker

Aerospike provides Docker images for the Aerospike Kafka source connector on Docker Hub.

sudo docker run \
 -v <path to local aerospike-kafka-outbound.yml>:/etc/aerospike-kafka-outbound/aerospike-kafka-outbound.yml \
 container.aerospike.com/aerospike/aerospike-kafka-outbound:5.3.11

<path to local aerospike-kafka-outbound.yml>: The path (including the name) of the configuration file in your local filesystem.

Installation prerequisites on Linux

Supported operating systems

The connector is supported on the following operating systems:

• RHEL/CentOS (8 and 9)
• Ubuntu (20.04, 22.04 and 24.04 LTS)
• Debian (11, 12 and 13)
• Amazon Linux 2023

Java Runtime Environment

This connector is a Java web-application that requires Java 11 or later. Both Oracle and OpenJDK Java Runtime Environments are supported.

Java 17 is supported starting with Aerospike Kafka source connector (outbound) version 4.1.0.

Installation

The installation steps below apply to both the Debian (*.deb) and RHEL (*.rpm) packages.

Install Java 11 or later version

The Aerospike Kafka source connector package does not include a Java runtime environment. Most supported platforms provide official JDK 11 packages. For platforms that do not, you can get Oracle’s JDK 11 builds from jdk.java.net/11/.

RHEL, CentOS, etc.

sudo yum install java-11-openjdk

Debian, Ubuntu, etc.

sudo apt-get install openjdk-11-jre

Amazon Linux etc.

sudo dnf install java-11-openjdk

Install connector package

Go to the Aerospike Enterprise downloads site to download the Aerospike Kafka source (outbound) connector package for your platform and install it.

RHEL, CentOS, etc.

sudo rpm -i aerospike-kafka-outbound-5.3.11-1.noarch.rpm

Debian, Ubuntu, etc.

sudo dpkg -i aerospike-kafka-outbound-5.3.11.all.deb

Amazon Linux

sudo rpm -i aerospike-kafka-outbound-5.3.11-1.noarch.rpm

Verify or update source connector configuration

The source connector’s configuration can be found in the /etc/aerospike-kafka-outbound/ directory. For details on how to configure the Kafka provider and enable TLS, see the configuration guide.

Start the source connector

The source connector package includes a Systemd service definition. The installation procedure creates an aerospike-kafka-outbound service.

Enable the source connector to start on system startup or reboot.

$ sudo systemctl enable aerospike-kafka-outbound

To start the source connector service run.

$ sudo systemctl start aerospike-kafka-outbound