Stream to Aerospike from Apache Pulsar

You can stream data from Apache Pulsar to Aerospike Database Enterprise Edition by using the Aerospike Pulsar inbound connector. The connector translates messages from Pulsar into Aerospike records, and then performs the corresponding inserts, updates, and deletes in an Aerospike database. The database then acknowledges records that have been written successfully.

Note

The Aerospike Pulsar inbound connector supports Pulsar topics that implement Pulsar’s struct schema. For information about this schema, see Understand schema in the Pulsar documentation.

This connector is implemented as a sink connector in the open-source Pulsar IO framework, and runs as a Pulsar Function. An instance of the connector persists data to a single Aerospike database.

You can also write custom code to manipulate Pulsar records before persisting them in Aerospike, performing operations on them that the connector does not support natively.

Note

There might be situations where records are re-ordered on the network or across Pulsar workers. In such cases, an older version of a record might overwrite a newer version of the record in Aerospike.