The tap-kafka Singer tap pulls data from the Apache Kafka that can then be sent to a destination using a Singer target.

Alternative variants

Multiple variants of tap-kafka are available. This document describes the default transferwise variant, which is recommended for new users.

Alternative variants are:

Standalone usage

Install the package using pip: 

pip install git+https://github.com/transferwise/pipelinewise-tap-kafka.git

For additional instructions, refer to the README in the repository.

Usage with Meltano

Install Meltano, create your Meltano project, and add the tap to your project as a custom extractor: 

meltano add --custom extractor tap-kafka

Then, configure the extractor, add any Singer target as a loader to send data to a destination and run a data integration (EL) pipeline.

Capabilities

Settings

Check the README in the repository for more information on settings for this tap.

Looking for help?

If you're having trouble getting tap-kafka to work by itself or with Meltano, look for an existing issue in its repository, file a new issue, or join the Meltano Slack community and ask for help in the #plugins-general channel.

Found an issue on this page?

This page is generated from a YAML file that you can contribute changes to! It is also validated against a JSON Schema used for taps and targets.