Kafka to Kudu connector
Accelerate your Kafka to Kudu streaming with a Kafka compatible connector via Lenses UI/ CLI, Native plugin or Helm charts for Kubernetes deployments
About the Kafka to Kudu connector
License Apache 2.0
A Connector and Sink to write events from Kafka to Kudu. The connector takes the value from the Kafka Connect SinkRecords and inserts a new entry to Kudu. This is an open-source project and so isn't available with Lenses support SLAs.
Connector options for Kafka to Kudu streaming
Docker to test the connector
Test in our pre-configured Lenses & Kafka sandbox packed with connectors
Use Lenses with your Kafka
Manage the connector in Lenses against your Kafka and data.
Or Kafka to Kudu GitHub Connector
Download the connector the usual way from GitHub
Connector benefits
- Flexible Deployment
- Powerful Integration Syntax
- Monitoring & Alerting
- Integrate with your GitOps
Why use Lenses.io to read data from Kafka to Kudu?
This connector saves you from learning terminal commands and endless back-and-forths connecting Kafka to Kudu by managing the Kudu stream reactor connector (and all your other connectors on your Kafka Connect Cluster) through Lenses.io. This lets you freely monitor, process and deploy data with the following features:
- Error handling
- Fine-grained permissions
- Data observability
How to set up your Kafka to Kudu data pipeline
Make sure you have:
- Apache Kafka 0.11.x of above
- Kafka Connect 0.11.x or above
- Kudu 0.8 or above
- Java 1.8
Features
- The KCQL routing querying - Kafka topic payload field selection is supported, allowing you to select fields written to Kudu.
- Error policies for handling failures.
- Auto creation of tables.
- Auto evolution of tables.