25 Jan 2019 Read in about 3 min
Stream Reactor, the largest open-source collection of Apache Kafka connectors, has released today with many new features, bug fixes and new connectors for Apache Hive!
Version 1.2.1 for Kafka Connect 2.1.0
A big thank you goes to the community who contributed to this release, not only with raising issues, but also with talking with the community and raising multiple pull requests (PRs). Lets have a closer look at some of the changes:
Stream Reactor is an
Apache License, Version 2.0 open source collection of components built on top of Kafka and
provides Kafka Connect compatible connectors to move data between Kafka and popular data stores. Stream Reactor
source connectors to publish data into Kafka and
sink connectors to bring data from Kafka into other
systems. The connectors support KCQL (Kafka Connect Query Language),
an open source component of Lenses SQL Engine
that provides an elegant and simple SQL like syntax for selecting fields and routing
from sources or topics to Kafka or the target system (topic to target entity mapping,
field selection, auto creation, auto evolution, error policies).
We hope you find Stream Reactor useful, and want to give it a try! Stream Reactor has over 25 connectors available, tested and documented, supporting Kafka 2.1.0, you can give it a go by downloading Lenses Development Environment or find the jars on GitHub, or even build the code locally and help us improve and add even more connectors.
The new Hive source and sink build further on our list of supported connectors allowing data pipelines so be constructed quickly and easily end to end with SQL. The Connectors support included:
These features are integrated into KCQL, our connector SQL, simplifying configuration and keep config bloat to a minimum.
HDFS is often used a persistent store, but sometimes you need to reload to replay data. The Hive source now makes this possible.
Follow us on Twitter @lensesio, For tech talk, join our Slack community channel to talk with the community. If you find problems or have ideas on how we can improve Stream Reactor, please let us know or log an issue.
Did you like this article?
Industrialize your Kafka with Lenses