Home Lenses

Kafka S3 connector for enterprise-grade data flows

Feature-packed, Apache 2 licensed, fully open-source and available with enterprise support.

Kafka to AWS S3

The most powerful Kafka S3 Connector out there

Amazon S3 is the de facto cloud storage solution, and a strategic component of any Apache Kafka running in AWS.

Built by the biggest contributors to open-source Kafka connectors, the Lenses Kafka S3 connector offers more flexibility and power to address S3 data integration challenges, whilst avoiding vendor-lock in.

What can you do with the Kafka to S3 connector?

Backup/Restore Kafka Topics

Backup/Restore Kafka Topics

Save on disaster recovery infrastructure costs by backing up data in S3.

Hydrate your Data Lake

Hydrate your Data Lake

Sink to S3 whilst optimizing for downstream analytics.

Simplify sourcing from S3

Simplify sourcing from S3

Source new, complex data sources such as XML.

Power event-driven apps & GenAI

Power event-driven apps & GenAI

Feed downstream event-driven apps with data sitting in S3.

Kafka S3 connector architecture

Kafka S3 connector architecture

Kafka with Amazon S3: Architecture & top use cases

An architecture pattern for sending data back and forth between Apache Kafka and Amazon S3, to address a range of use cases:

See the connector in action

Single-click backup/restore when managed through Lenses

Use the S3 connector paired with the Lenses Developer Experience for Kafka to backup/restore your Kafka topics with just a single click.

How to source XML files in Amazon S3 into a Kafka topic. Then query it with SQL.

XML data still exists, and it can be a pain to deal with. Here we demonstrate how to:
  • Deploy a Kafka source connector from Lenses
  • Pull in the XML data from Kafka
  • Download it to CSV

Kafka to S3 resources

S3 connector

BLOG

Mission critical data flows with the open-source

Lenses Kafka

connector for S3

Read blog
Data Capture and Kafka

BLOG

Single click

Kafka

topic backup

Read blog
Data Capture and Kafka

WEBINAR

Lenses 5.3 in

30 minutes

(new connector experience)