Why deploying streaming apps on Kubernetes is now a no-brainer

Why you should deploy your streaming applications on Kubernetes and how (with the help of Lenses) it can be as easy as pie

Adil Hussain
By Adil Hussain
Mar 25, 2020
Why deploying streaming apps on Kubernetes is now a no-brainer

We get it. Building streaming applications isn’t easy and they come with their own wave of challenges:

  • Data privacy and integrity - ensuring data is only accessible to those with the right permissions

  • Building for scale and being prepared for changing workloads

  • Factoring in ease of operations

  • Alerting….the last thing you want is for all to go haywire while you’re making a Peanut butter and jelly sandwich and not be aware of it. 

In recent times Apache Kafka with Kubernetes has become the go-to platform for running containerised real time data workloads - it lets us deploy and manage individual distributed real time applications and services like no other. 

But wait! I know what you’re thinking, “streaming applications need the coordinated deployment of different moving parts such as topics, storage, and app runtimes … all working in unison.” So how can Kubernetes manage this?

While it can require some extra work, the main advantage of having your streaming applications on Kubernetes is that it offers built-in high availability and failover by design - providing you the availability of service you require - even during software rollouts and other maintenance tasks. 

Kubernetes also offers great scaling capabilities as developers build their applications in microservices, which means that they can be scaled easily independently.

Now it’s no secret that developing applications for Kubernetes has challenges. For example, Kubernetes is complex to deploy on, so you really need to know your 💩. And your application must be architected according to the Kubernetes way of working.

Perhaps that’s where we can help? 👋

With Lenses you can build real time data applications without even being a developer using SQL (SQL Processors as we call them) and deploy them over your Kubernetes environment. Just like Siri, Lenses & Kubernetes makes it look easy. Behind the scenes, Lenses builds an application and sends it to Kubernetes which takes care of running the complex operations of working out what machines to best run on and scaling - whilst being highly available.

kafka and kubernetes architecture for deploying streaming sql applications with lenses.io

But rather than being a black box, Lenses gives you an instant feedback loop so you can see that the application has been deployed, what data it’s processing and what other applications are processing data off it.

So thanks to a little bit of magic from your Lenses - deploying your streaming applications on Kubernetes is quickly becoming a no-brainer.

Check out Lenses for yourself with a free download by clicking here

P.s. did I mention that Lenses integrates into Slack, PagerDuty, DataDog and most tools you use for alerting? So you can have peace of mind when you enjoy your next peanut butter and jelly sandwich. 

Ready to get started with Lenses?

Try now for free