When it comes to kafka monitoring software and infrastructure, multiple systems are playing an important role.
Lenses does not try to be a time-series database. It integrates and enriches popular open source solutions, where
you can monitor in Prometheus and Grafana your whole platform, not just the middleware.
Domain knowledge, pre-built dashboard, agent configuration and curated templates highlighting 100's of critical KPIs are provided to all clients, so you can have the same monitoring capabilities that Fortune-100 companies are enjoying, setting up your project for production.
Data Flows for Kafka Cluster Monitoring
Every component of a data topology is recommended to have a single responsibility. At the same time
different characteristics are indicating whether this component is healthy and performing efficiently
Irrespective of the underlying data processing technology, complete visibility is a requirement. Metrics, logs, threshold alerts as well as detailed status of the distributed processing are visually highlighted, and presented for immediate action.
A 360-degree of the key metrics of your Apache Kafka cluster curated into a single template, allows time travel between the past 60 days (by default) for key metrics. Pro-actively receive alerts and notifications when your streaming platform is under pressure, prevent downtime before it occurs.
Lenses continuously monitors your Apache Kafka cluster and provides alerts and notifications for important metrics degradation, such as consumer lag and offline or under-replicated partitions. It does not strive to become a time-series database. Established solutions from domain experts already exist.
Lenses Apache Kafka Monitoring Suite (Kafka Monitoring Tool) is a set of pre-defined templates, that use:
Monitor your apps like a pro! Lenses provides in-app features to monitor your applications and apply alerts to never miss an SLA. Lenses ships with Apache Kafka specific dashboards in order to monitor your low level metrics.
Monitor your apps like a pro! Lenses provides in-app features to monitor your Kafka applications and apply alerts to never miss an SLA. Lenses ships with Apache Kafka specific dashboards in order to monitor your low level metrics.
Apart from monitoring the underlying infrastructure and application, it's also about monitoring how the data streaming platform on Apache Kafka and data are utilized. Lenses captures all events (configuration changes) as well as all data access patterns so that you can know who did what and when at any point in history.