icon/x Created with Sketch.

Splunk Cookie Policy

We use our own and third-party cookies to provide you with a great online experience. We also use these cookies to improve our products and services, support our marketing campaigns, and advertise to you on our website and other websites. Some cookies may continue to collect information after you have left our website. Learn more (including how to update your settings) here.
Accept Cookie Policy

Accept License Agreements

This app is provided by a third party and your right to use the app is in accordance with the license provided by that third-party licensor. Splunk is not responsible for any third-party apps and does not provide any warranty or support. If you have any questions, complaints or claims with respect to this app, please contact the licensor directly.

Thank You

Downloading Kafka Smart Monitoring
SHA256 checksum (kafka-smart-monitoring_1125.tgz) 13fbbaf02f637620a4c8a31c2831710eabbcbddad086fb5675dc205a8babefd0 SHA256 checksum (kafka-smart-monitoring_1124.tgz) 115648e3920532032f68b6a5db02ac20476e76af860af82b63b92f016cba9b13 SHA256 checksum (kafka-smart-monitoring_1123.tgz) 0c90078b9621d72f70ce589840b6f7b33f8bc413762a102ccc9c549bc5337d9d SHA256 checksum (kafka-smart-monitoring_1122.tgz) f08d554b4a62964562843ed4699b93a15b5471566ad98465584be33433be9b4b SHA256 checksum (kafka-smart-monitoring_1121.tgz) a4caa2a6cad5ba0a0e4ff77531fb7734e189528f13077fd2383d54d29be54c1a SHA256 checksum (kafka-smart-monitoring_1120.tgz) 1c5d671c0a343460793b79a7d817f06babf30c51c3fea804b096d5e4cbb0962f SHA256 checksum (kafka-smart-monitoring_1119.tgz) d92865e1288b73f2e6786c4b81eafb366c91a98892fb6705153e64005ca469f9 SHA256 checksum (kafka-smart-monitoring_1118.tgz) 14c2d11928f6a994518f8dfdfbe1fac72d404dbc453ad11df20a19e0676a9fe9 SHA256 checksum (kafka-smart-monitoring_1117.tgz) e228ee0ca96e2394faa66efc00d9a720d996e617c4e12632fb8bd7f01d274891 SHA256 checksum (kafka-smart-monitoring_1116.tgz) 0cf7049cb2cffc44ecaa0ac570f1e60cfb55e3cfa51f38573e9e315a8e1a34a1 SHA256 checksum (kafka-smart-monitoring_1115.tgz) ebb70d4aa44d966c330283c1d3ab1a6d25aa87f64ba897552415c980429c331f SHA256 checksum (kafka-smart-monitoring_1114.tgz) 94317b9ac31afd81e92f5b1cb3618aaa8e1874d876131c95cdcbc113b88f4e55 SHA256 checksum (kafka-smart-monitoring_1113.tgz) eb58eb8ee9d91632e00fbd33427ad0dea82f9df4a775fed5a76dd0c104c9d446 SHA256 checksum (kafka-smart-monitoring_1112.tgz) 0f7de933d96b26272f8e8c035325ee432f1f1135a376ff214513adc94418f059 SHA256 checksum (kafka-smart-monitoring_1111.tgz) c0aa3791619a12f24373b00f8e24a6f554d7abb9a67581416f89ea5199ec5db0 SHA256 checksum (kafka-smart-monitoring_1110.tgz) 9431950a67669cc169f47880d1cfcf88ddef9401e176fd9eaadbd5a1c8e02c10 SHA256 checksum (kafka-smart-monitoring_119.tgz) 5f63e22b1e22f136428fbb2b8787dc84bd76fd9b2922945f54978db10875aa53 SHA256 checksum (kafka-smart-monitoring_118.tgz) 0d72219516cf14426365abf3482b0cb0ba2c3a2e9ef44d0bc8d5500efef95f01 SHA256 checksum (kafka-smart-monitoring_117.tgz) 7f0c5ec15c615dc251451b9db20b0f24d35df51e712d2323664361ffe202ac13 SHA256 checksum (kafka-smart-monitoring_116.tgz) a2509be3d39188c58c1e3ba6c9f1da0462fae0366cb69127bbc975e928dd5318 SHA256 checksum (kafka-smart-monitoring_115.tgz) cf5cd65edb4590d06b4781427256e267c064adf6164f5fe66d5459241c38382a SHA256 checksum (kafka-smart-monitoring_114.tgz) ef1b89597e0c3188053e85f20c8f92ff28ff0b1eafd8059dfee766d34cf34c8b SHA256 checksum (kafka-smart-monitoring_113.tgz) 64a990270b285bce6cbbdd3abe8ff54f76fc9c325aeb2f599d633bcbed245810 SHA256 checksum (kafka-smart-monitoring_112.tgz) 536fcc3c17c9925c7955755fce84d4bef5f58f0d6961efcb217b7a55c350cbef SHA256 checksum (kafka-smart-monitoring_111.tgz) 0e53c1daea993d93e094e5da1c61254d62bd719538665b4d458bf7646263b07c SHA256 checksum (kafka-smart-monitoring_110.tgz) a206c5831a3933f0ac08fcc533ee79bb39dbbcc118956d5420039718f7aa99ba SHA256 checksum (kafka-smart-monitoring_1012.tgz) 03016f1a9754de8836de1f63cbb12e256bc8b05205c90c1ba693776e39a697a2 SHA256 checksum (kafka-smart-monitoring_1011.tgz) 92f969fd5686b90ccfa2e69e7e11754fc8470cd34f9a39da1fd096837b9636ab SHA256 checksum (kafka-smart-monitoring_109.tgz) e868ce2f6a998c5861de1c27199d114209fb678a6fab3e9efc2319b0b1f80d4e SHA256 checksum (kafka-smart-monitoring_108.tgz) 10fa1f2e6c32fbdf184cd8692d47f4b34eb3330a7506a5fb7e864d3b664ad56f SHA256 checksum (kafka-smart-monitoring_107.tgz) 0fa02254128d1162996511273f1fcc790e78c3a13a3820a617d40adc2724799f SHA256 checksum (kafka-smart-monitoring_106.tgz) 533be5e1a48ca0fb709cb3d56fcb077646d062f94e43d5d4c0f21ff3f2a8a2f5 SHA256 checksum (kafka-smart-monitoring_105.tgz) 5689cf2860a314a667f57e6d07658556299c5588bc9cbdef3a9842e60280dcde SHA256 checksum (kafka-smart-monitoring_104.tgz) 0f6dccd8cb0c205a00f90d7b1a27fa49614a0bd3752bafabb483703cab6dab23 SHA256 checksum (kafka-smart-monitoring_103.tgz) 91face92b967c09d3927d895a634913ebf3e74dfd4ad7e9cdfb5d5208aecee79 SHA256 checksum (kafka-smart-monitoring_102.tgz) 7a4e38ba3bbdc7c13a8b420950695633d5020507b23d68407978c3adb90ccfc3 SHA256 checksum (kafka-smart-monitoring_101.tgz) b92e7194eeb94a789d169ccbb9024288636c9d2cbca9ebfd8c79bccde05df687 SHA256 checksum (kafka-smart-monitoring_100.tgz) ead31a2440ff4419274da434be4b5f0f43bfc2d47a13cd959e62793f9c711b35
To install your download
For instructions specific to your download, click the Details tab after closing this window.

Flag As Inappropriate

Kafka Smart Monitoring

Splunk AppInspect Passed
Overview
Details
The Splunk applicaton for Kafka monitoring with Telegraf leverages the best components to provide monitoring, alerting and reporting on top of Splunk and the high performance metric store.

READ THE UNIFIED GUIDE FOR KAFKA MONITORING: https://splunk-guide-for-kafka-monitoring.readthedocs.io

Review on-line documentation: https://telegraf-kafka.readthedocs.io
TA for events logging: https://splunkbase.splunk.com/app/4302
ITSI module : https://da-itsi-telegraf-kafka.readthedocs.io

The application provides builtin and native monitoring for Apache Kafka components, as well as the Confluent stack components:

- Zookeeper
- Apache Kafka Brokers
- Apache Kafka Connect
- Confluent schema-registry
- Confluent ksql-server
- Confluent kafka-rest
- Kafka SLA and end to end monitoring with the Linkedin Kafka monitor
- Kafka Consumers lag monitoring with Burrow (Kafka Connect connectors, Kafka Streams, etc.)

Multi-tenancy is fully supported by the application, relying on metrics tags support.

Out of the box alerting framework with management user interface provides easy and performer integration with Splunk.

Docker testing template, get an environment for lab and demonstration up and ready in 30 seconds !
https://github.com/guilhemmarchand/kafka-docker-splunk

READ THE UNIFIED GUIDE FOR KAFKA MONITORING: https://splunk-guide-for-kafka-monitoring.readthedocs.io

Install and configure events logging: https://splunkbase.splunk.com/app/4302

Documentation: https://telegraf-kafka.readthedocs.io

Github repository: https://github.com/guilhemmarchand/telegraf-kafka

ITSI module for Kafka Telegraf smart monitoring:
https://splunkbase.splunk.com/app/4261

ITSI module Flickr Gallery: https://flic.kr/s/aHsmkAJT9d

Docker testing template, get an environment up and ready in 30 seconds !
https://github.com/guilhemmarchand/kafka-docker-splunk

Release Notes

Version 1.1.25
May 20, 2019

Version 1.1.25

- fix: Regression introduced in version 1.1.21 impacts the Kafka Connect tasks inventory if a task is inactive or removed for a long period
- fix: Incorrect number of connectors reported in Alerting managing interface if connectors have the same names across environments

Version 1.1.24
May 18, 2019

Version 1.1.24

- feature: Introducing logs mapping macros used in entity views to provide customization capabilities for logs integration

Version 1.1.23
May 17, 2019

Version 1.1.23

- fix: Missing env/label filters in entity views impact results if multiple env/label and ANY selected

Version 1.1.22
May 11, 2019

Version 1.1.22

- fix: Improves searches for Connected experience dashboard for Kafka Connect (listing connectors in alert)
- fix: Improves Telegraf configuration generator modal window rendering and adds link button to documentation
- fix: Missing env / label filtering in show tasks in alert button from Overview
- feature: Add dynamic view inclusion in menu for Connected Experience custom dashboards

Version 1.1.21
May 9, 2019

Version 1.1.21

- feature: Introduction of the Telegraf configuration generator, a guided user interface that generates the telegraf.conf configuration files depending on your requirements
- feature: Adding new Audit menu with builtin Audit dashboard for scheduled performance and daily volume indexing analysis
- feature: Use bootstrap buttons in Overview rather than custom buttons design
- feature: Adding active button in Overview to show Kafka Connect tasks in alert (tasks not reporting)
- feature: Adding drilldown from single in Overview / Kafka Connect health views for failed connectors / failed tasks
- feature: Store the last operational time of Kafka Connect connectors in the KVstore, update at inventory / alert run time, return when an alert triggers
- fix: Lag field missing in table from Splunk Connected experience Burrow dashboard due to typo

Version 1.1.20
April 28, 2019

Version 1.1.20

- fix: Remove any console.log (even while these are commented) in javascript to avoid manual check from appinspect
- fix: Static index reference in new Splunk Connected experience Kafka Connect dashboard
- fix: lag field name type in new Splunk Connected experience Burrow dashboard
- fix: Remove restart required after installation to allow installation in Splunk Cloud via Self-services (SSAI)
- feature: Adding Splunk Connected experience mobile dashboard for Zookeeper health

Version 1.1.19
April 28, 2019

Version 1.1.19

- fix: Static index reference in new Splunk Connected experience Kafka Connect dashboard
- fix: lag field name type in new Splunk Connected experience Burrow dashboard
- fix: Remove restart required after installation to allow installation in Splunk Cloud via Self-services (SSAI)
- feature: Adding Splunk Connected experience mobile dashboard for Zookeeper health

Version 1.1.18
April 22, 2019

Version 1.1.18

- feature: Introduction of the builtin kafka_admin role
- feature: Provides default kafka_admin role member write access to the application name space and the KVstore based lookup collections
- feature: Introduction of the Connected Experience dashboards, Health overview dashboards designed to be used with Splunk Connected Experience and Splunk Cloud Gateway (Splunk Mobile, Splunk TV)
- fix: Static indexes references in Kafka Connect and Kafka Burrow dashboards

Version 1.1.17
April 14, 2019

Version 1.1.17

- fix: Expose units for Zookeeper latency metrics in Overview and entity view
- feature: Introducing the smart component enablement, which allows enabling / disabling a Kafka component to be visible from the Overview, to be managed via the configuration user interface
- feature: Expose Zookeeper leader and Broker active controller in Overview dashboard when mono tenancy (environment) detected or selected
- feature: Configuration checker, detect incomplete installation (Kafka inventory not updated) when loading Overview, and provide modal update user interaction
- fix: Prevents multiple endpoint calls in Alerting User Interface management in Ajax

Version 1.1.16
April 4, 2019

Version 1.1.16

- feature: Spinner during update / rebuild of KVstore collections within the management of embedded alerting UI
- feature: Manage unprivileged user access to the UI, and proper error handling due to lack of permission against the KVstore collections
- fix: Improved handling of topics / connectors / consumers discovery reports
- feature: Kafka Brokers OOTB alerts and Kafka Connect connector or task startup failure detected are not linked to a monitoring_state that can be deactivated via the KVstore collections
- feature: Configuration error checker which verifies at overview loading page for unsupported tags in env/label such as white spaces.

Version 1.1.15
March 24, 2019

Version 1.1.15

feature: Major improvements of the user experience with the management of embedded alerting via modal contextual user interactions
feature: Maintenance mode is now time conditioned with an end of maintenance period requested via UI calendar during activation
feature: Migration to native modal windows for user interactions in the alerting management user interface (removal of bootbox js plugin)
feature: Default schedule change of the maintenance mode status verification report
feature: Request Splunk restart by default in app.conf
fix: Kafka Connect tasks that are paused do not properly affect the aggregated state single form in Overview
fix: Burrow task single form in Overview page results in appendcols related error in Overview page within Splunk 7.0.x
fix: Regression in Kafka Connect task listing for Splunk 7.0.x in PostProcess search due to append (introduced by 1.1.14)
fix: Regression in dynamic table overview for Kafka Connect status per task in Overview (introduced by 1.1.14)

Version 1.1.14
March 24, 2019

Version 1.1.14

- feature: Major improvements of the user experience with the management of embedded alerting via modal contextual user interactions
- feature: Maintenance mode is now time conditioned with an end of maintenance period requested via UI calendar during activation
- feature: Migration to native modal windows for user interactions in the alerting management user interface (removal of bootbox js plugin)
- feature: Default schedule change of the maintenance mode status verification report
- feature: Request Splunk restart by default in app.conf
- fix: Kafka Connect tasks that are paused do not properly affect the aggregated state single form in Overview
- fix: Add Kafka Connect tasks in the dynamic table tasks overview if the tasks are listed as monitored in the collection, and the tasks do not report metrics currently
-fix: Burrow task single form in Overview page results in appendcols related error in Overview page within Splunk 7.0.x

Version 1.1.13
March 16, 2019

Version 1.1.13

- fix: Static span is defined in Burrow detailed view charts
- fix: Prevents removed Burrow consumers to appear as low range when latest metrics available are part of the selected time range
- fix: Missing group by statement for Burrow consumers monitoring in OOTB alert, generates unexpected output containing OK consumers, while alerts are correctly justified for ERR consumers

Version 1.1.12
March 14, 2019

Version 1.1.12

- feature: Adding drilldown to single forms for Offline and Under-replicated partitions in Overview and Kafka Brokers entities views
- fix: ISR Shrinking missing env/label/broker filters in Kafka broker entity view
- feature: Better table rendering in Kafka broker entity view for Under-replicated partitions

Version 1.1.11
March 13, 2019

Version 1.1.11

- feature: Improvement of the Alerting framework management interface with tabs categorization, capability to update and reset collections on demand, alert activation summary, UI experience greatly improved
- fix: Prevent low range state for Kafka Connect tasks that were recently deleted in tasks overview
- fix: Improve Kafka Connect tasks table in Kafka Connect entity view
- fix: Pastel red color for under-replicated partitions in topics views
- fix: Properly order per topic/partitions in broker entity table view
- fix: Prevents a failing component that was unreachable for a long period to be entirely removed from the infrastructure collection, replaced by a disabled_autoforced monitoring_state value if downtime>24 hours
- fix: Preserve _key_id of KVstore collections during updates for kafka_infra_inventory / kafka_infra_nodes_inventory lookups

Version 1.1.10
March 9, 2019

Version 1.1.10

- fix: Static index references instead of macro usage in Kafka Connect entity view, Kafka Connect status report and drilldown links
- fix: Switch to dopdown selector for env/label in Overview to avoid multiselect issues with forwarding tokens to dashboards

Version 1.1.9
March 6, 2019

Version 1.1.9

- fix: Static index reference instead of macro usage in Kafka Connect report
- feature: Improvements of the Kafka Connect task status overview report
- feature: Add icon ranges and filters for Kafka Connect task status overview from Overview main dashboard, configure drilldown from table to entity views

Version 1.1.8
March 6, 2019

Version 1.1.8

- feature: Improvements of the Kafka Connect task status overview report
- feature: Add icon ranges and filters for Kafka Connect task status overview from Overview main dashboard, configure drilldown from table to entity views

Version 1.1.7
March 3, 2019

Version 1.1.7

- feature: Add input text filter for Consumers in UI Monitoring management
- fix: Non working filters for Consumers / partitions in UI Burrow
- feature: Map monitoring_state in Consumers status preview in Overview

Version 1.1.6
Feb. 26, 2019

Version 1.1.6

- fix: incompatibility for ksql-server with latest Confluent release (5.1.x) due to metric name changes in JMX model
- feature: avoid no results returned by single in Overview page for Burrow when no consumers are yet added to the monitored collection

Version 1.1.5

Burrow integration: Kafka Consumer Lag monitoring

Version 1.1.5
Feb. 26, 2019

Version 1.1.5

Burrow integration: Kafka Consumer Lag monitoring

- feature: Integration of Burrow, new Burrow consumer lag monitoring UIs
- feature: Management of Kafka consumers state within the alerting framework
- feature: Integration of Burrow consumers state within the Overview UI
- feature: Schedule Kvstore collection update reports (infra, topics, tasks, consumers) on a per 4 hours basis
- fix: Prevents user from attempting to disable maintenance mode when already disabled, and vice-versa
- fix: Properly sort Connect tasks statuses on Overview page to show Unknown status when tasks are missing but monitored

The Burrow integration provides advanced threshold less lag monitoring for Kafka Consumers, such as Kafka Connect connectors and Kafka Streams.

Version 1.1.4
Feb. 25, 2019

Version 1.1.4

Burrow integration: Kafka Consumer Lag monitoring

- feature: Integration of Burrow, new Burrow consumer lag monitoring UIs
- feature: Management of Kafka consumers state within the alerting framework
- feature: Integration of Burrow consumers state within the Overview UI
- feature: Schedule Kvstore collection update reports (infra, topics, tasks, consumers) on a per 4 hours basis
- fix: Prevents user from attempting to disable maintenance mode when already disabled, and vice-versa

The Burrow integration provides advanced threshold less lag monitoring for Kafka Consumers, such as Kafka Connect connectors and Kafka Streams.

Version 1.1.3
Feb. 21, 2019

Version 1.1.3:

- fix: Properly order partitions in new Brokers detailed UI
- fix: Allows selection of special topics in entity topic view
- feature: New Brokers/Brokers details, Topics/Topics details UIs inspired from Yahoo kafka-manager
- feature: Allows environment and label selection from Overview, propagates tokens across all UIs
- fix: Incorrect number of partitions reported within Brokers entity view when multiple Brokers are selected

Version 1.1.2
Feb. 21, 2019

Version 1.1.2:

- feature: New Brokers/Brokers details, Topics/Topics details UIs inspired from Yahoo kafka-manager
- feature: Allows environment and label selection from Overview, propagates tokens across all UIs
- fix: Incorrect number of partitions reported within Brokers entity view when multiple Brokers are selected

Version 1.1.1
Jan. 16, 2019

Version 1.1.1
CAUTION: Breaking changes, telegraf modification is required to provide global tags for env and label dimensions!

https://da-itsi-telegraf-kafka.readthedocs.io/en/latest/kafka_monitoring.html#telegraf-output-configuration

Upgrade path:
Upgrade telegraf configuration to provide the env and label tags
Upgrade the application

Features/fixes:
feature: Multi-environment / Multi-dc support via env and label tagging at Telegraf metric level, allows embedded management of any number of environment and/or additional sub-dividing notion (multi-env, multi-dc…)
feature: New kvstore collection to allow monitoring of services in a container environment philosophy based on the number of active nodes per role rather than their identity
feature: Update of the Alerting Management User Interface
feature: New OOTB Alerting based on active nodes numbers per role
feature: Refreshed Overview page with layers icons, additional o...

Version 1.1.0
Jan. 16, 2019

Version 1.1.0

CAUTION: Breaking changes, telegraf modification is required to provide global tags for env and label dimensions!
https://da-itsi-telegraf-kafka.readthedocs.io/en/latest/kafka_monitoring.html#telegraf-output-configuration

Upgrade path:

Upgrade telegraf configuration to provide the env and label tags
Upgrade the application
Features/fixes:

feature: Multi-environment / Multi-dc support via env and label tagging at Telegraf metric level, allows embedded management of any number of environment and/or additional sub-dividing notion (multi-env, multi-dc…)
feature: New kvstore collection to allow monitoring of services in a container environment philosophy based on the number of active nodes per role rather than their identity
feature: Update of the Alerting Management User Interface
feature: New OOTB Alerting based on active nodes numbers per role
feature: Refreshed Overview page with layers icons, additional overview in page views
feature: New applications icons
fix: Various fixes and improvement

Version 1.0.12
Jan. 2, 2019

Version 1.0.12
- fix: Improve detection of Kafka Connect tasks not successfully running on the Overview page
- fix: Drilldown on single forms for Kafka Connect tasks

Version 1.0.11
Dec. 5, 2018

Version 1.0.11
- fix: Management interface toggle panels not working (bad reference in js)
- fix: Management interface disable maintenance button not showing up properly in Splunk 7.0.x
- fix: Preset a default value for maintenance mode status
- fix: share lookups, transforms and macros at system level by default

Version 1.0.9
Dec. 5, 2018

Version 1.0.9
- feature: Added OOTB Alert for under-replicated partitions per topics
- feature: Management interface for embedded Kafka alerting
- feature: Enabling / Deactivating maintenance mode through UI for alerting management

Version 1.0.8
Dec. 3, 2018

Version 1.0.8
- feature: Out of the box alerting templates for Kafka infrastructure
- fix: Kafka Connect aggregated states issues in Overview page

Version 1.0.7
Nov. 26, 2018

Version 1.0.7:
- fix: minor fixes and improvements in views
- feature: Support for Confluent ksql-server
- feature: Support for Confluent kafka-rest
- feature: Overview home page improvements and fixes
- feature: event logging integration with the TA-kafka-streaming-platform

Version 1.0.6
Nov. 16, 2018

Version 1.0.6:
- fix: Typo in Overview

Version 1.0.5
Nov. 11, 2018

Version 1.0.5:
- feature: Confluent schema-registry support

Version 1.0.4
Nov. 7, 2018

Version 1.0.4:
- fix: inverted filters for source/task in Overview
- fix: dropdown replaced by multiselect and key per connector/task in source/sink views

Version 1.0.3
Nov. 2, 2018

Version 1.0.3:
- fix: Overview page, link for topic management should be under brokers category

Version 1.0.2
Oct. 26, 2018

Version 1.0.2:
- various: logo update

Version 1.0.1
Oct. 26, 2018

Version 1.0.1
- fix: missing link for Kafka topics reporting

Version 1.0.0
Oct. 26, 2018

Version 1.0.0:
- initial and first public release

72
Installs
358
Downloads
Share Subscribe LOGIN TO DOWNLOAD

Subscribe Share

AppInspect Tooling

Splunk AppInspect evaluates Splunk apps against a set of Splunk-defined criteria to assess the validity and security of an app package and components.

Are you a developer?

As a Splunkbase app developer, you will have access to all Splunk development resources and receive a 50GB license to build an app that will help solve use cases for customers all over the world. Splunkbase has 1000+ apps and add-ons from Splunk, our partners and our community. Find an app or add-on for most any data source and user need, or simply create your own with help from our developer portal.

Follow Us:
© 2005-2019 Splunk Inc. All rights reserved.
Splunk®, Splunk>®, Listen to Your Data®, The Engine for Machine Data®, Hunk®, Splunk Cloud™, Splunk Light™, SPL™ and Splunk MINT™ are trademarks and registered trademarks of Splunk Inc. in the United States and other countries. All other brand names, product names, or trademarks belong to their respective owners.