Monitoring Kubernetes - Metrics and Log Forwarding
Overview
Details
Application features:
- Overview of hosts, workloads/pods/containers/processes;
- Diagnostics capabilities (allocation and security review);
- ACL based on Kubernetes namespaces/workloads/pods.
Logs:
- Container logs enriched with Kubernetes metadata;
- Application logs;
- Host logs;
- Multi-line logs;
- Flexible field extraction;
- At least once logs delivery guarantee;
Metrics:
- Metrics are correlated with Logs;
- Host/Pods/Container/Process Metrics;
- Prometheus metrics, control plane metrics (etcd cluster, api servers, controllers, schedulers, kubelets)
Events:
- Kubernetes events;
Easy-to-deploy solution.
The application requires Collector built by Outcold Solutions, see https://www.outcoldsolutions.com/docs/monitoring-kubernetes/
The application is provided under Evaluation License.
Monitoring Kubernetes is a solution for monitoring Kubernetes clusters in Splunk Enterprise and Splunk Cloud. We provide a collector, explicitly built for Kubernetes, that forwards data from the clusters to Splunk software. We created dashboards that allow you to monitor your containerized applications and clusters in Splunk Enterprise or Splunk Cloud.
Product Benefits
- Built for Kubernetes. Outcold Solutions provides ready-to-use deployments, which helps you start monitoring your clusters in under 10 minutes.
- Diagnose performance of your applications using pre-built Splunk Certified Application.
- Leverage Splunk Users and Roles Control Access to set up project or cluster level ACL.
Use Cases
- Application Monitoring: see detailed metrics from containers and processes, including performance metrics, utilization metrics, and security insights. Use prebuilt Splunk dashboards for a comprehensive overview.
- Log Aggregation: aggregate logs from containers, applications, and servers in Splunk Enterprise or Splunk Cloud. Use flexible mappings for filtering logs enriched with container metadata, correlate logs with metrics, and leverage Splunk capabilities for analyzing logs.
- Cluster Health monitoring: diagnose issues with the clusters by looking at historical events and monitoring allocations and cluster capacity.
Application features
- Overview of hosts, workloads/pods/containers/processes;
- Diagnostics capabilities (allocation and security review);
- ACL based on Kubernetes namespaces/workloads/pods.
Logs
- Container logs enriched with Kubernetes metadata;
- Host logs;
- Multi-line logs;
- Flexible field extraction;
- At least once logs delivery guarantee;
Metrics
- Metrics are correlated with Logs;
- Host/Pods/Container/Process Metrics;
- Prometheus metrics, control plane metrics (etcd cluster, api servers, controllers, schedulers, kubelets)
Events
- Kubernetes events;
Easy to deploy solution.
Application requires Collector built by Outcold Solutions, see documentation
Application is provided under Evaluation License.
Release Notes
Version 5.2.176
5.2 - 2018-10-15
--------------------------------------------------------------------------------
Requires collectorforkubernetes version 5.2 or above (see https://www.outcoldsolutions.com for latest configuration)
- New: Review/Storage dashboard based on storage metrics and PVC metrics.
- New: predefined alerts to help you monitor the health of the clusters and performance of the applications.
- Fixed: Performance improvements
...
For details https://www.outcoldsolutions.com/docs/monitoring-kubernetes/release-history/
Version 5.1.175
- New: Network metrics (MB, Packets, Drops, and Errors) for host and containers.
- New: Network socket tables (list of the port that containers and hosts are listening on, connections to external resources).
- New: Network review dashboard to see the list of connection to public services and in private network.
- Improvement: Replace python-based lookup with a macro written with eval.
- Improvement: Visual improvement for showing when the object was Last Seen (highlighting and showing minutes ago).
... and more
https://www.outcoldsolutions.com/docs/monitoring-kubernetes/release-history/
Version 5.0.174
Highlights:
- Application logs
- Annotations for fields extraction, hiding sensitive information, time extraction, redirecting to /dev/null, stripping terminal colors and more
For more details:
https://www.outcoldsolutions.com/docs/monitoring-kubernetes/release-history/
Version 4.0.24
- New dashboard: Cluster/Audit
- New dashboard: Cluster/Kubernetes API Server
- New dashboard: Cluster/Kubelet
- New dashboard: Cluster/etcd
- New dashboard: Cluster/Scheduler
- New dashboard: Cluster/Controller Manager.
- Include image name, when list containers.
- Added syslog component to the list of host logs.
- Fixed: Include Daemon Set on Overview dashboard, list of namespaces.
Version 3.0.23
3.0.23 - bug fixes release
3.0.22
New overview, security and capacity dashboards. Workload aggregation dashboard.
A lot of of bug fixes and performance improvements.
Relese Notes: https://www.outcoldsolutions.com/docs/monitoring-kubernetes/release-history/#30-2018-02-07
Upgrade instructions: https://www.outcoldsolutions.com/docs/monitoring-kubernetes/upgrade-2-to-3/
Requires collectorforkubernetes version 3.0 or above (see https://www.outcoldsolutions.com for latest configuration)
Version 3.0.22
New overview, security and capacity dashboards. Workload aggregation dashboard.
A lot of of bug fixes and performance improvements.
Relese Notes: https://www.outcoldsolutions.com/docs/monitoring-kubernetes/release-history/#30-2018-02-07
Upgrade instructions: https://www.outcoldsolutions.com/docs/monitoring-kubernetes/upgrade-2-to-3/
Requires collectorforkubernetes version 3.0 or above (see https://www.outcoldsolutions.com for latest configuration)
Version 2.1.21
2.1.21 - 2018-01-02
--------------------------------------------------------------------------------
Requires collectorforkubernetes version 2.1.59.171209 or above
- Updated author and description
2.1.20 - 2017-12-09
--------------------------------------------------------------------------------
- Fixed link to setup / installation instructions.
2.1.18 - 2017-12-09
--------------------------------------------------------------------------------
- Implemented collectors dashboard to track number of collectors, their versions
and used licenses.
- Fallback to the process IO statistics when blkio is not available.
- Fix IO statistic graphs, showed average, when sum should be used.
- Fields extraction support for nginx ingress 0.9 and above.
- [collector] Improved resistance for storage failures.
- [collector] License checks reporting.
- [collector] Better support for openshift environment (default configuration).
Version 2.1.20
2.1.20 - 2017-12-09
--------------------------------------------------------------------------------
Requires collectorforkubernetes version 2.1.59.171209 or above
- Fixed link to setup / installation instructions.
2.1.18 - 2017-12-09
--------------------------------------------------------------------------------
Requires collectorforkubernetes version 2.1.59.171209 or above
- Implemented collectors dashboard to track number of collectors, their versions
and used licenses.
- Fallback to the process IO statistics when blkio is not available.
- Fix IO statistic graphs, showed average, when sum should be used.
- Fields extraction support for nginx ingress 0.9 and above.
- [collector] Improved resistance for storage failures.
- [collector] License checks reporting.
- [collector] Better support for openshift environment (default configuration).
Version 2.0.17
2.0 - 2017-10-22
--------------------------------------------------------------------------------
Requires collectorforkubernetes version 2.0.37.171023 or above
- Better labels support in Dashboards.
Collector has a breaking feature, replacing format for labels from
`kubernetes_node_labels_LABEL1=VALUE1` to `kubernetes_node_labels=[LABEL1=VALUE1,LABEL2=VALUE2]`.
- Process level metrics.
- Uptime for hosts and processes.
- Fields extraction for kubernetes controller manager and scheduler.
- Fields extraction and support in dashboards for main kubernetes components (setup
host logs collection with collector).
- New top-like dashboards allow to monitor Hosts/Pods/Containers/Processes in realtime.
- Rewritten Kubernetes Objects Dashboards with support of Events and Labels.
- Improved dashboards navigation.
- Support for host logs.
- Other bugs and improvements based on user feedback.
Version 1.0.3
Updated links to official documentation for installation instructions.
Version 1.0.2
Fix labels on Kubernetes Dashboards (Most of the filters has incorrect label Daemon Sets)
Version 1.0.1
Monitoring Kubernetes