Kubernetes kubelet

Metrics, Dashboards, Alerts and more for Kubernetes kubelet Integration in Sysdig Monitor.
Kubernetes kubelet

This integration is disabled by default. See Enable and Disable Integrations to enable it in your account.

This integration is out-of-the-box, so it doesn’t require any exporter.

This integration has 26 metrics.

List of Alerts

AlertDescriptionFormat
[k8s-kubelet] Kubelet Too Many PodsKubelet Too Many PodsPrometheus
[k8s-kubelet] Kubelet Pod Lifecycle Event Generator Duration HighKubelet Pod Lifecycle Event Generator Duration HighPrometheus
[k8s-kubelet] Kubelet Pod StartUp Latency HighKubelet Pod StartUp Latency HighPrometheus
[k8s-kubelet] Kubelet DownKubelet DownPrometheus

List of Dashboards

Kubernetes Kubelet

The dashboard provides information on the Kubernetes Kubelet. Kubernetes Kubelet

List of Metrics

Metric name
go_goroutines
go_info
kube_node_status_capacity_pods
kube_node_status_condition
kubelet_cgroup_manager_duration_seconds_bucket
kubelet_cgroup_manager_duration_seconds_count
kubelet_node_config_error
kubelet_pleg_relist_duration_seconds_bucket
kubelet_pleg_relist_interval_seconds_bucket
kubelet_pod_start_duration_seconds_bucket
kubelet_pod_start_duration_seconds_count
kubelet_pod_worker_duration_seconds_bucket
kubelet_pod_worker_duration_seconds_count
kubelet_running_containers
kubelet_running_pods
kubelet_runtime_operations_duration_seconds_bucket
kubelet_runtime_operations_errors_total
kubelet_runtime_operations_total
kubernetes_build_info
process_cpu_seconds_total
process_resident_memory_bytes
rest_client_request_duration_seconds_bucket
rest_client_requests_total
storage_operation_duration_seconds_bucket
storage_operation_duration_seconds_count
volume_manager_total_volumes

Prerequisites

None.

Installation

Installing an exporter is not required for this integration.

Agent Configuration

The default agent job for this integration is as follows:

- job_name: k8s-kubelet-default
  scrape_interval: 60s
  bearer_token_file: /var/run/secrets/kubernetes.io/serviceaccount/token
  scheme: https
  tls_config:
    ca_file: /var/run/secrets/kubernetes.io/serviceaccount/ca.crt
    insecure_skip_verify: true
  kubernetes_sd_configs:
  - role: node
  relabel_configs:
  - action: keep
    source_labels: [__meta_kubernetes_node_address_InternalIP]
    regex: __HOSTIPS__
  - action: labelmap
    regex: __meta_kubernetes_node_label_(.+)
    replacement: kube_node_label_$1
  - replacement: localhost:10250
    target_label: __address__
  - action: replace
    source_labels: [__meta_kubernetes_node_name]
    target_label: kube_node_name
  - action: replace
    source_labels: [__meta_kubernetes_namespace]
    target_label: kube_namespace_name
  metric_relabel_configs:
  # - source_labels: [__name__]
  #   regex: "kubelet_volume(.+)|storage(.+)"
  #   action: drop
  - source_labels: [__name__]
    regex: (go_goroutines|go_info|kube_node_status_capacity_pods|kube_node_status_condition|kubelet_cgroup_manager_duration_seconds_bucket|kubelet_cgroup_manager_duration_seconds_count|kubelet_node_config_error|kubelet_pleg_relist_duration_seconds_bucket|kubelet_pleg_relist_interval_seconds_bucket|kubelet_pod_start_duration_seconds_bucket|kubelet_pod_start_duration_seconds_count|kubelet_pod_worker_duration_seconds_bucket|kubelet_pod_worker_duration_seconds_count|kubelet_running_containers|kubelet_running_pods|kubelet_runtime_operations_duration_seconds_bucket|kubelet_runtime_operations_errors_total|kubelet_runtime_operations_total|kubernetes_build_info|process_cpu_seconds_total|process_resident_memory_bytes|rest_client_request_duration_seconds_bucket|rest_client_requests_total|volume_manager_total_volumes)
    action: keep