Apache Kafka JMX Metrics

See Application Integrations for more information.

The kafka.consumer.* and kafka.producer.* metrics are only available with JMX customization as documented in Integrate JMX Metrics from Java Virtual Machines.

kafka.consumer.bytes_consumed

The average number of bytes consumed for a specific topic per second.

kafka.consumer.bytes_in

The rate of bytes coming in to the consumer.

kafka.consumer.delayed_requests

The number of delayed consumer requests.

kafka.consumer.expires_per_second

The rate of delayed consumer request expiration.

kafka.consumer.fetch_rate

The minimum rate at which the consumer sends fetch requests to a broker.

kafka.consumer.fetch_size_avg

The average number of bytes fetched for a specific topic per request.

kafka.consumer.fetch_size_max

The maximum number of bytes fetched for a specific topic per request.

kafka.consumer.kafka_commits

The rate of offset commits to Kafka.

kafka.consumer.max_lag

The maximum consumer lag.

kafka.consumer.messages_in

The rate of consumer message consumption.

kafka.consumer.records_consumed

The average number of records consumed per second for a specific topic.

kafka.consumer.records_per_request_avg

The average number of records in each request for a specific topic.

kafka.consumer.zookeeper_commits

The rate of offset commits to ZooKeeper.

kafka.expires_sec

The rate of delayed producer request expiration.

kafka.follower.expires_per_second

The rate of request expiration on followers.

kafka.log.flush_rate

The log flush rate.

kafka.messages_in

The incoming message rate.

kafka.net.bytes_in

The incoming byte rate.

kafka.net.bytes_out

The outgoing byte rate.

kafka.net.bytes_rejected

The rejected byte rate.

kafka.producer.available_buffer_bytes

The total amount of buffer memory, including unallocated buffer memory and memory in the free list, that is not being used.

kafka.producer.batch_size_avg

The average number of bytes sent per partition per-request.

kafka.producer.batch_size_max

The maximum number of bytes sent per partition per-request.

kafka.producer.buffer_bytes_total

The maximum amount of buffer memory the client can use.

kafka.producer.bufferpool_wait_time

The fraction of time an appender waits for space allocation.

kafka.producer.bytes_out

The rate of bytes going out for the producer.

kafka.producer.compression_rate

The average compression rate of record batches for a topic.

kafka.producer.compression_rate_avg

The average compression rate of record batches.

kafka.producer.delayed_requests

The number of producer requests delayed.

kafka.producer.expires_per_seconds

The rate of producer request expiration.

kafka.producer.io_wait

The producer I/O wait time.

kafka.producer.message_rate

The producer message rate.

kafka.producer.metadata_age

The age of the current producer metadata being used, in seconds.

kafka.producer.record_error_rate

The average number of retried record sends for a topic per second.

kafka.producer.record_queue_time_avg

The average time that record batches spent in the record accumulator, in milliseconds.

kafka.producer.record_queue_time_max

The maximum amount of time record batches can spend in the record accumulator, in milliseconds.

kafka.producer.record_retry_rate

The average number of retried record sends for a topic per second.

kafka.producer.record_send_rate

The average number of records sent per second for a topic.

kafka.producer.record_size_avg

The average record size.

kafka.producer.record_size_max

The maximum record size.

kafka.producer.records_per_request

The average number of records sent per second.

kafka.producer.request_latency_avg

The average request latency of the producer.

kafka.producer.request_latency_max

The maximum request latency in milliseconds.

kafka.producer.request_rate

The number of producer requests per second.

kafka.producer.requests_in_flight

The current number of in-flight requests awaiting a response

kafka.producer.response_rate

The number of producer responses per second.

kafka.producer.throttle_time_avg

The average time in a request was throttled by a broker, in milliseconds.

kafka.producer.throttle_time_max

The maximum time in a request was throttled by a broker, in milliseconds.

kafka.producer.waiting_threads

The number of user threads blocked waiting for buffer memory to enqueue their records.

kafka.replication.isr_expands

The rate of replicas joining the ISR pool.

kafka.replication.isr_shrinks

The rate of replicas leaving the ISR pool.

kafka.replication.leader_elections

The leader election rate.

kafka.replication.unclean_leader_elections

The unclean leader election rate.

kafka.replication.under_replicated_partitions

The number of unreplicated partitions.

kafka.request.fetch.failed

The number of client fetch request failures.

kafka.request.fetch.failed_per_second

The rate of client fetch request failures per second.

kafka.request.fetch.time.99percentile

The time for fetch requests for the 99th percentile.

kafka.request.fetch.time.avg

The average time per fetch request.

kafka.request.handler.avg.idle.pct

The average fraction of time the request handler threads are idle.

kafka.request.metadata.time.99percentile

The time for metadata requests for 99th percentile.

kafka.request.metadata.time.avg

The average time for a metadata request.

kafka.request.offsets.time.99percentile

The time for offset requests for the 99th percentile.

kafka.request.offsets.time.avg

The average time for an offset request.

kafka.request.produce.failed

The number of failed produce requests.

kafka.request.produce.failed_per_second

The rate of failed produce requests per second.

kafka.request.produce.time.99percentile

The time for produce requests for the 99th percentile.

kafka.request.produce.time.avg

The average time for a produce request.

kafka.request.update_metadata.time.99percentile

The time for update metadata requests for the 99th percentile

kafka.request.update_metadata.time.avg

The average time for a request to update metadata.