This the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

Apache Kafka JMX Metrics

    See Application Integrations for more information.

    The kafka.consumer.* and kafka.producer.* metrics are only available with JMX customization as documented in Integrate JMX Metrics from Java Virtual Machines.

    kafka.consumer.bytes_consumed

    The average number of bytes consumed for a specific topic per second.

    kafka.consumer.bytes_in

    The rate of bytes coming in to the consumer.

    kafka.consumer.delayed_requests

    The number of delayed consumer requests.

    kafka.consumer.expires_per_second

    The rate of delayed consumer request expiration.

    kafka.consumer.fetch_rate

    The minimum rate at which the consumer sends fetch requests to a broker.

    kafka.consumer.fetch_size_avg

    The average number of bytes fetched for a specific topic per request.

    kafka.consumer.fetch_size_max

    The maximum number of bytes fetched for a specific topic per request.

    kafka.consumer.kafka_commits

    The rate of offset commits to Kafka.

    kafka.consumer.max_lag

    The maximum consumer lag.

    kafka.consumer.messages_in

    The rate of consumer message consumption.

    kafka.consumer.records_consumed

    The average number of records consumed per second for a specific topic.

    kafka.consumer.records_per_request_avg

    The average number of records in each request for a specific topic.

    kafka.consumer.zookeeper_commits

    The rate of offset commits to ZooKeeper.

    kafka.expires_sec

    The rate of delayed producer request expiration.

    kafka.follower.expires_per_second

    The rate of request expiration on followers.

    kafka.log.flush_rate

    The log flush rate.

    kafka.messages_in

    The incoming message rate.

    kafka.net.bytes_in

    The incoming byte rate.

    kafka.net.bytes_out

    The outgoing byte rate.

    kafka.net.bytes_rejected

    The rejected byte rate.

    kafka.producer.available_buffer_bytes

    The total amount of buffer memory, including unallocated buffer memory and memory in the free list, that is not being used.

    kafka.producer.batch_size_avg

    The average number of bytes sent per partition per-request.

    kafka.producer.batch_size_max

    The maximum number of bytes sent per partition per-request.

    kafka.producer.buffer_bytes_total

    The maximum amount of buffer memory the client can use.

    kafka.producer.bufferpool_wait_time

    The fraction of time an appender waits for space allocation.

    kafka.producer.bytes_out

    The rate of bytes going out for the producer.

    kafka.producer.compression_rate

    The average compression rate of record batches for a topic.

    kafka.producer.compression_rate_avg

    The average compression rate of record batches.

    kafka.producer.delayed_requests

    The number of producer requests delayed.

    kafka.producer.expires_per_seconds

    The rate of producer request expiration.

    kafka.producer.io_wait

    The producer I/O wait time.

    kafka.producer.message_rate

    The producer message rate.

    kafka.producer.metadata_age

    The age of the current producer metadata being used, in seconds.

    kafka.producer.record_error_rate

    The average number of retried record sends for a topic per second.

    kafka.producer.record_queue_time_avg

    The average time that record batches spent in the record accumulator, in milliseconds.

    kafka.producer.record_queue_time_max

    The maximum amount of time record batches can spend in the record accumulator, in milliseconds.

    kafka.producer.record_retry_rate

    The average number of retried record sends for a topic per second.

    kafka.producer.record_send_rate

    The average number of records sent per second for a topic.

    kafka.producer.record_size_avg

    The average record size.

    kafka.producer.record_size_max

    The maximum record size.

    kafka.producer.records_per_request

    The average number of records sent per second.

    kafka.producer.request_latency_avg

    The average request latency of the producer.

    kafka.producer.request_latency_max

    The maximum request latency in milliseconds.

    kafka.producer.request_rate

    The number of producer requests per second.

    kafka.producer.requests_in_flight

    The current number of in-flight requests awaiting a response

    kafka.producer.response_rate

    The number of producer responses per second.

    kafka.producer.throttle_time_avg

    The average time in a request was throttled by a broker, in milliseconds.

    kafka.producer.throttle_time_max

    The maximum time in a request was throttled by a broker, in milliseconds.

    kafka.producer.waiting_threads

    The number of user threads blocked waiting for buffer memory to enqueue their records.

    kafka.replication.isr_expands

    The rate of replicas joining the ISR pool.

    kafka.replication.isr_shrinks

    The rate of replicas leaving the ISR pool.

    kafka.replication.leader_elections

    The leader election rate.

    kafka.replication.unclean_leader_elections

    The unclean leader election rate.

    kafka.replication.under_replicated_partitions

    The number of unreplicated partitions.

    kafka.request.fetch.failed

    The number of client fetch request failures.

    kafka.request.fetch.failed_per_second

    The rate of client fetch request failures per second.

    kafka.request.fetch.time.99percentile

    The time for fetch requests for the 99th percentile.

    kafka.request.fetch.time.avg

    The average time per fetch request.

    kafka.request.handler.avg.idle.pct

    The average fraction of time the request handler threads are idle.

    kafka.request.metadata.time.99percentile

    The time for metadata requests for 99th percentile.

    kafka.request.metadata.time.avg

    The average time for a metadata request.

    kafka.request.offsets.time.99percentile

    The time for offset requests for the 99th percentile.

    kafka.request.offsets.time.avg

    The average time for an offset request.

    kafka.request.produce.failed

    The number of failed produce requests.

    kafka.request.produce.failed_per_second

    The rate of failed produce requests per second.

    kafka.request.produce.time.99percentile

    The time for produce requests for the 99th percentile.

    kafka.request.produce.time.avg

    The average time for a produce request.

    kafka.request.update_metadata.time.99percentile

    The time for update metadata requests for the 99th percentile

    kafka.request.update_metadata.time.avg

    The average time for a request to update metadata.