This the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

  • 1:
    • 2:

      1 -

      Apache Kafka Consumer Metrics

      See also: Apache Kafka integration information.

      kafka.broker_offset

      The current message offset value on the broker.

      kafka.consumer_lag

      The lag in messages between the consumer and the broker.

      kafka.consumer_offset

      The current message offset value on the consumer.

      2 -

      Apache Kafka JMX Metrics

      See also: Apache Kafka integration information.

      The kafka.consumer.* and kafka.producer.* metrics are only available with JMX customization as documented in Integrate JMX Metrics from Java Virtual Machines.

      kafka.consumer.bytes_consumed

      The average number of bytes consumed for a specific topic per second.

      kafka.consumer.bytes_in

      The rate of bytes coming in to the consumer.

      kafka.consumer.delayed_requests

      The number of delayed consumer requests.

      kafka.consumer.expires_per_second

      The rate of delayed consumer request expiration.

      kafka.consumer.fetch_rate

      The minimum rate at which the consumer sends fetch requests to a broker.

      kafka.consumer.fetch_size_avg

      The average number of bytes fetched for a specific topic per request.

      kafka.consumer.fetch_size_max

      The maximum number of bytes fetched for a specific topic per request.

      kafka.consumer.kafka_commits

      The rate of offset commits to Kafka.

      kafka.consumer.max_lag

      The maximum consumer lag.

      kafka.consumer.messages_in

      The rate of consumer message consumption.

      kafka.consumer.records_consumed

      The average number of records consumed per second for a specific topic.

      kafka.consumer.records_per_request_avg

      The average number of records in each request for a specific topic.

      kafka.consumer.zookeeper_commits

      The rate of offset commits to ZooKeeper.

      kafka.expires_sec

      The rate of delayed producer request expiration.

      kafka.follower.expires_per_second

      The rate of request expiration on followers.

      kafka.log.flush_rate

      The log flush rate.

      kafka.messages_in

      The incoming message rate.

      kafka.net.bytes_in

      The incoming byte rate.

      kafka.net.bytes_out

      The outgoing byte rate.

      kafka.net.bytes_rejected

      The rejected byte rate.

      kafka.producer.available_buffer_bytes

      The total amount of buffer memory, including unallocated buffer memory and memory in the free list, that is not being used.

      kafka.producer.batch_size_avg

      The average number of bytes sent per partition per-request.

      kafka.producer.batch_size_max

      The maximum number of bytes sent per partition per-request.

      kafka.producer.buffer_bytes_total

      The maximum amount of buffer memory the client can use.

      kafka.producer.bufferpool_wait_time

      The fraction of time an appender waits for space allocation.

      kafka.producer.bytes_out

      The rate of bytes going out for the producer.

      kafka.producer.compression_rate

      The average compression rate of record batches for a topic.

      kafka.producer.compression_rate_avg

      The average compression rate of record batches.

      kafka.producer.delayed_requests

      The number of producer requests delayed.

      kafka.producer.expires_per_seconds

      The rate of producer request expiration.

      kafka.producer.io_wait

      The producer I/O wait time.

      kafka.producer.message_rate

      The producer message rate.

      kafka.producer.metadata_age

      The age of the current producer metadata being used, in seconds.

      kafka.producer.record_error_rate

      The average number of retried record sends for a topic per second.

      kafka.producer.record_queue_time_avg

      The average time that record batches spent in the record accumulator, in milliseconds.

      kafka.producer.record_queue_time_max

      The maximum amount of time record batches can spend in the record accumulator, in milliseconds.

      kafka.producer.record_retry_rate

      The average number of retried record sends for a topic per second.

      kafka.producer.record_send_rate

      The average number of records sent per second for a topic.

      kafka.producer.record_size_avg

      The average record size.

      kafka.producer.record_size_max

      The maximum record size.

      kafka.producer.records_per_request

      The average number of records sent per second.

      kafka.producer.request_latency_avg

      The average request latency of the producer.

      kafka.producer.request_latency_max

      The maximum request latency in milliseconds.

      kafka.producer.request_rate

      The number of producer requests per second.

      kafka.producer.requests_in_flight

      The current number of in-flight requests awaiting a response

      kafka.producer.response_rate

      The number of producer responses per second.

      kafka.producer.throttle_time_avg

      The average time in a request was throttled by a broker, in milliseconds.

      kafka.producer.throttle_time_max

      The maximum time in a request was throttled by a broker, in milliseconds.

      kafka.producer.waiting_threads

      The number of user threads blocked waiting for buffer memory to enqueue their records.

      kafka.replication.isr_expands

      The rate of replicas joining the ISR pool.

      kafka.replication.isr_shrinks

      The rate of replicas leaving the ISR pool.

      kafka.replication.leader_elections

      The leader election rate.

      kafka.replication.unclean_leader_elections

      The unclean leader election rate.

      kafka.replication.under_replicated_partitions

      The number of unreplicated partitions.

      kafka.request.fetch.failed

      The number of client fetch request failures.

      kafka.request.fetch.failed_per_second

      The rate of client fetch request failures per second.

      kafka.request.fetch.time.99percentile

      The time for fetch requests for the 99th percentile.

      kafka.request.fetch.time.avg

      The average time per fetch request.

      kafka.request.handler.avg.idle.pct

      The average fraction of time the request handler threads are idle.

      kafka.request.metadata.time.99percentile

      The time for metadata requests for 99th percentile.

      kafka.request.metadata.time.avg

      The average time for a metadata request.

      kafka.request.offsets.time.99percentile

      The time for offset requests for the 99th percentile.

      kafka.request.offsets.time.avg

      The average time for an offset request.

      kafka.request.produce.failed

      The number of failed produce requests.

      kafka.request.produce.failed_per_second

      The rate of failed produce requests per second.

      kafka.request.produce.time.99percentile

      The time for produce requests for the 99th percentile.

      kafka.request.produce.time.avg

      The average time for a produce request.

      kafka.request.update_metadata.time.99percentile

      The time for update metadata requests for the 99th percentile

      kafka.request.update_metadata.time.avg

      The average time for a request to update metadata.