Type Members

1.  trait FetchStrategy extends AnyRef

   A fetch strategy determined which stream are allowed to fetch data in the next poll.

   A fetch strategy determined which stream are allowed to fetch data in the next poll.

   WARNING: this is an EXPERIMENTAL API and may change in an incompatible way without notice in any zio-kafka version.

2.  final case class QueueSizeBasedFetchStrategy(partitionPreFetchBufferLimit: Int = 1024) extends FetchStrategy with Product with Serializable

   A fetch strategy that allows a stream to fetch data when its queue size is below partitionPreFetchBufferLimit.

   A fetch strategy that allows a stream to fetch data when its queue size is below partitionPreFetchBufferLimit.

   partitionPreFetchBufferLimit

   The queue size below which more records are fetched and buffered (per partition). This buffer improves throughput and supports varying downstream message processing time, while maintaining some backpressure. Large values effectively disable backpressure at the cost of high memory usage, low values will effectively disable prefetching in favour of low memory consumption. The number of records that is fetched on every poll is controlled by the max.poll.records setting, the number of records fetched for every partition is somewhere between 0 and max.poll.records. A value that is a power of 2 offers somewhat better queueing performance. The default value for this parameter is 2 * the default max.poll.records of 500, rounded to the nearest power of 2.