package consumer
- Alphabetic
- Public
- Protected
Package Members
- package diagnostics
- package internal
Type Members
- final case class CommittableRecord[K, V](record: ConsumerRecord[K, V], commitHandle: (Map[TopicPartition, Long]) => Task[Unit], consumerGroupMetadata: Option[ConsumerGroupMetadata]) extends Product with Serializable
- trait Consumer extends AnyRef
- final case class ConsumerSettings(bootstrapServers: List[String], properties: Map[String, AnyRef] = Map.empty, closeTimeout: zio.Duration = 30.seconds, pollTimeout: zio.Duration = 50.millis, offsetRetrieval: OffsetRetrieval = OffsetRetrieval.Auto(), rebalanceListener: RebalanceListener = RebalanceListener.noop, restartStreamOnRebalancing: Boolean = false, runloopTimeout: zio.Duration = ConsumerSettings.defaultRunloopTimeout, maxPartitionQueueSize: Int = 1024) extends Product with Serializable
- restartStreamOnRebalancing
When
true_all_ streams are restarted during a rebalance, including those streams that are not revoked. The default isfalse.- runloopTimeout
Internal timeout for each iteration of the command processing and polling loop, use to detect stalling. This should be much larger than the pollTimeout and the time it takes to process chunks of records. If your consumer is not subscribed for long periods during its lifetime, this timeout should take that into account as well. When the timeout expires, the plainStream/partitionedStream/etc will fail with a Consumer.RunloopTimeout.
- maxPartitionQueueSize
Maximum number of records to be buffered per partition. This buffer improves throughput and supports varying downstream message processing time, while maintaining some backpressure. Large values effectively disable backpressure at the cost of high memory usage, low values will effectively disable prefetching in favour of low memory consumption. The number of records that is fetched on every poll is controlled by the
max.poll.recordssetting, the number of records fetched for every partition is somewhere between 0 andmax.poll.records. A value that is a power of 2 offers somewhat better queueing performance. The default value for this parameter is 2 * the defaultmax.poll.recordsof 500, rounded to the nearest power of 2.
- final case class InvalidSubscriptionUnion(subscriptions: Chunk[Subscription]) extends RuntimeException with Product with Serializable
- sealed trait Offset extends AnyRef
- sealed trait OffsetBatch extends AnyRef
- trait RebalanceConsumer extends AnyRef
A subset of Consumer methods available during rebalances.
- final case class RebalanceListener(onAssigned: (Set[TopicPartition], RebalanceConsumer) => Task[Unit], onRevoked: (Set[TopicPartition], RebalanceConsumer) => Task[Unit], onLost: (Set[TopicPartition], RebalanceConsumer) => Task[Unit]) extends Product with Serializable
ZIO wrapper around Kafka's
ConsumerRebalanceListenerto work with Scala collection types and ZIO effects. - sealed trait Subscription extends AnyRef
Value Members
- object CommittableRecord extends Serializable
- object Consumer
- object ConsumerSettings extends Serializable
- case object EmptyOffsetBatch extends OffsetBatch with Product with Serializable
- object Offset
- object OffsetBatch
- object RebalanceConsumer
- object RebalanceListener extends Serializable
- object Subscription